Experienced Big Data Engineer - Cloud & Scalable Application Development at American Express

Unlock Your Potential as a Big Data Engineer at American Express American Express, a leader in the financial services industry, is seeking a highly skilled and experienced Big Data Engineer to join its innovative technology team. As a key member of our product engineering and delivery team, you will play a crucial role in designing, developing, and deploying cutting-edge big data solutions that drive business growth and customer satisfaction. About American Express and the Role At American Express, we empower our technology teams to innovate and experiment with the latest technologies, fostering a culture of collaboration, creativity, and continuous learning. As a Big Data Engineer, you will be part of a dynamic and agile team that leverages groundbreaking technologies such as Hadoop, Big Data, Data Science, and Machine Learning to deliver innovative solutions across multiple lines of business. In this role, you will report to an Engineering Manager and be responsible for: Designing, developing, and testing software applications using programming languages such as Java, Python, and Scala Contributing to software development through consistent development practices, including code reviews, automated testing, and continuous integration Troubleshooting primary software components, identifying code defects, and enabling the deployment, support, and monitoring of software across test, integration, and production environments Automating solutions in test or production environments and scaling applications based on demand projections Leading a small team of engineers and influencing peers with innovative changes and enhancements Essential Qualifications and Skills To succeed in this role, you will need: A Bachelor's degree in Engineering, Software Engineering, or a related field, or a Master's degree in Computer Applications or a related field 3+ years of experience in software development and leading teams of engineers and scrum teams 3+ years of hands-on experience working with Guide Reduce, Hive, Spark (core, SQL, and PySpark) Strong understanding of Data Warehousing concepts and experience with financial reporting environments Expertise in distributed environments, programming using Core Java or Python/Scala, and Hadoop and Spark architecture Experience with UNIX shell scripting, designing and developing advanced data pipelines, and analyzing complex SQL (Hive/PySpark-dataframes) Demonstrated ability to create and document technical and functional specifications and analyze software and system processing flows Preferred Qualifications and Skills To further enhance your candidacy, you will ideally have: Knowledge of cloud platforms such as GCP/AWS, building Microservices, and scalable solutions 3+ years of experience with designing and building solutions using Kafka streams or queues Experience with GitHub/Bitbucket and utilizing CI/CD pipelines Experience with NoSQL databases such as HBase, Couchbase, or MongoDB Excellent technical and analytical skills, as well as strong communication and project management abilities Career Growth Opportunities and Learning Benefits At American Express, we are committed to helping our employees grow and develop their skills. As a Big Data Engineer, you will have access to: Ongoing training and development opportunities to stay up-to-date with the latest technologies and trends Collaboration with cross-functional teams to drive business innovation and growth Opportunities to lead and influence peers, driving technical excellence and innovation A culture that encourages experimentation, learning from failure, and continuous improvement Work Environment and Company Culture American Express is committed to creating a diverse and inclusive work environment that fosters creativity, collaboration, and innovation. As a Big Data Engineer, you will be part of a dynamic team that values: Open communication and transparency Collaboration and teamwork Innovation and experimentation Continuous learning and development Diversity and inclusion Compensation, Perks, and Benefits American Express offers a competitive compensation package, including a salary of $28/hour, as well as a range of benefits and perks, such as: Comprehensive health and wellness programs Retirement savings plans Paid time off and holidays Opportunities for career growth and development A dynamic and inclusive work environment Join Our Team and Shape the Future of Financial Services If you are a motivated and experienced Big Data Engineer looking to drive innovation and growth in the financial services industry, we encourage you to apply for this exciting opportunity. At American Express, we are committed to creating a diverse and inclusive work environment that fosters creativity, collaboration, and continuous learning. Join our team and help shape the future of financial services! To apply, please visit our website and submit your application. We look forward to hearing from you! Apply for this job Apply tot his job