Lead Software Engineer

Mastercard • O Fallon, MO • 13h ago

Our Purpose

Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.

Title and Summary

Job Summary:

As a Lead Software Engineer focused on Data Quality, you will lead the design, development, and deployment of scalable data quality frameworks and pipelines. You will work closely with data engineers, analysts, and business stakeholders to build robust solutions that validate, monitor, and improve data quality across large-scale distributed systems.

Key Responsibilities:

Lead the design and implementation of data quality frameworks and automated validation pipelines using Python, Apache Spark, and Hadoop ecosystem tools.

Develop, deploy, and maintain scalable ETL/ELT workflows using Apache - Airflow and Apache NiFi to ensure seamless data ingestion, transformation, and quality checks.

Collaborate with cross-functional teams to understand data quality requirements and translate them into technical solutions.

Define and enforce data quality standards, rules, and monitoring processes.

Perform root cause analysis on data quality issues and implement effective fixes and enhancements.

Mentor and guide junior engineers, conducting code reviews and fostering best practices.

Continuously evaluate and integrate new tools and technologies to enhance data quality capabilities.

Ensure high code quality, performance, and reliability in all data processing pipelines.

Create comprehensive documentation and reports on data quality metrics and system architecture.

All About You:

Bachelor's or Master's degree in Computer Science, Engineering, or a related field with Data Engineering Experience.

Proficient professional experience in software development, with at least 2 years in a lead or senior engineering role.

Strong proficiency in Python programming and experience building data processing applications.

Hands-on expertise with Apache Spark and Hadoop for big data processing.

Solid experience with workflow orchestration tools like Apache Airflow.

Experience designing and managing data ingestion and integration pipelines with Apache NiFi.

Understanding on Data Quality automation, CI/CD, Jenkins, Oracle, Power BI, Splunk

Deep understanding of data quality concepts, data validation techniques, and distributed data systems.

Strong problem-solving skills and ability to lead technical discussions.

Experience with cloud platforms (AWS, GCP, or Azure) is a plus.

Excellent communication and collaboration skills

Mastercard is a merit-based, inclusive, equal opportunity employer that considers applicants without regard to gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law. We hire the most qualified candidate for the role. In the US or Canada, if you require accommodations or assistance to complete the online application process or during the recruitment process, please contact reasonable_accommodation@mastercard.com and identify the @type of accommodation or assistance you are requesting. Do not include any medical or health information in this email. The Reasonable Accommodations team will respond to your email promptly.

Corporate Security Responsibility

All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:

Abide by Mastercard's security policies and practices;

Ensure the confidentiality and integrity of the information being accessed;

Report any suspected information security violation or breach, and

Complete all periodic mandatory security trainings in accordance with Mastercard's guidelines.

In line with Mastercard's total compensation philosophy and assuming that the job will be performed in the US, the successful candidate will be offered a competitive base salary based on location, experience and other qualifications for the role and may be eligible for an annual bonus or commissions depending on the role. Mastercard benefits for full time (and certain part time) employees generally include: insurance (including medical, prescription drug, dental, vision, disability, life insurance), flexible spending account and health savings account, paid leaves (including 16 weeks new parent leave, up to 20 paid days bereavement leave), 10 annual paid sick days, 10 or more annual paid vacation days based on level, 5 personal days, 10 annual paid U.S. observed holidays, 401k with a best-in-class company match, deferred compensation for eligible roles, fitness reimbursement or on-site fitness facilities, eligibility for tuition reimbursement, gender-inclusive benefits and many more.

Pay Ranges

O'Fallon, Missouri: $138,000 - $221,000 USD

Similar Jobs

Production Technician - 2nd shift

Central States Manufacturing • Saint Peters, MO • 1d ago

IT & Engineering

Description Come be an Employee-Owner of one of the nation's largest producers of metal roofing and siding! We sell, manufacture, build, and distribute metal building components and packages. Since 1988 we've grown to ov...

1d ago

Go to Apply

Manufacturing Processing Technician - Dye Mixer

ManpowerGroup • Saint Peters, MO • 3d ago

IT & Engineering

Manpower is currently seeking motivated & experienced Processing Technician/Mixer in St. Peters, MO to work for our client Reckitt Manufacturing. What's in it for you? Pay Range: $25.00 PER HR Hours: Several Shifts O...

3d ago

Go to Apply

Software Engineer Developer

The Boeing Company • Maryland Heights, MO • 4d ago

IT & Engineering

Job Description At Boeing, we innovate and collaborate to make the world a better place. We're committed to fostering an environment for every teammate that's welcoming, respectful and inclusive, with great opportunity f...

4d ago

Go to Apply

Electrical Designer

Actalent • Maryland Heights, MO • 1w ago

IT & Engineering

Job Title: Electrical DesignerJob Description We are seeking a qualified Electrical Project Engineer or Senior Designer to join our team of professional and talented engineers, designers, and support staff. This individu...

1w ago

Go to Apply

Staff Machine Learning Eng

Bayer • Chesterfield, MO • 1w ago

IT & Engineering

At Bayer we're visionaries, driven to solve the world's toughest challenges and striving for a world where 'Health for all Hunger for none' is no longer a dream, but a real possibility. We're doing it with energy, curios...

1w ago

Go to Apply

Electrical Technician 3

Craftsmen Industries, Inc. • Saint Charles, MO • 1w ago

IT & Engineering

About Craftsmen Industries Craftsmen Industries custom manufactures unique specialty trailers and vehicles and large format printed elements for experiential marketing and industrial solutions for brands across the indus...

1w ago

Go to Apply

Electrical Panel Assembler

CPM Holdings, Inc. • Saint Charles, MO • 2w ago

IT & Engineering

CPM Holdings Inc. is a leading process and equipment solutions provider to the oilseed, animal feed, biomass, food, and materials processing industries. We also serve the corn wet milling, pet food, ethanol and wood indu...

2w ago

Go to Apply

Software Engineer

U.S. Bank • Earth City, MO • 2w ago

IT & Engineering

At U.S. Bank, we're on a journey to do our best. Helping the customers and businesses we serve to make better and smarter financial decisions and enabling the communities we support to grow and succeed. We believe it tak...

2w ago

Go to Apply

Shop Technician/Class A CDL Driver

Craftsmen Industries, Inc. • Saint Charles, MO • 2w ago

IT & Engineering

This job was posted by https://illinoisjoblink.illinois.gov : For more information, please see: https://illinoisjoblink.illinois.gov/jobs/12784081 About Craftsmen Industries Craftsmen Industries custom manufactures uniqu...

2w ago

Go to Apply

Senior IT Asset Specialist

U.S. Bank • Earth City, MO • 2w ago

IT & Engineering

2w ago

Go to Apply

Subscribe to get new jobs sent directly to you
(no charge, cancel anytime)

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.