Mastercard Logo

Mastercard

Senior Data Engineer

Posted Yesterday
Be an Early Applicant
Hybrid
Pune, Maharashtra
Senior level
Hybrid
Pune, Maharashtra
Senior level
Build and maintain petabyte-scale data pipelines, entity-centric data models, and distributed workflows using Databricks and Spark. Partner with data science teams to productionize ML features and artifacts, optimize ETL/ELT processes, and implement testing, monitoring, observability, and incident response. Collaborate with governance and operations teams to ensure secure, compliant data management while supporting scalable merchant identity and trust-profile systems.
The summary above was generated by AI
Our Purpose
Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.
Title and Summary
Senior Data Engineer
The AI Innovation at Scale team is seeking a highly motivated and detail-oriented Quality Assurance Engineer to join our team. This role is critical in ensuring the delivery of high-quality products by assessing requirements, identifying issues, and implementing effective testing strategies. The ideal candidate is curious, detail-oriented, technically skilled, and thrives in a collaborative environment. You will play a key role in improving quality management and continuous improvement.
RoleAs a Senior Data Engineer, you will:• Be an integral part of a creative and innovative team, contributing to collaborative projects and sharing insights to drive engineering and data science excellence• Work with cutting-edge big data platforms (e.g., Databricks, Apache Spark) at petabyte scale, pushing the boundaries of data processing and model enablement• Partner closely with Data Science teams to enable seamless R&D, scale models, features, and experimentations into reliable systems• Support the deployment of model features and model artifacts, ensuring seamless integration into production environments and downstream decisioning systems• Write clean, testable, and maintainable code, ensuring solutions are robust, efficient, and production-grade• Design, build, and maintain data pipelines that integrate multiple data sources to support a unified merchant registry and trust profile, enabling richer datasets and unlocking new opportunities for innovation• Collaborate with data operations and governance teams to move and manage data in compliance with security standards, policies, and regulatory requirements• Contribute to the design and evolution of scalable, entity-centric data models that support merchant identity resolution and longitudinal profiling• Automate and maintain data workflows in distributed environments, improving reliability and operational efficiency• Analyze and optimize ETL/ELT processes to support high-performance data access and model execution• Implement testing frameworks and monitoring capabilities to ensure production solutions are reliable, observable, and continuously improving• Support incident response, debugging, and performance tuning of production AI/ML systemsAbout You
Essential Skills to be successful:• Proven track record of self-directed learning, demonstrating the ability to acquire new skills and knowledge independently• Strong independent research skills and resourcefulness, enabling you to find solutions and innovate in data engineering• Strong understanding of data pipelines and end-to-end ML model development workflows, with exposure to entity-centric data systems• Experience with Python and SQL, showcasing the ability to write clean, readable, and maintainable code• Experience with big data technologies (e.g., Spark, distributed compute frameworks)• Hands-on experience with cloud platforms such as Databricks, AWS, or GCP• Critical thinking and a drive to produce high-quality work, ensuring all solutions meet rigorous standards• Strong communication skills, enabling effective collaboration with team members and stakeholders• Experience collaborating across data science, engineering, and governance teams• Ability and interest in problem-solving, with a proactive approach to tackling challenges• Openness to learn and apply new technologies, staying current with industry trends and advancements• Familiarity with Agile methodologies, with the ability to drive iterative delivery and cross-team collaboration• Bachelor's degree in Computer Science, Data Analytics, Mathematics, Software Engineering, or a related field or equivalent practical experience• Contributions to platform standardization, reusability, and shared tooling across teamsNice to Have• Experience working in hybrid environments (cloud and on-premises)• Familiarity with ML lifecycle and CI/CD practices for data and ML workflows• Experience with data governance, lineage, and metadata management• Exposure to batch, streaming, or real-time data pipelines and production ML monitoring/observability• Experience supporting high-scale production systems in merchant, fraud, or payment domains• Understanding of security, compliance, and handling sensitive data• Experience designing scalable databases and data models such as business registries• Experience with database updates and maintenance
Corporate Security Responsibility
All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:
  • Abide by Mastercard's security policies and practices;
  • Ensure the confidentiality and integrity of the information being accessed;
  • Report any suspected information security violation or breach, and
  • Complete all periodic mandatory security trainings in accordance with Mastercard's guidelines.

Similar Jobs at Mastercard

13 Days Ago
Hybrid
Senior level
Senior level
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Develop, test, validate, and support large-scale batch and real-time data platforms using Spark, Kafka, and NiFi. Build resilient data pipelines, validation frameworks, reusable platform components, and deployment automation. Optimize distributed systems for performance, scalability, and reliability; support production operations, monitoring, troubleshooting, and incident resolution. Collaborate on architecture, CI/CD, documentation, and engineering standards while mentoring junior engineers.
Top Skills: Apache KafkaApache NifiApache OzoneSparkCephCi/CdDockerGitHdfsKubernetesLinuxPysparkPythonScalaShell ScriptingSQL
One Month Ago
Hybrid
Senior level
Senior level
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Design, build, and maintain scalable batch and near-real-time data pipelines and curated datasets. Enable ML-ready feature datasets, implement reliability patterns, ensure secure data handling and governance, and drive engineering best practices in collaboration with data science, platform, and BI stakeholders.
Top Skills: AWSCi/CdDatabricksDatabricks LakehouseHadoopLakehouse PatternsMlopsObject StoragePysparkPythonS3ScalaSparkSQL
One Month Ago
Hybrid
Senior level
Senior level
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Lead design and implementation of an Analytic Foundation and scalable big-data services delivered via APIs. Build data pipelines, analytics and data models, responsive UIs, and production ML/data-driven applications. Ensure high-quality, well-tested code, mentor junior engineers, drive process improvements, and collaborate with product and design teams to deliver customer-focused data solutions.
Top Skills: .NetAdvanced StatisticsAirflowC#HadoopHiveImpalaJavaMachine LearningNifiPythonReactReduxScalaSparkSpring BootSQLSQL ServerSqoopTypescript

What you need to know about the Kolkata Tech Scene

When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account