Mastercard Logo

Mastercard

Senior Big Data Engineer

Reposted 19 Days Ago
Be an Early Applicant
Hybrid
2 Locations
Senior level
Hybrid
2 Locations
Senior level
Design and build scalable data pipelines to support Mastercard’s SpendingPulse product, collaborating with cross-functional teams to deliver economic insights and ensure high performance and reliability.
The summary above was generated by AI

Our Purpose

Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.

Title and Summary

Senior Big Data Engineer

SpendingPulse is a data product that provides economic insights to our customers. We analyze billions of transactions across the globe to power our platform and create reports on historical consumer spending, predictions of future spending, and commentary on the current economic climate for our customers across financial, retail, and government sectors across the globe. We are looking for an innovative engineer who will design data pipelines on our in-house, 800+ node Hadoop cluster and expand our footprint to cloud infrastructure. We work closely with Data Science, Product Management, and Data Warehouse teams to create reliable, scalable, and flexible data pipelines. The team is located in Prague, the United States, and India. This position requires a strong foundation in programming and SQL. Experience with Spark is preferred, but not required. Every team member contributes to designing, building, and testing new features.
The SpendingPulse team is currently scaling the product globally, adding new countries, new sectors, and expanding with new features. As the product continues to grow, we must design our infrastructure and codebase to facilitate quality control and reliability for our customers. In addition to our ongoing efforts on-prem, we are currently exploring moving our pipelines to cloud technologies like Databricks.
The SpendingPulse team is part of Mastercard's Services organization. Services are a key differentiator for Mastercard, helping our clients make better decisions around the world.
Position Responsibilities
As a Senior Data Engineer on the data pipeline team, you will:
Build scalable and maintainable data pipelines to expand SpendingPulse with new features and deliver insights from economic trends.
Drive performance, reliability, and readability in our code base, allowing us to troubleshoot quickly and publish data consistently.
Test your code and review code from other team members.
Continuously innovate and determine new approaches, tools, techniques, and technologies to solve business problems.
Partner with roles across the organization including data scientists, product managers, and system administrators to determine the highest priority problems to solve.
Ideal Candidate Qualifications
Strong foundation in programming. Python is preferred, but experience in other high-level languages is ok.
Strong SQL, writing readable and well-tuned queries.
Familiarity with objected-oriented software design.
Familiarity Linux command line.
Experience with big data technologies like PySpark is a bonus.
Clear communicator; Strong written and verbal English skills
Motivation, creativity, self-direction, and desire to thrive on small project teams.
Ability to collaborate within the team across roles and communicate with teammates who have varying levels of technical understanding.
Strong technologist eager to learn new tools and frameworks.
Passion for analytical / quantitative problem solving.
Eager to experiment with new team processes and innovate on development approaches.

Corporate Security Responsibility


All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:

  • Abide by Mastercard’s security policies and practices;

  • Ensure the confidentiality and integrity of the information being accessed;

  • Report any suspected information security violation or breach, and

  • Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.




Top Skills

Databricks
Hadoop
Pyspark
Python
SQL

Similar Jobs

10 Days Ago
Hybrid
2 Locations
Senior level
Senior level
Artificial Intelligence • Software
The Senior Data Engineer will build, deploy, and manage data pipelines and processing solutions using Big Data and ETL technologies while ensuring data integrity and performance.
Top Skills: AirflowAthenaAWSGCPHadoopKafkaKibanaMongoDBPrestoPythonRedashRedshiftScalaSparkSQLTableau
4 Hours Ago
Hybrid
Delhi, Connaught Place, New Delhi, Delhi, IND
Mid level
Mid level
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
The Healthcare Executive is responsible for achieving territory sales budgets, conducting sales analytics, and fostering relationships with medical practitioners while adhering to company policies.
Top Skills: Product Promotion TechnologySales AnalyticsTechnology Solutions
4 Hours Ago
Hybrid
2 Locations
Mid level
Mid level
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Develop and enhance customer relations while driving sales for Pfizer's products. Responsible for strategic planning, market analysis, and execution of promotional strategies in healthcare.

What you need to know about the Kolkata Tech Scene

When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account