ERM Logo

ERM

Data Engineer - India GDC (Gurugram)

Reposted 5 Days Ago
Be an Early Applicant
In-Office
New Delhi, Delhi
Mid level
In-Office
New Delhi, Delhi
Mid level
Develop and maintain scalable data pipelines in Azure and Microsoft Fabric, optimize data workflows, and apply scientific algorithms to climate model data.
The summary above was generated by AI

Who is ERM?
ERM is a leading global sustainability consulting firm, committed for nearly 50 years to helping organizations navigate complex environmental, social, and governance (ESG) challenges. We bring together a diverse and inclusive community of experts across regions and disciplines, providing a truly multicultural environment that fosters collaboration, professional growth, and meaningful global exposure. As a people-first organization, ERM values well-being, career development, and the power of collective expertise to drive sustainable impact for our clients—and the planet.
Introducing our new Global Delivery Centre (GDC)
Our Global Delivery Centre (GDC) in India is a unified platform designed to deliver high-value services and solutions to ERM’s global clientele. By centralizing key business and consulting functions, we streamline operations, optimize service delivery, and enable our teams to focus on what matters most—advising clients on sustainability challenges with agility and innovation. Through the GDC, you will collaborate with international teams, leverage emerging technologies, and further enhance ERM’s commitment to excellence—amplifying our shared mission to make a lasting, positive impact.

ERM is seeking a Data Engineer to join our Digital Products team. This is an exciting opportunity for an early- to mid-career data professional to support cutting-edge climate science by engineering high-performance data pipelines and workflows in Azure and Microsoft Fabric. The successful candidate will help operationalize global climate model data and other scientific datasets by applying algorithms developed by ERM’s climate scientists and consultants, supporting large-scale climate risk assessments across sectors including energy, finance, infrastructure, and natural resources.

You’ll work alongside a team of experts in climate science, software development, and environmental consulting. You’ll also have access to a global network of technical specialists and opportunities to grow your skills within a purpose-driven organization.

RESPONSIBILITIES:

  • Develop, test, and maintain scalable data pipelines in Azure and Microsoft Fabric to process climate and environmental data.

  • Support the application of scientific algorithms to global climate model outputs and other multidimensional datasets (e.g., NetCDF, Zarr).

  • Optimize data pipelines for performance, scalability, and reliability, including benchmarking storage read/write speeds and tuning Spark-based workflows.

  • Implement logging, monitoring, and metadata management systems for traceability and auditability.

  • Evaluate and configure Azure storage (Blob, Data Lake, etc.) for climate-scale workloads; ensure performance alignment with data access needs.

  • Build and manage distributed processing pipelines to support large-scale data transformations using PySpark and parallel computing strategies.

  • Monitor and optimize I/O performance across workflows and storage tiers.

  • Collaborate with climate scientists and software engineers to translate prototype code into scalable, production-ready processes.

  • Document data engineering workflows and support internal data governance efforts.

REQUIREMENTS:

  • Bachelor’s degree in Computer Science, Data Science, Environmental/Climate Science, Oceanography, or a related field.

  • 2+ years of experience in data engineering, including pipeline development and workflow optimization (cloud-based preferred).

  • Hands-on experience with Microsoft Azure data services and/or Microsoft Fabric.

  • Strong programming skills in Python; experience with Spark (PySpark or SparkSQL) in distributed environments.

  • Demonstrated experience working with large, multidimensional datasets (Zarr, NetCDF, HDF5).

  • Familiarity with cloud storage performance tuning and benchmarking techniques.

  • Experience implementing logging, monitoring, and metadata practices in data environments.

  • Strong communication skills, with ability to collaborate across technical and non-technical teams.

  • Preferred: Azure Data Engineering certification, or demonstrable equivalent experience.

Top Skills

Azure
Hdf5
Microsoft Fabric
Netcdf
Pyspark
Python
Sparksql
Zarr

Similar Jobs

3 Days Ago
In-Office
New Delhi, Delhi, IND
Entry level
Entry level
Information Technology • Consulting
The Data Engineer will enhance consulting capabilities using AI tools, support project teams with tech solutions, and foster independent problem-solving skills.
Top Skills: Microsoft FabricPython
6 Hours Ago
Remote or Hybrid
16 Locations
Senior level
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
The Sr. Software Engineer will create file format parsers, collaborate on machine learning features, and maintain software systems. Responsibilities include testing, optimization, and documentation.
Top Skills: AWSAzureBitbucketC++GCPGitJenkinsJIRAPythonRust
6 Hours Ago
Remote or Hybrid
Delhi, Connaught Place, New Delhi, Delhi, IND
Mid level
Mid level
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Big Data Analytics • Automation
As a Solution Engineer at Dynatrace, you will support sales through demos, technical guidance, and managing POCs while collaborating with various teams and clients.
Top Skills: .NetAnsibleAWSAzureCSSGCPGoHTMLJavaKubernetesLinuxNode.jsOpenshiftPHPPuppetTerraformWindows

What you need to know about the Kolkata Tech Scene

When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account