Design and maintain scalable data pipelines on Azure, transform data across layers, implement CI/CD, and collaborate with teams for analytics and reporting.
We are looking for an experienced Azure Data Engineer to design and build scalable data pipelines on Azure. The role involves ingesting raw data, transforming it through curated layers, and delivering high-quality Gold-layer datasets for analytics and reporting using Azure Databricks.
RequirementsKey Responsibilities
- Design, build, and maintain end-to-end data pipelines on Azure
- Ingest raw data from multiple sources and transform it into Bronze, Silver, and Gold layers
- Develop scalable data processing solutions using Azure Databricks
- Build optimized data models to support analytics and business reporting
- Ensure data quality, reliability, and performance across pipelines
- Implement CI/CD and version control best practices for data engineering
- Collaborate with analytics, platform, and business teams
- Strong hands-on experience with Azure Data Engineering
- Experience working with Azure Databricks
- Proficiency in Python and PySpark
- Strong SQL and analytical skills
- Experience building and maintaining data pipelines
- Hands-on with Git/GitHub for version control
- Exposure to CI/CD tools (Azure DevOps, Jenkins, or similar)
- Experience with dbt
- Knowledge of Terraform or Infrastructure-as-Code
- Experience with Azure services like ADLS, Azure Data Factory
- Understanding of data modeling and analytics engineering concepts
- Experience in Agile/Scrum environments
- Strong communication and stakeholder management skills
BenefitsWhat We Offer
- Opportunity to work on modern cloud data platforms
- Challenging, high-impact data projects
- Collaborative and engineering-driven culture
Top Skills
Adls
Azure
Azure Data Factory
Azure Databricks
Azure Devops
Ci/Cd
Dbt
Git
Git
Jenkins
Pyspark
Python
SQL
Terraform
Similar Jobs
Artificial Intelligence • Productivity • Software • Automation
Lead and develop a team of backend engineers for Integration Quality at Zapier, focusing on reliability, security, and cross-functional collaboration to improve product outcomes.
Top Skills:
Node.jsTypescript
Cloud • Information Technology • Productivity • Software • Automation
As a Principal Engineer, you will develop software solutions, guide teams through the software lifecycle, resolve customer issues, mentor engineers, and own features from gathering requirements to deployment.
Top Skills:
AWSConfluenceDevops ToolsGraphQLJavaJIRAMySQLNoSQLPostgresRestRpcSoapWsdl
Artificial Intelligence • Consumer Web • Edtech • HR Tech • Information Technology • Software • Conversational AI
Negotiate and manage customer contracts, draft legal documents, ensure compliance, and collaborate with internal and external teams on contract terms.
Top Skills:
PeoplesoftSalesforceWord
What you need to know about the Kolkata Tech Scene
When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.
