Design, develop, and maintain scalable ETL/ELT pipelines and data models using Azure Databricks and SQL. Optimize data processing workflows, ensure data quality, support cloud data warehouse initiatives, troubleshoot pipeline performance, and collaborate with stakeholders to deliver analytics-ready data for BI and reporting.
This role is for one of the Weekday's clients
Salary range: Rs 1500000 - Rs 2700000 (ie INR 15-27 LPA)
Experience: 5+ yrs
Location: Pune, Maharashtra, India
Job Type: Full-Time
We are looking for a skilled Data Engineer with expertise in Azure Databricks, ETL, and SQL to design, develop, and optimize scalable data solutions that support enterprise analytics and business intelligence initiatives. The ideal candidate will have experience building robust data pipelines, transforming large datasets, and enabling reliable, high-performance data platforms within modern cloud environments.
In this role, you will collaborate with cross-functional teams including data architects, analysts, business stakeholders, and engineering teams to deliver efficient data integration solutions, ensure data quality, and support data-driven decision-making across the organization.
RequirementsKey Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines for ingesting, transforming, and loading data from multiple sources.
- Build and optimize data processing workflows using Azure Databricks, SQL, and cloud-native technologies.
- Develop reliable data models and transformation logic to support reporting, analytics, and business intelligence requirements.
- Write, optimize, and maintain complex SQL queries, stored procedures, and data transformation scripts.
- Monitor, troubleshoot, and optimize data pipelines for performance, scalability, and reliability.
- Ensure data quality through validation, reconciliation, and automated quality checks.
- Collaborate with business users, analysts, and technical teams to translate data requirements into scalable technical solutions.
- Support cloud-based data warehouse initiatives and data integration projects.
- Implement best practices for data governance, security, documentation, and compliance.
- Participate in performance tuning, process automation, and continuous improvement initiatives across the data platform.
- Strong hands-on experience with Azure Databricks, ETL development, and SQL.
- Proven experience building and supporting enterprise-scale data engineering solutions.
- Excellent SQL skills with expertise in query optimization and data transformation.
- Solid understanding of cloud-based data platforms, data warehousing concepts, and modern data architectures.
- Experience designing scalable and efficient data pipelines for structured and semi-structured data.
- Knowledge of data modeling, performance optimization, and data quality management practices.
- Strong analytical and problem-solving skills with attention to detail.
- Experience working in collaborative Agile development environments.
- Excellent communication and stakeholder management skills with the ability to work across technical and business teams.
- A proactive mindset with a passion for building reliable, scalable, and high-performing data platforms that drive business insights.
Similar Jobs
Artificial Intelligence • HR Tech • Professional Services • Software
Design and implement modern data warehouse solutions using Databricks and cloud (Azure/AWS). Develop, orchestrate (Airflow) and troubleshoot ETL pipelines (batch and streaming), build dimensional data models for reporting, collaborate with architects and business stakeholders, mentor team members, and drive technical discussions.
Top Skills:
AirflowApache KafkaAWSAzure Data FactoryAzure DatabricksCassandraCircleCIDatabricks Delta LakeGitHadoop (HiveImpala)KinesisMongoDBNeo4JPigPl/SqlPysparkPythonRdbmsSQLTerraformUnix Shell Scripting
Artificial Intelligence • Consulting
Design, build, and maintain Azure-based data infrastructure and pipelines. Implement data models and schemas, ensure data quality, optimize distributed storage and processing (Databricks/PySpark), and establish engineering best practices while partnering with cross-functional teams.
Top Skills:
AdfAdls2Ai FactoryAzureDatabricksDevOpsPygenticPysparkPythonUltimate
.png)
Other
Design, build, and maintain scalable people-data pipelines, warehouses, and datasets using structured and unstructured sources. Improve pipeline efficiency and data quality, ensure regulatory compliance, research data warehouse tools, create dashboards for leadership, and collaborate cross-functionally to enable data-driven people analytics.
Top Skills:
AIAzure Data FactoryAzure Sql Data WarehouseBig-DataEtl ToolsGitMachine LearningPythonSQL
What you need to know about the Kolkata Tech Scene
When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.
