Senior Datalake Engineer
We are seeking an experienced Senior Data Engineer with strong expertise in Azure cloud technologies, Databricks, and modern data architecture practices. The ideal candidate will have hands-on experience in migrating enterprise data platforms from on-premises environments to cloud-based architectures, implementing scalable data pipelines, and designing robust analytical data models using Medallion Architecture and Star/Snowflake schemas.
Key Responsibilities
Design, develop, and maintain scalable and reliable data pipelines using Azure data services and Databricks.
Lead and support migration initiatives from on-premises data platforms to Azure cloud environments.
Implement modern data Lakehouse architectures using Medallion Architecture principles (Bronze, Silver, Gold layers).
Build and optimize ETL/ELT workflows for structured and semi-structured data processing.
Design dimensional data models using Star and Snowflake schemas to support reporting, analytics, and business intelligence solutions.
Collaborate with architects, analysts, business stakeholders, and cross-functional teams to understand data requirements and deliver scalable solutions.
Ensure data quality, governance, security, and performance optimization across the data platform.
Develop reusable frameworks, coding standards, and best practices for data engineering processes.
Monitor and troubleshoot production data pipelines and workflows.
Mentor junior engineers and contribute to technical leadership within the team.
Required Skills & Experience
6+ years of experience in Data Engineering and Databricks.
Strong hands-on experience with Azure cloud services, including:
Microsoft Azure Data Factory (ADF)
Azure Databricks
Azure Data Lake Storage (ADLS)
Azure Synapse Analytics
Azure SQL Database
Azure DevOps
Extensive experience with Databricks, Py Spark, Spark SQL, and Delta Lake.
Proven experience in cloud migration projects from on-premises platforms to Azure.
Strong understanding and implementation experience with Medallion Architecture.
Expertise in dimensional modelling concepts including Star Schema and/or Snowflake Schema.
Strong SQL and Python programming skills.
Experience working with large-scale datasets and distributed data processing frameworks.
Knowledge of CI/CD processes and DevOps practices for data platforms.
Familiarity with data governance, security, and performance tuning best practices.
Desired Competencies
Strong analytical and problem-solving skills.
Excellent communication and stakeholder management abilities.
Ability to work independently and lead technical initiatives.
Strong documentation and technical design skills.
Continuous learning mindset with adaptability to evolving technologies.
