Designation Azure Data Engineer
Location Bengaluru, India
Top Skills
Cloud & Azure Technologies: Azure Data Factory, Azure Data Lake Storage, Azure Synapse Analytics, and Azure Databricks/Synapse for complex stored procedures
Programming & Scripting: Proficiency in Python, SQL (compulsory), and Scala; hands-on experience with PLSQL
Data Expertise: Data modelling, data warehousing, and data integration concepts
Big Data & Infrastructure: Familiarity with Apache Spark, Hadoop, and cloud infrastructure management
DevOps & Automation: Experience with Azure DevOps, PowerShell, and automation tools for deployment and monitoring
Data Governance & Security: Robust understanding of data governance practices, data quality management, and security principles
Soft Skills: Strategic planning, strong communication, collaboration, and problem-solving skills
Roles and Responsibilities
Design & Implementation: Architect, implement, and optimize end-to-end data solutions on the Azure ecosystem.
ETL Pipeline Development: Build and maintain efficient ETL pipelines using Azure Data Factory while ensuring data quality and integration with Azure Data Lake.
Stored Procedures & Analytics: Develop and fine-tune complex stored procedures within Azure Databricks or Synapse to enable advanced analytics on large-scale data (exceeding 50TB).
Data Management: Apply your expertise in SQL, PLSQL, and data modelling to manipulate, transform, and analyze data effectively.
Collaboration: Work cross-functionally to support data-driven initiatives; utilize Azure Synapse Analytics to convert raw data into actionable insights.
Optimization & Troubleshooting: Monitor and enhance data storage, processing, and retrieval mechanisms while addressing performance issues.
Security & Governance: Enforce and maintain strong data governance, adherence to data security standards, and compliance with privacy regulations.
Process Automation: Collaborate with DevOps teams to automate deployments, configurations, and monitoring using tools such as Azure DevOps and PowerShell.
Qualification
Education: Bachelor’s degree in Computer Science, Engineering, or a related field (advanced degree preferred).
Experience: 6–8 years of hands-on experience designing and implementing data engineering solutions in the Azure ecosystem.
Technical Expertise:
Proficiency in developing solutions with Azure Data Factory, Azure Data Lake Storage, Azure Databricks, and Azure Synapse Analytics.
Extensive experience in SQL (compulsory) and PLSQL.
Strong background in data modelling, data warehousing, and data integration concepts.
Familiarity with big data frameworks such as Apache Spark or Hadoop is required.
Certifications: Relevant Azure certifications (e.g., Azure Data Engineer Associate or Azure Solutions Architect Expert) are preferred.
Industry Experience: Experience in a retail setup is a plus.
Employee Value Proposition Join the dynamic team at Landmark Digital and play a pivotal role in driving innovation through state-of-the-art data engineering practices. You’ll work with the latest Azure technologies to design, deploy, and optimize robust data pipelines that directly influence strategic, data-driven decision-making. This role offers a collaborative environment that fosters continuous learning, career growth, and the opportunity to impact retail transformation on a global scale.
