Role : Azure Data Engineer
Exp : 4-7 yrs
Loc : Bangalore / Noida
Job Description :
Data Engineering with Databricks:
- Design, implement, and optimize data pipelines in Databricks to process large-scale structured and unstructured data.
- Develop ETL workflows for data ingestion, transformation, and integration using Databricks and other cloud-based tools.
- Implement Delta Lake for efficient data management and real-time data processing.
- Collaborate with data architects and stakeholders to build scalable and reusable data solutions.
- Leverage Databricks' MLflow for managing and deploying machine learning workflows, if required.
- Ensure data quality, integrity, and compliance with organizational standards and governance policies.
Required Skills & Qualifications:
- Education: Bachelor’s or master’s degree in computer science, Data Analytics, Information Technology, or a related field.
- Technical Proficiency:
- Hands-on experience with Databricks: Spark, Pyspark, Scala, or SQL.
- Strong understanding of database concepts and working experience with SQL/NoSQL databases.
- Experience integrating Databricks and Power BI with cloud platforms like Azure or AWS.
- Analytical Skills: Strong ability to analyse, interpret, and visualize large datasets.
- Problem Solving: Demonstrated ability to troubleshoot complex data workflows and reporting challenges.
Soft Skills: Strong written and verbal communication, collaboration, and stakeholder management
Similar Jobs
Information Technology
The Azure Data Engineer will develop and manage data solutions using Azure technologies, conduct data profiling, and participate in POCs, requiring strong expertise in SQL, Python, and Azure services.
Top Skills:
Azure AnalyticsAzure Data Bricks (Adb)Azure Data EngineeringAzure Data Factory (Adf)Azure DevopsAzure SynapseDelta TablesPysparkPythonSQLUnity Catalog
Financial Services
Develop regulatory models for portfolio risk, execute model surveillance, perform statistical analyses, and streamline model development processes.
Top Skills:
Db2OraclePysparkPythonRSASSQLTeradata
Financial Services
The Senior Lead Security Engineer develops secure software, guides tech teams, influences product design, and tackles cybersecurity challenges.
Top Skills:
AWSCSSDockerDot NetDynamoDBHTMLJavaKubernetesOracleReactReduxSpring Boot
What you need to know about the Kolkata Tech Scene
When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.
