emids Logo

emids

Azure Data Engineer (Databricks) || 4+ yrs || RR/1294/2024

Sorry, this job was removed at 09:41 a.m. (IST) on Thursday, Nov 21, 2024
Be an Early Applicant
Bangalore, Bengaluru, Karnataka
Bangalore, Bengaluru, Karnataka

Role : Azure Data Engineer 

Exp : 4-7 yrs

Loc : Bangalore / Noida

Job Description :

Data Engineering with Databricks:

  • Design, implement, and optimize data pipelines in Databricks to process large-scale structured and unstructured data.
  • Develop ETL workflows for data ingestion, transformation, and integration using Databricks and other cloud-based tools.
  • Implement Delta Lake for efficient data management and real-time data processing.
  • Collaborate with data architects and stakeholders to build scalable and reusable data solutions.
  • Leverage Databricks' MLflow for managing and deploying machine learning workflows, if required.
  • Ensure data quality, integrity, and compliance with organizational standards and governance policies.

Required Skills & Qualifications:

  • Education: Bachelor’s or master’s degree in computer science, Data Analytics, Information Technology, or a related field.
  • Technical Proficiency:
    • Hands-on experience with Databricks: Spark, Pyspark, Scala, or SQL.
    • Strong understanding of database concepts and working experience with SQL/NoSQL databases.
    • Experience integrating Databricks and Power BI with cloud platforms like Azure or AWS.
  • Analytical Skills: Strong ability to analyse, interpret, and visualize large datasets.
  • Problem Solving: Demonstrated ability to troubleshoot complex data workflows and reporting challenges.

Soft Skills: Strong written and verbal communication, collaboration, and stakeholder management


Similar Jobs

4 Hours Ago
Hybrid
Bengaluru, Karnataka, IND
Senior level
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
As a Senior Lead Software Engineer, you will develop innovative data management solutions, improve engineering culture, guide stakeholders, and influence design decisions.
Top Skills: SparkAWSC++DatabricksGoGCPJavaAzurePythonRustSnowflakeSpark Sql
4 Hours Ago
Bangalore, Bengaluru, Karnataka, IND
Senior level
Senior level
Fintech • Legal Tech • Software • Financial Services • Cybersecurity • Data Privacy
The Senior Manager will lead the Testing Center of Excellence, overseeing testing strategies, managing a small team, and executing hands-on testing, including automation and performance testing, in the financial services sector.
Top Skills: Ai-Driven Testing ToolsCi/CdCypressJmeterK6LoadrunnerPlaywrightSelenium
6 Hours Ago
Hybrid
Bengaluru, Karnataka, IND
Junior
Junior
Cloud • eCommerce • Information Technology • Professional Services • Software
The EDI Support Engineer manages Cleo B2B Cloud systems, responds to incidents, troubleshoots EDI issues, and collaborates with teams to resolve customer problems.
Top Skills: APIsAs2EdiFlat FilesFtp/SHttp/SSftpSpreadsheetsSQLXML

What you need to know about the Kolkata Tech Scene

When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account