Design, build, and maintain scalable Azure-based data pipelines and systems (Databricks, Data Lake, Synapse, ADF). Collaborate with cross-functional teams, ensure data quality and integrity, optimize performance, monitor and troubleshoot systems, and stay current with industry trends to improve solutions.
## Company Overview
Delphic Global is a forward-thinking company dedicated to innovation and excellence in the global market. We pride ourselves on our dynamic work environment and our commitment to fostering talent and growth.
## Job Title
Data Engineer
## Location
India
## Experience Required
6-8 years
## Key Responsibilities
* Design, develop, and maintain scalable data pipelines and systems.
* Collaborate with cross-functional teams to understand data requirements and deliver solutions.
* Implement data solutions using Azure technologies such as Azure Databricks, Data Lake, Synapse, and Azure Data Factory (ADF).
* Optimize and improve existing data systems for better performance and scalability.
* Ensure data quality and integrity through rigorous testing and validation.
* Monitor and troubleshoot data systems to ensure reliability and performance.
* Stay updated with the latest industry trends and technologies to drive continuous improvement.
## Required Skills
* Proven experience in data engineering with a focus on Azure technologies.
* Strong expertise in Azure Databricks, Data Lake, Synapse, and Azure Data Factory (ADF).
* Proficiency in Python and Apache Spark for data processing and analysis.
* Solid understanding of SQL for data manipulation and querying.
* Experience in building and optimizing data pipelines and architectures.
* Ability to work collaboratively in a team environment and communicate effectively.
## Why Join Us?
At Delphic Global, we offer a vibrant work culture that encourages innovation and personal growth. Join us to be part of a team that values diversity, creativity, and collaboration.
Delphic Global Pvt Ltd Kolkata, West Bengal, IND Office
Kolkata, India
Similar Jobs
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead the technical evolution of Atlassian’s data engineering capabilities by architecting scalable batch and streaming data solutions. Direct complex engineering efforts, improve data quality and productivity, establish technical direction, and coordinate implementation across teams. Mentor and coach data engineers while partnering cross-functionally to support data-driven business decisions and long-term platform scalability.
Top Skills:
Apache AirflowApache FlinkApache HiveApache KafkaSparkAws AthenaAws EmrAws RedshiftDatabricksKappa ArchitectureLambda ArchitectureMaster Data ManagementMicroservicesSQL
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Senior Software Engineer role focused on Atlassian’s Trusted Data Platform. The available description emphasizes a distributed-first, remote-friendly work environment with virtual interviews and onboarding. Specific technical responsibilities, required qualifications, compensation, travel, and clearance details are not provided.
Other
Maintain Python-based web scraping configurations, monitor errors and data blockages, coordinate scraping requirements with stakeholders, and report on scraping activities. Build and optimize pipelines for data lake ingestion and transformation using ETL, data modeling, cloud, database, and infrastructure tools. Collaborate with data scientists and analysts while ensuring data security, compliance, testing, and maintainability.
Top Skills:
AirflowAzureData LakesData WarehousingDbtETLGitNoSQLPythonSQLTerraform
What you need to know about the Kolkata Tech Scene
When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.
