Leads enterprise data engineering strategy and designs scalable cloud and hybrid data architectures. Responsibilities include building high-volume ETL/ELT pipelines, modernizing data platforms, implementing governance and security, supporting streaming analytics and machine learning workloads, and establishing DataOps practices. The role provides technical leadership and mentorship, partners with data science and product teams, translates business requirements into technical solutions, and develops REST APIs and Azure PaaS solutions.
Job Title: Data Engineer - Lead
Experience Required: 8+ Years
Location: Hyderabad/Ahmedabad
Employment Type: Full-time
Position Overview
We are seeking an experienced Data Engineer with over 8 years of experience in designing, developing, and optimizing enterprise-scale data solutions. The ideal candidate will lead our data engineering strategy, architect cloud-based data platforms, and mentor engineering teams to deliver scalable and reliable data systems that power business intelligence, AI, and analytics.
Roles & Responsibilities
· Design and implement modern data architectures across cloud and hybrid environments.
- Develop and optimize data pipelines and ETL/ELT processes for high-volume, high-velocity data.
- Lead data platform modernization initiatives using cutting-edge tools and frameworks.
- Define and enforce data governance, security, and compliance standards.
- Partner with Data Science, BI, and Product teams to ensure data availability, accuracy, and performance.
- Provide technical leadership and mentorship to data engineers and developers.
- Implement DevOps/Data Ops practices for automated testing, deployment, and monitoring.
- Continuously evaluate and introduce innovative data technologies that enhance efficiency and scalability.
- Translate business requirements into robust and scalable technical data solutions.
- Support real-time and streaming data architectures for analytics and ML workloads.
- Designing and developing REST APIs / Azure App Services and implementing Azure PaaS solutions.
Required Skills & Qualifications
- Bachelor’s or master’s in computer science, Engineering, or related field.
- 8+ years in Data Engineering or Data Architecture roles.
- Expertise in Python, SQL, Spark, Kafka, and Airflow.
- Proven experience with cloud platforms (AWS, Azure, or GCP).
- Hands-on experience with Snowflake, Databricks, or Delta Lake.
- Strong understanding of data modelling, governance, and lineage tools.
- Excellent problem-solving, leadership, and communication skills.
Good to Have Skills:
· C#, .NET Core, Azure PaaS, Problem-Solving, REST API Development, EF Core, Leadership, Agile Practices.
· Blazor UI, Azure IPaaS (Azure Integration Services), Design Patterns, and Cloud Security best practices.
Similar Jobs
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
The Account Executive will prospect, build pipeline, and close mid-market sales of Samsara’s IoT solutions. Responsibilities include researching prospects, conducting high-volume cold outreach, managing proofs of concept and trials, coordinating multiple stakeholders, negotiating complex pricing, selling to executives, and consistently achieving quota. Typical deals range from $20,000 to $100,000, with approximately 25% travel required across the Midwest territory.
Top Skills:
Internet Of Things (Iot)Salesforce (Sfdc)
Events • Food • Travel • Hospitality • Hotels & Resorts
Manage hotel HR operations across recruitment, training, compensation, benefits, employee and labor relations, compliance, safety, and performance management. Coordinate engagement and recognition initiatives, maintain employee records and HR systems, track employment changes, document training and corrective actions, produce HR metrics reports, and supervise, coach, and develop HR team members while ensuring policy and regulatory compliance.
Top Skills:
Microsoft Office Suite
Events • Food • Travel • Hospitality • Hotels & Resorts
Assists with hotel reservations operations, room inventory, group bookings, rooming lists, rate strategies, revenue optimization, reporting, and administrative support. Provides reservation assistance to customers and team members while supervising, coaching, and developing reservations staff. Coordinates with meeting planners, housing bureaus, and internal departments to ensure accurate billing, special requests, and guest service.
Top Skills:
DelphiIdeas Gro V3MS OfficeOnq PmR&I
What you need to know about the Kolkata Tech Scene
When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.
