Lead Data Engineer
Important Information
Location: India
Experience: 8 years
Job Mode: Full-time
Work Mode: Work from home/On-site/Hybrid
Job Summary
As a Lead Data Engineer, you will provide technical guidance and supervision to data teams and help develop advanced analytics solutions to optimize data value for partnered organizations. You will ensure company and industry standards are met and tackle unique challenges using your skills in programming, statistics, and data analysis, along with your business knowledge and leadership.
Responsibilities and Duties
• Collaborate and partner with Business Analyst teams located in US and EMEA regions.
• Interface across our Business Analyst and Data Science teams
• Play a key role in integrating new data sources into our data & analytical ecosystem over AWS cloud
• Implement data lake solutions while addressing common data concerns, such as data quality, data governance
• Set the standard for technical excellence as we move / build our data ecosystem into the cloud
• understanding their common data problems and deliver scalable solutions
Qualifications and Skills
• 7-10 years of strong development experience performing ETL and/or data pipeline implementations.
• Expert in programming languages, preferably Python.
• Expert in delivering end-to-end analytic solutions using AWS services (EMR, Airflow, S3, Athena, Kinesis, Redshift).
• Experience in batch technologies like Hadoop, Hive, Athena, Presto.
• Strong SQL skills, including query optimization, schema design, complex analytics.
• Expert in data modeling and metadata management like Glue Catalog etc.
• Experience in deployment tools like GitHub actions, Jenkins, AWS Code Pipeline etc.
• Experience in data quality tools like Deque or Great Expectations is Nice To Have
Role Specific requirement:
• Strong Experience in SQL, EMR, AWS, Pyspark, Python, EMR, Airflow
About Encora
Encora is the preferred digital engineering and modernization partner of some of the world’s leading enterprises and digital native companies. With over 9,000 experts in 47+ offices and innovation labs worldwide, Encora’s technology practices include Product Engineering & Development, Cloud Services, Quality Engineering, DevSecOps, Data & Analytics, Digital Experience, Cybersecurity, and AI & LLM Engineering.
At Encora, we hire professionals based solely on their skills and qualifications, and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.
Top Skills
What We Do
Headquartered in Santa Clara, California, and backed by renowned private equity firms Advent International and Warburg Pincus, Encora is the preferred technology modernization and innovation partner to some of the world’s leading enterprise companies. It provides award-winning digital engineering services including Product Engineering & Development, Cloud Services, Quality Engineering, DevSecOps, Data & Analytics, Digital Experience, Cybersecurity, and AI & LLM Engineering. Encora's deep cluster vertical capabilities extend across diverse industries, including HiTech, Healthcare & Life Sciences, Retail & CPG, Energy & Utilities, Banking Financial Services & Insurance, Travel, Hospitality & Logistics, Telecom & Media, Automotive, and other specialized industries.
With over 9,000 associates in 47+ offices and delivery centers across the U.S., Canada, Latin America, Europe, India, and Southeast Asia, Encora delivers nearshore agility to clients anywhere in the world, coupled with expertise at scale in India. Encora’s Cloud-first, Data-first, AI-first approach enables clients to create differentiated enterprise value through technology
