Design, implement, and automate Snowflake data ingestion and DBT transformation pipelines (Data Vault 2.0). Troubleshoot data operations, implement data quality monitoring, optimize platform performance, and deploy code via CI/CD while collaborating with the team.
Role : Sr. Data Engineer (Snowflake + DBT + Python) Location: Chennai Primary Skills: Snowflake, DBT & Python Secondary Skill : Experience / good knowledge of data modeling, database design, data quality and governance principles. AWS skills - Glue/EMR, Lambda Responsibilities: Design and implement data pipelines using Snowpipe for data ingestion. Design and implement data pipelines using DBT for transformation and loading processes into Snowflake Data Vault 2.0. Execute ETL processes using DBT to load the data from Snowflake Business Data Vault to Snowflake Consumption Layer, ensuring the smooth implementation of data integration strategies. Demonstrate a good understanding and hands-on experience in DevOps, actively participating in troubleshooting issues within the data operations environment. Participate in data quality checks and monitoring, implementing appropriate metrics and alerts. Work with the team to automate data pipelines and deploy code using CI/CD tools. Monitor and optimize data platform performance and resource utilization. Document data pipelines and processes for maintainability and knowledge sharing. Preferred skills: Glue/EMR , Lambda and Fivetran Qualifications: Overall 10+ years of experience on data engineering Demonstrated experience of 5+ years in primary skill with similar engineering role, showcasing proficiency in Data Transformations and Integration Projects Solid understanding and hands-on experience in the Azure Cloud environment, particularly DBT, Python and Snowflake Proficient in troubleshooting data pipelines built using DBT & Snowflake. Good experience in ETL processes, and data integration. Ability to work collaboratively in a team-oriented environment Excellent problem-solving and analytical skills.
Similar Jobs
Information Technology • Consulting
Senior Big Data Engineer responsible for Azure Databricks development and end-to-end data engineering. Must be hands-on with PySpark, write advanced SQL, work with data ingestion, preparation, integration, and operationalize pipelines across Data Lakes, Warehouses and Marts. Own coding, testing, debugging, deployment; DWH experience required. Strong communication skills.
Top Skills:
AzureAzure DatabricksData LakeData MartData WarehousePysparkPythonSQL
Information Technology • Consulting
Hands-on Big Data Engineer responsible for PySpark development on Azure Databricks, advanced SQL, and data warehouse/DWH work. Own data ingestion, preparation, integration, operationalization, and end-to-end development (coding, testing, debugging, deployment). Understand data lakes, data warehouses, and data marts. Strong communication required.
Top Skills:
AzureAzure DatabricksData LakeData MartData WarehousePysparkPythonSQL
Information Technology • Consulting
The Big Data Engineer requires 3-6 years of hands-on experience with PySpark, ADF, ADB, and SQL, focusing on big data technologies.
Top Skills:
AdbAdfPysparkSQL
What you need to know about the Kolkata Tech Scene
When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.
