Design and support batch and incremental data ingestion pipelines, ETL workflows, SQL transformations, and Airflow orchestration. Troubleshoot data quality, reconciliation, lineage, discrepancies, and production incidents. Support cloud data migrations, validate data across systems, collaborate with stakeholders, and develop reusable engineering components using BigQuery, SQL, Python, Airflow, and GCP services.
Key Responsibilities
Part of the $4.8 billion RPG Group, we’re a community of 10,000+ innovators across 30+ global locations, including Milpitas, Seattle, Princeton, Cape Town, London, Zurich, Singapore, and Mexico City. Explore Life at Zensar and join us to Grow. Own. Achieve. Learn. to be the best version of yourself.
We believe the best work happens when individuality is celebrated, growth is encouraged, and well-being is prioritized. We are an equal employment opportunity (EEO) and affirmative action employer, committed to creating an inclusive workplace. All qualified applicants will be considered without regard to race, creed, color, ancestry, religion, sex, national origin, citizenship, age, sexual orientation, gender identity, disability, marital status, family medical leave status, or protected veteran status.
- Design, develop, and support batch and incremental data ingestion pipelines into the data lake.
- Develop and optimize complex SQL queries, data transformations, and ETL workflows.
- Build, maintain, and monitor Airflow DAGs for orchestration and workflow automation.
- Analyze and troubleshoot data quality, data reconciliation, and pipeline execution issues.
- Perform end-to-end data lineage analysis and trace data from source systems to downstream consumers.
- Debug data discrepancies by investigating source systems, transformation logic, and target datasets.
- Support data migration and modernization initiatives from legacy platforms to cloud-based data platforms.
- Work closely with business stakeholders, architects, and upstream/downstream teams to understand data requirements.
- Validate data completeness, accuracy, and consistency across multiple systems.
- Participate in production support activities and resolve data-related incidents within SLA timelines.
- Develop reusable data engineering components and recommend process improvements.
- SQL / PL/SQL
- Complex joins, CTEs, analytical functions
- Query optimization and performance tuning
- Data modeling and database concepts
- BigQuery
- Query development and optimization
- Partitioning and clustering concepts
- Data loading and transformation techniques
- ETL/Data Engineering
- Data ingestion patterns (Batch and Incremental)
- Data transformations and validations
- Data quality checks and reconciliation
- Apache Airflow
- Developing and troubleshooting DAGs
- Scheduling, monitoring, and dependency management
- Python
- Basic to intermediate scripting
- Data processing and automation
- Cloud Platforms (Preferably GCP)
- Cloud Storage
- BigQuery
- Composer/Airflow
Part of the $4.8 billion RPG Group, we’re a community of 10,000+ innovators across 30+ global locations, including Milpitas, Seattle, Princeton, Cape Town, London, Zurich, Singapore, and Mexico City. Explore Life at Zensar and join us to Grow. Own. Achieve. Learn. to be the best version of yourself.
We believe the best work happens when individuality is celebrated, growth is encouraged, and well-being is prioritized. We are an equal employment opportunity (EEO) and affirmative action employer, committed to creating an inclusive workplace. All qualified applicants will be considered without regard to race, creed, color, ancestry, religion, sex, national origin, citizenship, age, sexual orientation, gender identity, disability, marital status, family medical leave status, or protected veteran status.
Zensar Technologies Kolkata, West Bengal, IND Office
12th floor, Srijan Corporate Park, Street Number 25, GP Block, Sector V, Bidhannagar, Kolkata, West Bengal, India, 700091
Similar Jobs
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead the technical evolution of Atlassian’s data engineering capabilities by architecting scalable batch and streaming data solutions. Direct complex engineering efforts, improve data quality and productivity, establish technical direction, and coordinate implementation across teams. Mentor and coach data engineers while partnering cross-functionally to support data-driven business decisions and long-term platform scalability.
Top Skills:
Apache AirflowApache FlinkApache HiveApache KafkaSparkAws AthenaAws EmrAws RedshiftDatabricksKappa ArchitectureLambda ArchitectureMaster Data ManagementMicroservicesSQL
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Develop and maintain software for Atlassian’s Trusted Data Platform. The provided description contains limited role-specific responsibilities, qualifications, technologies, travel requirements, and clearance information.
Information Technology
Designs and supports batch and incremental data ingestion pipelines, ETL workflows, SQL transformations, and Airflow orchestration. Investigates data quality issues, reconciles discrepancies, performs data lineage analysis, supports cloud migration initiatives, and validates data across systems. The role also provides production support, resolves incidents, develops reusable engineering components, and collaborates with stakeholders on data requirements.
Top Skills:
Apache AirflowBigQueryGoogle Cloud ComposerGoogle Cloud StorageKafkaPl/SqlPub/SubPythonSQL
What you need to know about the Kolkata Tech Scene
When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.
