Top Data Engineer Jobs in Kolkata

Principal Data Engineer responsible for developing and supporting Databricks pipelines, integrating heterogeneous healthcare data sources, modeling unified data products, and ensuring data quality and availability. The role partners with business stakeholders, product teams, data engineers, and clinical leaders to gather requirements, create datasets, support ad hoc analytics, enable machine learning and AI use cases, and assist with acquisition integrations. Extensive healthcare data, cloud, SQL, PySpark, and Python experience is required.

Design, build, and maintain scalable Azure-based data pipelines and systems (Databricks, Data Lake, Synapse, ADF). Collaborate with cross-functional teams, ensure data quality and integrity, optimize performance, monitor and troubleshoot systems, and stay current with industry trends to improve solutions.

Build and maintain scalable data products using Snowflake, dbt, and Airflow. Responsibilities include dimensional data modeling, SQL transformations, pipeline orchestration, data quality testing, exploratory analysis, SLA monitoring, documentation, and stakeholder requirement gathering. Partner with analytics, product, engineering, and business teams to deliver reliable, production-ready datasets while following software engineering, CI/CD, testing, and deployment practices.

Design, build, and optimize end-to-end data solutions using Microsoft Fabric, Azure Synapse, Databricks, Azure Data Factory, and Power BI. Develop scalable real-time and batch pipelines, data models, semantic and dimensional models, dashboards, reports, and self-service analytics. Apply medallion architecture, DataOps, monitoring, security, governance, quality controls, and performance tuning. Integrate Azure Machine Learning and streaming technologies when needed while delivering enterprise data and BI solutions for clients.

Designs and maintains SAP-integrated ETL/ELT pipelines connecting ECC, S/4HANA, BW/4HANA, and cloud data platforms. Responsibilities include SAP data extraction, transformation, real-time integrations, dimensional modeling, database optimization, data quality monitoring, alerting, cost optimization, and documentation. The role partners with functional consultants, BI teams, FP&A stakeholders, and business leaders while developing cloud skills across AWS services such as Glue, Lambda, Airflow, and Redshift.

Design, build, and maintain enterprise ETL/ELT pipelines in Microsoft Fabric; ingest and transform data from diverse sources into dimensional star schemas; optimize performance and cost; implement data quality checks and monitoring; document architecture and pipelines; collaborate with analysts, stakeholders, and global engineering teams to deliver Power BI-ready analytics datasets.

As a Senior Data Engineer, you will develop and maintain data pipelines for healthcare data, ensuring data quality, reliability, and adherence to enterprise standards while collaborating with architects and stakeholders.

The Senior Data Engineer will develop data ingestion, transformation, and enrichment pipelines, ensuring data quality and reliability. Responsibilities include creating Bronze and Silver data layers, using SQL and dbt for implementation, and collaborating with architects and stakeholders to align data solutions with enterprise standards.

Build, optimize, and maintain scalable AWS-based data pipelines and data lakes (Snowflake/Databricks). Implement streaming ingestion (Kinesis/Kafka), CDC, automated data quality checks, and ML-ready feature stores. Collaborate with Product, ML, and Analytics teams, own pipeline QA, observability, and participate in on-call rotations to resolve production data issues.

Design, build, and optimize scalable GCP data pipelines and BigQuery data warehouses. Develop ETL/ELT workflows, implement data modeling, ensure data quality, optimize query performance and costs, maintain orchestration with Cloud Composer/Dataflow/Pub‑Sub, and automate deployments with CI/CD while enforcing security and governance.

As a Data Engineer, you will design, develop, and maintain data integration solutions, optimize ETL/ELT pipelines, and support data workflows for analytics and reporting.

Develop and maintain reliable data pipelines, ELT processes, workflow orchestration, custom data connectors, and CI/CD pipelines using Airflow, Python, PySpark, Hive/Trino, SQL, and Snowflake. Collaborate with cross-functional teams, monitor and troubleshoot data workflows, validate and test data, document technical processes, and support data governance.

Leads end-to-end data products from ingestion and transformation through semantic modeling, Power BI reporting, documentation, governance, and user adoption. Builds Microsoft Fabric pipelines, Lakehouse or Warehouse architectures, dimensional models, and secure, optimized Power BI solutions. Analyzes data, supports advanced analytics and AI-assisted reporting, establishes quality and CI/CD practices, collaborates with cross-functional stakeholders, and manages data engineers through objectives, reviews, and development.

Design, build, and maintain scalable ETL/ELT and real-time data pipelines on AWS. Manage Airflow DAGs, Kafka ingestion, Redshift optimization, data quality checks, API integrations, and cost optimization while collaborating with BI for reporting needs.

Design, build, and maintain production data pipelines and integrations across applications, databases, and cloud services. Support data architecture, ingestion, embedding workflows for AI, data quality, monitoring, and platform reliability. Collaborate with Full Stack and AI teams to deploy scalable cloud-based data infrastructure and establish data engineering standards and best practices.

Design, build, and maintain scalable ETL/data pipelines and data management blueprints. Ingest, transform, and curate large complex datasets for analytics, support cloud (AWS) implementations, enable downstream consumers, and provide technical leadership and operational support to ensure data governance, quality, and automation.

Design and develop scalable data-driven solutions and pipelines using Python and SQL. Leverage Azure data services to build secure, high-performance architectures, ensuring data integrity, governance, and overall success of data projects.

Design and build scalable data pipelines and architectures on Azure using ADF, Databricks, and Synapse. Implement Kimball/Data Vault modeling, write ETL in Python and T-SQL, ensure data governance (Azure Purview), automate tests, troubleshoot issues, document processes, and collaborate across teams.

Design and develop data-driven solutions and scalable data pipelines using Python and SQL. Leverage Azure data products to build robust, secure architectures, ensuring data integrity, performance, and governance while supporting data-centric client projects.

As a hands-on data engineer, you'll build and enhance scalable data platforms, develop data pipelines, and collaborate with various teams to improve data solutions and system performance.

Lead technical direction for data platform capabilities: design and maintain data pipelines, reporting models, and data governance to support trusted metrics and AI/LLM agentic workflows. Drive architectural improvements, mentor engineers, collaborate on roadmaps, and represent technical capabilities externally.

Design, develop, and coordinate cloud data solutions using Snowflake, Python, and AWS. Support product releases, deployments, testing, and post-install support. Collaborate with architects and tech leads, troubleshoot issues, and maintain documentation. Contribute to agile squads, adopt new technologies, and enable Fidelity Wealth business data needs.

Design, build, and maintain cloud data pipelines and architectures using SQL, Python, Snowflake, and AWS. Implement CI/CD for data workflows, use developer assistance tools, and collaborate across teams to deliver reliable data solutions.

Lead database design, data modeling, migrations, and schema evolution across MySQL/Postgres and GCP databases. Design and operate config-driven ETL/ELT pipelines and streaming ingestion, enable CI/CD, troubleshoot data flows, and mentor offshore DB/ETL engineers.

Perform data migration/refresh from production, support Python-based data refresh framework, run post-migration fixes, validate and reconcile data, monitor and resolve batch jobs and pipeline issues, perform performance checks, and coordinate with dependent teams.