Top Data Engineer Jobs in Kolkata

Analyze business and user requirements across financial services value streams, define technical requirements, develop cloud solution options, and manage business and IT stakeholders. The role requires understanding existing framework capabilities, complex data models, cross-functional solution design, clear documentation, team coordination across regions, and familiarity with the SDLC from design through testing and implementation.

Designs, develops, and maintains scalable data solutions, pipelines, and ETL processes using Databricks and PySpark. Ensures data quality, reliability, and performance across systems; supports data migration and deployment; documents workflows; collaborates with cross-functional teams; troubleshoots data issues; and guides junior team members.

Design, develop, and maintain scalable data solutions, pipelines, and ETL processes. Ensure data quality, optimize data processing performance, troubleshoot data issues, document workflows, and collaborate with cross-functional teams. The role also involves independently contributing as a subject matter expert and supporting junior team members.

Designs, develops, and maintains scalable data solutions, pipelines, and ETL processes. Ensures data quality, reliability, and performance across systems while supporting data migration and deployment. Collaborates with cross-functional teams, documents workflows, troubleshoots data issues, and optimizes distributed data-processing jobs. The role also provides technical guidance to junior team members and contributes as a subject matter expert.

Build, monitor, optimize, and maintain cloud-based ETL/ELT pipelines supporting business intelligence and reporting. Develop high-performance SQL transformations, manage data warehouse schemas, tune query and pipeline performance, and optimize cloud costs. Collaborate with analysts, data scientists, actuaries, and architects to translate insurance and SaaS requirements into scalable technical solutions. Participate in code reviews, documentation, troubleshooting, and data integrity initiatives.

Design, build, and support production-grade AWS data pipelines that transform operational data into secure, high-quality, AI-ready datasets. Responsibilities include distributed data processing, Parquet curation, privacy-preserving transformations, orchestration, data quality monitoring, schema management, CI/CD, infrastructure as code, metadata and lineage management, troubleshooting, and reliable backfills.

Design, develop, and maintain scalable Microsoft Fabric and Azure data solutions. Build Lakehouse, Data Warehouse, OneLake, ETL/ELT pipelines, data transformations, and integrations using Python, PySpark, SQL, and Fabric tools. Implement medallion architecture, optimize data models and workloads, establish data quality monitoring, and support CI/CD deployments. Collaborate with analytics and business teams to deliver enterprise-scale data platforms.

Build and maintain batch and streaming data pipelines across AWS, Azure, and GCP using Databricks, Spark, PySpark, SQL, and Delta Lake. Implement medallion architecture, CDC, SCD, data quality, governance, security, metadata, and lineage controls. Configure storage, orchestration, CI/CD, monitoring, troubleshooting, and performance optimization. Collaborate with architects, data scientists, engineers, analysts, and product teams while documenting pipelines, transformations, testing, and operational procedures.

Design, build, and maintain scalable data pipelines and ETL/ELT workflows using Azure Data Factory, Databricks, PySpark, Python, and SQL. Transform large datasets, optimize data ingestion and queries, monitor pipeline performance, resolve data quality issues, support data modeling, document engineering standards, and contribute to cloud data infrastructure improvements. The role also involves collaboration with architects and senior engineers and requires familiarity with Azure Synapse, Delta Lake, governance, and security.

Design, build, and maintain scalable Azure-based data pipelines and systems (Databricks, Data Lake, Synapse, ADF). Collaborate with cross-functional teams, ensure data quality and integrity, optimize performance, monitor and troubleshoot systems, and stay current with industry trends to improve solutions.

Principal Data Engineer responsible for developing and supporting Databricks pipelines, integrating heterogeneous healthcare data sources, modeling unified data products, and ensuring data quality and availability. The role partners with business stakeholders, product teams, data engineers, and clinical leaders to gather requirements, create datasets, support ad hoc analytics, enable machine learning and AI use cases, and assist with acquisition integrations. Extensive healthcare data, cloud, SQL, PySpark, and Python experience is required.

Build and maintain scalable data products using Snowflake, dbt, and Airflow. Responsibilities include dimensional data modeling, SQL transformations, pipeline orchestration, data quality testing, exploratory analysis, SLA monitoring, documentation, and stakeholder requirement gathering. Partner with analytics, product, engineering, and business teams to deliver reliable, production-ready datasets while following software engineering, CI/CD, testing, and deployment practices.

Design, build, and optimize end-to-end data solutions using Microsoft Fabric, Azure Synapse, Databricks, Azure Data Factory, and Power BI. Develop scalable real-time and batch pipelines, data models, semantic and dimensional models, dashboards, reports, and self-service analytics. Apply medallion architecture, DataOps, monitoring, security, governance, quality controls, and performance tuning. Integrate Azure Machine Learning and streaming technologies when needed while delivering enterprise data and BI solutions for clients.

Designs and maintains SAP-integrated ETL/ELT pipelines connecting ECC, S/4HANA, BW/4HANA, and cloud data platforms. Responsibilities include SAP data extraction, transformation, real-time integrations, dimensional modeling, database optimization, data quality monitoring, alerting, cost optimization, and documentation. The role partners with functional consultants, BI teams, FP&A stakeholders, and business leaders while developing cloud skills across AWS services such as Glue, Lambda, Airflow, and Redshift.

Design, build, and maintain enterprise ETL/ELT pipelines in Microsoft Fabric; ingest and transform data from diverse sources into dimensional star schemas; optimize performance and cost; implement data quality checks and monitoring; document architecture and pipelines; collaborate with analysts, stakeholders, and global engineering teams to deliver Power BI-ready analytics datasets.

As a Senior Data Engineer, you will develop and maintain data pipelines for healthcare data, ensuring data quality, reliability, and adherence to enterprise standards while collaborating with architects and stakeholders.

The Senior Data Engineer will develop data ingestion, transformation, and enrichment pipelines, ensuring data quality and reliability. Responsibilities include creating Bronze and Silver data layers, using SQL and dbt for implementation, and collaborating with architects and stakeholders to align data solutions with enterprise standards.

Designs and leads enterprise business intelligence and analytics solutions using Power BI, Microsoft Fabric, Snowflake, Azure Data Factory, and modern data architectures. Responsibilities include developing semantic models, datasets, dashboards, data pipelines, data products, and scalable data platforms; implementing governance, quality, lineage, and metadata practices; enabling self-service analytics; optimizing performance; evaluating emerging tools such as Promethium; and advising stakeholders while mentoring data teams.

Designs and maintains enterprise data architecture, including conceptual, logical, and physical data models. Establishes data standards, metadata conventions, governance policies, security frameworks, and data dictionaries. Leads Master Data Management initiatives to improve consistency and integrity across platforms. Collaborates with business, analytics, application, and engineering teams, while supporting database, data warehouse, integration, and ETL pipeline efforts aligned with business, regulatory, security, and performance requirements.

Build, optimize, and maintain scalable AWS-based data pipelines and data lakes (Snowflake/Databricks). Implement streaming ingestion (Kinesis/Kafka), CDC, automated data quality checks, and ML-ready feature stores. Collaborate with Product, ML, and Analytics teams, own pipeline QA, observability, and participate in on-call rotations to resolve production data issues.

Build, monitor, optimize, and maintain ETL/ELT pipelines using Google Cloud technologies. Develop complex SQL transformations, design dimensional data models, improve query performance and cloud cost efficiency, and ensure data integrity. Collaborate with analysts and stakeholders to translate SaaS and insurance metrics into technical solutions. Participate in code reviews, documentation, troubleshooting, and data warehouse lifecycle management while supporting US business hours.

Design, build, and optimize scalable GCP data pipelines and BigQuery data warehouses. Develop ETL/ELT workflows, implement data modeling, ensure data quality, optimize query performance and costs, maintain orchestration with Cloud Composer/Dataflow/Pub‑Sub, and automate deployments with CI/CD while enforcing security and governance.

As a Data Engineer, you will design, develop, and maintain data integration solutions, optimize ETL/ELT pipelines, and support data workflows for analytics and reporting.

Develop and maintain reliable data pipelines, ELT processes, workflow orchestration, custom data connectors, and CI/CD pipelines using Airflow, Python, PySpark, Hive/Trino, SQL, and Snowflake. Collaborate with cross-functional teams, monitor and troubleshoot data workflows, validate and test data, document technical processes, and support data governance.

Leads end-to-end data products from ingestion and transformation through semantic modeling, Power BI reporting, documentation, governance, and user adoption. Builds Microsoft Fabric pipelines, Lakehouse or Warehouse architectures, dimensional models, and secure, optimized Power BI solutions. Analyzes data, supports advanced analytics and AI-assisted reporting, establishes quality and CI/CD practices, collaborates with cross-functional stakeholders, and manages data engineers through objectives, reviews, and development.