Top Data Engineer Jobs in Kolkata

Design, build, and maintain cloud-native data pipelines and ETL/ELT workflows for high-volume trade lifecycle data. Integrate DTCC sources (RTTM, Settlement Web) into a Unified Trade Record, process ISO 15022 messages, manage trade exception databases, optimize SQL Server performance, and ensure data quality, lineage, governance, and observability while collaborating with business stakeholders.

Design, develop, and optimize AWS Glue ETL pipelines integrating data from S3, RDS, Redshift, and other AWS services. Transform data into analytics-ready formats, ensure data quality and security, tune performance, orchestrate workflows (Step Functions/Airflow), monitor jobs, and collaborate with analysts and stakeholders to deliver scalable data lake and warehouse solutions.

Design, develop, and maintain scalable data pipelines and ETL processes using PySpark. Ensure data quality, optimize distributed data workflows, troubleshoot complex data issues, collaborate with stakeholders, mentor junior engineers, and lead team technical decisions to support data-driven business needs.

Build and operate ingestion and transformation pipelines to turn messy insurance data into clean datasets. Design bronze/silver/fact layers, model and tune Postgres and analytical stores, define KPIs and reconciliation checks, orchestrate observable data jobs, and ensure end-to-end data quality for analytics and AI products.

Build and prepare data pipelines: mapping, cleansing, transformation, integration, and wrangling using Python and SQL. Perform feature engineering for structured and unstructured data and support API and web app deployment for data products.

Design, build, and maintain scalable ETL/ELT data pipelines on GCP/BigQuery using Python and Spark. Integrate systems (APIs, Oracle EBS), implement workflow orchestration, ensure data quality and security, monitor performance, and document processes while collaborating with analysts and business teams.

Build and maintain scalable ETL pipelines on GCP, transform large/disconnected datasets, automate and optimize data delivery, support stakeholders, and apply data engineering best practices including testing and release management.

Design, build, and maintain scalable ETL/ELT pipelines and microservices for marketing and product data, ingesting from ad platforms (especially Meta Ads) and event systems. Enable campaign performance tracking, lead funnel analysis, attribution, and revenue reporting. Ensure data quality, observability, governance, and documentation while collaborating with marketing, growth, and analytics to deliver actionable datasets and drive business outcomes.

Design, build, and optimize Snowflake data models and dbt pipelines. Create Power BI reports and paginated RDLs with DAX and row-level security. Manage CI/CD with Azure DevOps, version control with Git, enforce data quality and governance, and optimize warehouse cost and performance while collaborating with business stakeholders.

Data Engineer responsible for building and maintaining ETL pipelines, data processing workflows, and data platforms. Must have strong hands-on experience with Healthcare Revenue Cycle Management and understanding of healthcare data workflows. Role requires hybrid (onsite + offshore) work and immediate availability.

Design, implement, and maintain data pipelines using Elasticsearch and data warehousing solutions, integrate data sources, and ensure data accuracy while collaborating with cross-functional teams.

Design, build, and maintain dbt models and Snowflake data warehouses, own CI/CD and orchestration for pipelines, implement data quality tests, partner with stakeholders to translate requirements into production-ready data models, and optimize performance and observability.

Design, build, and maintain scalable Azure-based data pipelines and systems (Databricks, Data Lake, Synapse, ADF). Collaborate with cross-functional teams, ensure data quality and integrity, optimize performance, monitor and troubleshoot systems, and stay current with industry trends to improve solutions.

The Data Engineer will design and maintain data models, develop BI solutions, integrate data, and optimize data flows while collaborating with stakeholders.

Design, build, and maintain scalable cloud-native data pipelines for trade lifecycle processing. Ingest, transform, and normalize high-volume financial data (DTCC, ISO15022), implement MQ/API-based ingestion, optimize SQL Server performance, maintain UTR schemas and trade exception databases, ensure data quality, lineage and governance, and collaborate with reconciliation, settlements, and operations stakeholders.

Design and build a greenfield, multi-layer data warehouse and semantic metrics layer; separate analytics from OLTP; ensure data quality, traceability, tenant isolation, and high SLAs; enable linking of structured records to drone imagery/video; deliver self-service data access, observability, and infrastructure automation to scale across products and tenants.

Build and maintain end-to-end data pipelines using PySpark and SQL on Databricks/Delta. Establish data modeling and pipeline best practices, create AI-ready analytical datasets, troubleshoot pipeline issues, and collaborate with stakeholders to embed business logic and optimize reliability, efficiency, and performance.

Build and enhance enterprise data pipelines into Databricks Unity Catalog and Delta Lake. Improve remediation and entity-matching layers (including D&B DataBlocks), integrate APIs, and support LLM-assisted remediation and CMG redesign projects.

Design, build, and maintain centralized data pipelines, warehouses, lakes and hubs. Assemble complex datasets, implement ETL processes, build analytics tools and reports, support cross-functional teams, ensure secure cross-region data separation, and create product data tools to enable insights on acquisition and operational metrics.

Build and maintain scalable batch and real-time data pipelines using Kafka, Maxwell, Spark and dbt; design medallion-based data models; implement cloud-native data platforms (S3, Trino, BigQuery); optimize performance, ensure data quality, observability, and SLA adherence; enable analytics through trusted datasets and Metabase dashboards.

Design, build, and operate scalable data engineering services and ingestion pipelines (CDC/streaming). Develop and optimize a centralized analytics warehouse, data models, and aggregation strategies. Build APIs, enforce multi-tenant security and data governance, monitor pipeline health, improve automation and observability, and ensure production reliability through strong engineering practices.

Lead a two-month project to assess the current data environment and design, build, and optimize a scalable cloud data warehouse. Deliver automated ETL/ELT pipelines, dimensional models, analytics-ready datasets, documentation, and handover while partnering with analysts and stakeholders for BI and reporting.

Support design and implementation of the data platform blueprint, collaborate with Integration and Data Architects, troubleshoot integration and performance issues, document best practices, optimize Snowflake storage and queries, and mentor junior team members to ensure cohesive, secure, and scalable data platform operations.

The Azure Data Engineer will build data pipelines and dataflows, implement security modules, and work with Azure services while supporting business requirements and data analysis.

We are looking for a Data Engineer with skills in Python, SQL, and Azure technologies to develop Big Data applications. Responsibilities include working with Spark and Docker to handle large scale data processing and analytics.