Top Data Engineer Jobs in Kolkata

Design, build, and maintain cloud-native data pipelines and ETL/ELT workflows for high-volume trade lifecycle data. Integrate DTCC sources (RTTM, Settlement Web) into a Unified Trade Record, process ISO 15022 messages, manage trade exception databases, optimize SQL Server performance, and ensure data quality, lineage, governance, and observability while collaborating with business stakeholders.

Design, develop, and optimize AWS Glue ETL pipelines integrating data from S3, RDS, Redshift, and other AWS services. Transform data into analytics-ready formats, ensure data quality and security, tune performance, orchestrate workflows (Step Functions/Airflow), monitor jobs, and collaborate with analysts and stakeholders to deliver scalable data lake and warehouse solutions.

Design and implement modern data warehouse solutions using Databricks and cloud (Azure/AWS). Develop, orchestrate (Airflow) and troubleshoot ETL pipelines (batch and streaming), build dimensional data models for reporting, collaborate with architects and business stakeholders, mentor team members, and drive technical discussions.

Data Engineer responsibilities include designing and building scalable data management systems, optimizing data pipelines, managing data warehouses, and ensuring data quality and compliance.

Build and prepare data pipelines: mapping, cleansing, transformation, integration, and wrangling using Python and SQL. Perform feature engineering for structured and unstructured data and support API and web app deployment for data products.

Design, build, and maintain scalable ETL/ELT data pipelines on GCP/BigQuery using Python and Spark. Integrate systems (APIs, Oracle EBS), implement workflow orchestration, ensure data quality and security, monitor performance, and document processes while collaborating with analysts and business teams.

Build and maintain scalable ETL pipelines on GCP, transform large/disconnected datasets, automate and optimize data delivery, support stakeholders, and apply data engineering best practices including testing and release management.

Design, build, and maintain scalable ETL/ELT pipelines and microservices for marketing and product data, ingesting from ad platforms (especially Meta Ads) and event systems. Enable campaign performance tracking, lead funnel analysis, attribution, and revenue reporting. Ensure data quality, observability, governance, and documentation while collaborating with marketing, growth, and analytics to deliver actionable datasets and drive business outcomes.

Design, build, and optimize Snowflake data models and dbt pipelines. Create Power BI reports and paginated RDLs with DAX and row-level security. Manage CI/CD with Azure DevOps, version control with Git, enforce data quality and governance, and optimize warehouse cost and performance while collaborating with business stakeholders.

Data Engineer responsible for building and maintaining ETL pipelines, data processing workflows, and data platforms. Must have strong hands-on experience with Healthcare Revenue Cycle Management and understanding of healthcare data workflows. Role requires hybrid (onsite + offshore) work and immediate availability.

Entry-level Azure-focused data engineering role supporting cloud data pipelines, Azure resource management, monitoring, and assisting senior engineers with ETL and troubleshooting.

Design, implement, and maintain data pipelines using Elasticsearch and data warehousing solutions, integrate data sources, and ensure data accuracy while collaborating with cross-functional teams.

The Data Engineer will design and maintain data models, develop BI solutions, integrate data, and optimize data flows while collaborating with stakeholders.

Design, develop, and maintain ELT/ETL Snowflake data warehouse solutions; implement data standards, CI/CD, monitoring, and production support; collaborate with product, business, and vendors; mentor junior developers and improve data engineering practices.

Build and maintain accounting data reporting and automation for global accounting teams. Design ETL/BI pipelines, investigate high-volume datasets, perform testing/QA, troubleshoot system configuration with users, and deliver accurate reports under tight deadlines.

Design, build, and maintain scalable cloud-native data pipelines for trade lifecycle processing. Ingest, transform, and normalize high-volume financial data (DTCC, ISO15022), implement MQ/API-based ingestion, optimize SQL Server performance, maintain UTR schemas and trade exception databases, ensure data quality, lineage and governance, and collaborate with reconciliation, settlements, and operations stakeholders.

Design and build a greenfield, multi-layer data warehouse and semantic metrics layer; separate analytics from OLTP; ensure data quality, traceability, tenant isolation, and high SLAs; enable linking of structured records to drone imagery/video; deliver self-service data access, observability, and infrastructure automation to scale across products and tenants.

Build and maintain end-to-end data pipelines using PySpark and SQL on Databricks/Delta. Establish data modeling and pipeline best practices, create AI-ready analytical datasets, troubleshoot pipeline issues, and collaborate with stakeholders to embed business logic and optimize reliability, efficiency, and performance.

Design, build, and maintain scalable Azure-based data pipelines and systems (Databricks, Data Lake, Synapse, ADF). Collaborate with cross-functional teams, ensure data quality and integrity, optimize performance, monitor and troubleshoot systems, and stay current with industry trends to improve solutions.

The role involves data modeling, troubleshooting complex issues, optimizing storage architectures and mentoring junior engineers while working with GCP and Python.

Design, build, and maintain centralized data pipelines, warehouses, lakes and hubs. Assemble complex datasets, implement ETL processes, build analytics tools and reports, support cross-functional teams, ensure secure cross-region data separation, and create product data tools to enable insights on acquisition and operational metrics.

Design, build, and operate scalable ETL/ELT pipelines using open-source tools. Optimize databases and SQL, prototype new tools, support migration from Azure Databricks to AWS, ensure data quality, observability, CI/CD, and collaborate across distributed teams in Advertising and Market Research.

Lead modernization of a large-scale AWS data platform: design, build, and optimize scalable ETL/ELT pipelines, migrate Airflow/EMR to AWS-native services (Glue, MWAA), implement data lake/warehouse solutions, enforce data governance/lineage/metadata, build data quality and monitoring frameworks, automate deployments with IaC, and support BI (QuickSight) and Power BI migration, UAT, and production support.

Build and maintain scalable batch and real-time data pipelines using Kafka, Maxwell, Spark and dbt; design medallion-based data models; implement cloud-native data platforms (S3, Trino, BigQuery); optimize performance, ensure data quality, observability, and SLA adherence; enable analytics through trusted datasets and Metabase dashboards.

Design and implement critical processes for a subscription billing system while collaborating with cross-functional teams. Requires expert SQL skills and familiarity with various databases and DevOps methodologies.