Top Data Engineer Jobs in Kolkata

Design, build, and maintain cloud-native data pipelines and ETL/ELT workflows for high-volume trade lifecycle data. Integrate DTCC sources (RTTM, Settlement Web) into a Unified Trade Record, process ISO 15022 messages, manage trade exception databases, optimize SQL Server performance, and ensure data quality, lineage, governance, and observability while collaborating with business stakeholders.

Design, develop, and optimize AWS Glue ETL pipelines integrating data from S3, RDS, Redshift, and other AWS services. Transform data into analytics-ready formats, ensure data quality and security, tune performance, orchestrate workflows (Step Functions/Airflow), monitor jobs, and collaborate with analysts and stakeholders to deliver scalable data lake and warehouse solutions.

Data Engineer responsibilities include designing and building scalable data management systems, optimizing data pipelines, managing data warehouses, and ensuring data quality and compliance.

Build and operate a scalable data platform: design and maintain ETL/ELT pipelines, Bronze/Silver/Gold data layers, data models and semantic layers, manage migrations and schema changes, ensure data quality/observability, enable analytics and future event-driven/recommendation systems, and use AI-assisted workflows to accelerate engineering.

Design, build, and maintain scalable Azure-based data pipelines and systems (Databricks, Data Lake, Synapse, ADF). Collaborate with cross-functional teams, ensure data quality and integrity, optimize performance, monitor and troubleshoot systems, and stay current with industry trends to improve solutions.

Design, build, and deliver production-ready Data & AI solutions on Microsoft Azure. Develop and maintain data pipelines and lakehouse architectures using Fabric, Databricks, and Azure services; implement CI/CD, optimize production workloads, and collaborate with architects, project teams, and clients.

Owner of company-wide reporting and analytics for Growth, Marketing, Product, Finance and Operations. Build and maintain dashboards, automated reports and data pipelines (dbt), ensure data quality and governance, run growth and product analyses (CAC, ROAS, LTV, retention), support A/B testing and ad-hoc decision support, leverage AI for automation, and coordinate VAs on data tasks.

Build and operate ingestion and transformation pipelines to turn messy insurance data into clean datasets. Design bronze/silver/fact layers, model and tune Postgres and analytical stores, define KPIs and reconciliation checks, orchestrate observable data jobs, and ensure end-to-end data quality for analytics and AI products.

Build and prepare data pipelines: mapping, cleansing, transformation, integration, and wrangling using Python and SQL. Perform feature engineering for structured and unstructured data and support API and web app deployment for data products.

Design, build, and maintain scalable ETL/ELT data pipelines on GCP/BigQuery using Python and Spark. Integrate systems (APIs, Oracle EBS), implement workflow orchestration, ensure data quality and security, monitor performance, and document processes while collaborating with analysts and business teams.

Build and maintain scalable ETL pipelines on GCP, transform large/disconnected datasets, automate and optimize data delivery, support stakeholders, and apply data engineering best practices including testing and release management.

Design, build, and maintain scalable ETL/ELT pipelines and microservices for marketing and product data, ingesting from ad platforms (especially Meta Ads) and event systems. Enable campaign performance tracking, lead funnel analysis, attribution, and revenue reporting. Ensure data quality, observability, governance, and documentation while collaborating with marketing, growth, and analytics to deliver actionable datasets and drive business outcomes.

Data Engineer responsible for building and maintaining ETL pipelines, data processing workflows, and data platforms. Must have strong hands-on experience with Healthcare Revenue Cycle Management and understanding of healthcare data workflows. Role requires hybrid (onsite + offshore) work and immediate availability.

Design, build, and optimize Snowflake data models and dbt pipelines. Create Power BI reports and paginated RDLs with DAX and row-level security. Manage CI/CD with Azure DevOps, version control with Git, enforce data quality and governance, and optimize warehouse cost and performance while collaborating with business stakeholders.

Design, implement, and maintain data pipelines using Elasticsearch and data warehousing solutions, integrate data sources, and ensure data accuracy while collaborating with cross-functional teams.

Design, build, and maintain dbt models and Snowflake data warehouses, own CI/CD and orchestration for pipelines, implement data quality tests, partner with stakeholders to translate requirements into production-ready data models, and optimize performance and observability.

The Data Engineer will design and maintain data models, develop BI solutions, integrate data, and optimize data flows while collaborating with stakeholders.

Design, build, and maintain scalable cloud-native data pipelines for trade lifecycle processing. Ingest, transform, and normalize high-volume financial data (DTCC, ISO15022), implement MQ/API-based ingestion, optimize SQL Server performance, maintain UTR schemas and trade exception databases, ensure data quality, lineage and governance, and collaborate with reconciliation, settlements, and operations stakeholders.

Design and build a greenfield, multi-layer data warehouse and semantic metrics layer; separate analytics from OLTP; ensure data quality, traceability, tenant isolation, and high SLAs; enable linking of structured records to drone imagery/video; deliver self-service data access, observability, and infrastructure automation to scale across products and tenants.

Build and maintain end-to-end data pipelines using PySpark and SQL on Databricks/Delta. Establish data modeling and pipeline best practices, create AI-ready analytical datasets, troubleshoot pipeline issues, and collaborate with stakeholders to embed business logic and optimize reliability, efficiency, and performance.

Build and enhance enterprise data pipelines into Databricks Unity Catalog and Delta Lake. Improve remediation and entity-matching layers (including D&B DataBlocks), integrate APIs, and support LLM-assisted remediation and CMG redesign projects.

Design, build, and maintain centralized data pipelines, warehouses, lakes and hubs. Assemble complex datasets, implement ETL processes, build analytics tools and reports, support cross-functional teams, ensure secure cross-region data separation, and create product data tools to enable insights on acquisition and operational metrics.

Build and maintain scalable batch and real-time data pipelines using Kafka, Maxwell, Spark and dbt; design medallion-based data models; implement cloud-native data platforms (S3, Trino, BigQuery); optimize performance, ensure data quality, observability, and SLA adherence; enable analytics through trusted datasets and Metabase dashboards.

Design, build, and operate scalable data engineering services and ingestion pipelines (CDC/streaming). Develop and optimize a centralized analytics warehouse, data models, and aggregation strategies. Build APIs, enforce multi-tenant security and data governance, monitor pipeline health, improve automation and observability, and ensure production reliability through strong engineering practices.

Lead a two-month project to assess the current data environment and design, build, and optimize a scalable cloud data warehouse. Deliver automated ETL/ELT pipelines, dimensional models, analytics-ready datasets, documentation, and handover while partnering with analysts and stakeholders for BI and reporting.