Top Data Engineer Jobs in Kolkata

Build, maintain, and optimize scalable batch and real-time data pipelines using PySpark, Spark, and cloud platforms. Develop ETL/ELT processes, data ingestion strategies, data lakes, and Big Data frameworks. Support data platform architecture, governance, security, performance tuning, and deployment across AWS, Azure, or GCP. Collaborate with data scientists, analysts, architects, and engineers to ensure reliable, secure, and accessible data.

Designs, develops, and maintains scalable data solutions, pipelines, and ETL processes using Databricks. Ensures data quality, integrates and migrates data across systems, troubleshoots pipeline issues, and optimizes performance and reliability. The role collaborates with cross-functional teams to translate data requirements into technical solutions, documents workflows, supports data governance and security practices, and mentors junior team members.

Design, develop, and maintain data solutions, pipelines, and ETL processes using Microsoft Azure Databricks. Ensure data quality, integration, migration, deployment, and workflow performance across systems. Lead data engineering efforts, resolve complex data challenges, coordinate with stakeholders, make team decisions, and mentor engineers while contributing to cross-team initiatives.

Design, develop, and optimize AWS Glue ETL pipelines integrating data from S3, RDS, Redshift, and other AWS services. Transform data into analytics-ready formats, ensure data quality and security, tune performance, orchestrate workflows (Step Functions/Airflow), monitor jobs, and collaborate with analysts and stakeholders to deliver scalable data lake and warehouse solutions.

Design, build, and maintain scalable Azure-based data pipelines and systems (Databricks, Data Lake, Synapse, ADF). Collaborate with cross-functional teams, ensure data quality and integrity, optimize performance, monitor and troubleshoot systems, and stay current with industry trends to improve solutions.

Leads architecture and development of large-scale batch and real-time data platforms and pipelines. Ensures data quality, governance, reliability, observability, scalability, and cost efficiency while building self-service capabilities. Supports analytics, machine learning, and generative AI teams with trusted data infrastructure. Establishes engineering standards, mentors engineers, and drives platform health across multiple teams. The role requires expertise in data integration, distributed processing, data modeling, cloud platforms, CI/CD, and infrastructure automation.

Develop and maintain reliable data pipelines, ELT processes, workflow orchestration, custom data connectors, and CI/CD pipelines using Airflow, Python, PySpark, Hive/Trino, SQL, and Snowflake. Collaborate with cross-functional teams, monitor and troubleshoot data workflows, validate and test data, document technical processes, and support data governance.

Leads end-to-end data products from ingestion and transformation through semantic modeling, Power BI reporting, documentation, governance, and user adoption. Builds Microsoft Fabric pipelines, Lakehouse or Warehouse architectures, dimensional models, and secure, optimized Power BI solutions. Analyzes data, supports advanced analytics and AI-assisted reporting, establishes quality and CI/CD practices, collaborates with cross-functional stakeholders, and manages data engineers through objectives, reviews, and development.

Design, build, and maintain scalable ETL/ELT and real-time data pipelines on AWS. Manage Airflow DAGs, Kafka ingestion, Redshift optimization, data quality checks, API integrations, and cost optimization while collaborating with BI for reporting needs.

Design, build, and maintain production data pipelines and integrations across applications, databases, and cloud services. Support data architecture, ingestion, embedding workflows for AI, data quality, monitoring, and platform reliability. Collaborate with Full Stack and AI teams to deploy scalable cloud-based data infrastructure and establish data engineering standards and best practices.

Designs and maintains SAP BW/4HANA data models and pipelines, develops end-to-end BI solutions, integrates SAP and non-SAP data, and delivers structured datasets for reporting and analytics. The role includes ETL, data transformation, performance optimization, query and load monitoring, and collaboration with business stakeholders. Candidates need strong SQL, data warehousing, SAP Datasphere, SAP BW on HANA, and SAP BDC experience. Power BI, Business Objects, and ABAP are beneficial.

Design, build, and maintain scalable ETL/data pipelines and data management blueprints. Ingest, transform, and curate large complex datasets for analytics, support cloud (AWS) implementations, enable downstream consumers, and provide technical leadership and operational support to ensure data governance, quality, and automation.

Design and develop scalable data-driven solutions and pipelines using Python and SQL. Leverage Azure data services to build secure, high-performance architectures, ensuring data integrity, governance, and overall success of data projects.

Design and build scalable data pipelines and architectures on Azure using ADF, Databricks, and Synapse. Implement Kimball/Data Vault modeling, write ETL in Python and T-SQL, ensure data governance (Azure Purview), automate tests, troubleshoot issues, document processes, and collaborate across teams.

Design and develop data-driven solutions and scalable data pipelines using Python and SQL. Leverage Azure data products to build robust, secure architectures, ensuring data integrity, performance, and governance while supporting data-centric client projects.

As a hands-on data engineer, you'll build and enhance scalable data platforms, develop data pipelines, and collaborate with various teams to improve data solutions and system performance.

Lead technical direction for data platform capabilities: design and maintain data pipelines, reporting models, and data governance to support trusted metrics and AI/LLM agentic workflows. Drive architectural improvements, mentor engineers, collaborate on roadmaps, and represent technical capabilities externally.

Design, build, and maintain cloud data pipelines and architectures using SQL, Python, Snowflake, and AWS. Implement CI/CD for data workflows, use developer assistance tools, and collaborate across teams to deliver reliable data solutions.

Design, develop, and coordinate cloud data solutions using Snowflake, Python, and AWS. Support product releases, deployments, testing, and post-install support. Collaborate with architects and tech leads, troubleshoot issues, and maintain documentation. Contribute to agile squads, adopt new technologies, and enable Fidelity Wealth business data needs.

Design, develop, and optimize PL/SQL artifacts and Python ETL scripts; tune SQL and Oracle performance; ensure data integrity and availability; integrate systems via APIs; support production deployments and monitoring; collaborate with engineers and analysts; administer Oracle and PostgreSQL; use GitLab and Jira for version control and tracking.

Lead database design, data modeling, migrations, and schema evolution across MySQL/Postgres and GCP databases. Design and operate config-driven ETL/ELT pipelines and streaming ingestion, enable CI/CD, troubleshoot data flows, and mentor offshore DB/ETL engineers.

Perform data migration/refresh from production, support Python-based data refresh framework, run post-migration fixes, validate and reconcile data, monitor and resolve batch jobs and pipeline issues, perform performance checks, and coordinate with dependent teams.

Design, develop, and optimize ELT/ETL pipelines and data models using SQL, Python, and cloud services (AWS). Enable cloud data movement to Snowflake, perform SQL performance tuning, support code migrations, and collaborate in agile, distributed teams to deliver analytics-ready data solutions.

Design, build, and maintain ELT/data pipelines and workflow orchestration using Airflow, Python, and PySpark. Develop custom connectors, implement DataOps and CI/CD for data, monitor and validate data flows, collaborate with cross-functional teams, and document data workflows and governance.

Design, build, and maintain scalable ELT/data pipelines and connectors using Airflow, Python, and PySpark. Implement DataOps and CI/CD for data workflows, monitor and troubleshoot pipelines, validate data quality, collaborate with cross-functional teams, and document data processes and governance.