Top Data Engineer Jobs in Kolkata

Design, build, and optimize high-volume data pipelines using Python, Databricks and Spark on Azure. Create and maintain automation test suites (Azure DevOps), perform manual/load/exploratory testing, collaborate with BAs and developers to meet sprint goals, and assist with sprint estimation and delivery.

Design, develop, and deploy data engineering solutions and analytics pipelines on Databricks. Build data models, optimize SQL and DAX queries, manage ETL and real-time ingestion, tune performance for large data volumes, and produce dashboards and reports while cross-training team members.

The Senior Data Scientist & Engineer will build and manage data infrastructure, analyze product usage, build models, track metrics, run experiments, and communicate insights to guide product decisions.

Senior technical leader responsible for designing, building, and scaling cloud-native data platforms and pipelines. Partners with stakeholders, mentors engineers, enforces engineering best practices, ensures data modeling, governance, and quality, debugs production issues, and contributes to architecture, design, and Agile delivery to support business outcomes.

Design, build, and maintain scalable cloud-native batch and streaming data platforms and pipelines. Own end-to-end solutioning, deployment, production support, performance tuning, monitoring, and mentorship while collaborating with product, analytics, and infrastructure teams.

Design, build, and operate scalable batch and real-time data pipelines and analytics platforms. Partner with enterprise customers to define requirements, own technical delivery from discovery to adoption, and present architectures to stakeholders. Drive data governance, observability, CI/CD, and platform optimization while mentoring junior engineers and collaborating with Product, Engineering, and Customer Success teams to enable analytics and AI/ML applications.

Design, build, and optimize large-scale ETL pipelines and distributed data applications (batch and streaming) using Spark and Scala. Ensure data quality and performance, deploy and manage workloads in cloud/container environments, troubleshoot production issues, and collaborate with product, engineering, and analytics teams to deliver scalable AdTech data solutions.

The Big Data Engineer will support existing applications and work on new design and implementation requirements, utilizing big data technologies and tools.

The Data Analyst prepares, analyzes, and validates data, applying statistical methods and visualization techniques to derive insights and support business objectives. Communicates findings effectively and collaborates with Data Engineers for model and dashboard implementation.

The role involves data analytics with a focus on querying large data sets, visualization using Tableau, and applying quantitative skills, predominantly in the FMCG and Food & Distribution sectors.

Triage and resolve Master Data Management (Party, Risk, Reference) issues in Stibo STEP, run targeted data-cleansing sprints, monitor data quality dashboards, support releases/UAT, and maintain documentation and playbooks to prevent recurring data issues.

Design and implement data federation and lakehouse architectures (Starburst/Trino), build scalable ETL/ELT pipelines using Python and Spark, optimize Spark and federated queries, manage Delta/Iceberg/Hudi tables, and enforce governance, access control, and data masking for analytics and AI use.

Lead and mentor a data engineering team to design, build, and optimize scalable batch and real-time data pipelines using Databricks, Spark, Delta Lake and cloud services (Azure/AWS). Implement Medallion architecture, ETL/ELT workflows (ADF/Databricks Workflows), CI/CD and IaC, ensure data governance, performance, and stakeholder collaboration.