Top Data Engineer Jobs in Kolkata

Develop and maintain data pipelines and applications using Python and Pandas, apply OOP and data structures, write and optimize SQL, and communicate with stakeholders. Familiarity with Agile, DevOps/CI-CD tools (Jenkins, Git, Jira), AWS, web frameworks (Django/Flask), and Snowflake is a plus.

Design, build, and maintain cloud data pipelines and streaming solutions using Java, Kafka, AWS services, SQL/warehouse technologies, and Python. Implement CI/CD, automated testing, and resilient microservice-based systems. Collaborate in a small agile team and ensure secure identity/authentication controls.

Design, build and optimize ETL pipelines and cloud data workflows using Python, PySpark, AWS Glue and Lambda. Implement data models and schemas in PL/SQL/PostgreSQL, integrate AWS services (SNS, Step Functions), and troubleshoot pipelines for performance, scalability and reliability.

Design, build, and maintain ETL pipelines and frameworks on AWS. Deploy and troubleshoot containerized applications (Docker, EKS), support CI/CD and build tooling, work with SQL/Oracle and ORM tools, and use job schedulers like Autosys/Airflow. Collaborate in Agile/SCRUM environments.

Design, implement and maintain high-volume online and offline batch and transactional data applications using Java and Spark. Build scalable data stores, write scripts, call APIs, and author complex SQL. Maintain code and database infrastructure, ensure data integrity, perform data cleaning, visualization and reporting, and support model training in an agile environment.

Design, build and maintain data solutions using Oracle SQL/PLSQL and Informatica ETL. Develop backend and APIs with Java/Spring Boot, work with XML/JSON, web frameworks (Angular/React), and operate in Unix environments. Use cloud/container tooling (AWS, Kubernetes, Docker, Rancher), Splunk for logging, follow Agile, collaborate across distributed teams, and support migrations and CI/CD pipelines.

Deliver data engineering and analysis work using Python, PySpark, SQL and data platforms (Airflow, Trino, Hive). Produce LLD, coordinate offshore teams, follow Agile/Scrum, and work with container platforms (Linux, OpenShift, Kubernetes) and visualization (Superset). Banking domain experience is a plus.

Design, build, and maintain ELT/data pipelines and workflow orchestration using Airflow, Python, and PySpark. Develop custom connectors to ingest diverse data, implement DataOps and data CI/CD pipelines, monitor and troubleshoot pipelines, validate data quality, collaborate with cross-functional teams, document workflows, and work with large-scale distributed datasets and visualization tools.

Design, build, and optimize ETL pipelines and data warehouses using SQL, AWS Glue, and S3. Investigate and resolve data issues, develop Python-based solutions and small web apps, and own requirements, design, and end-to-end delivery for change requests.

Data Engineer responsibilities include designing and building scalable data management systems, optimizing data pipelines, managing data warehouses, and ensuring data quality and compliance.

Build and operate a scalable data platform: design and maintain ETL/ELT pipelines, Bronze/Silver/Gold data layers, data models and semantic layers, manage migrations and schema changes, ensure data quality/observability, enable analytics and future event-driven/recommendation systems, and use AI-assisted workflows to accelerate engineering.

Design, build, and deliver production-ready Data & AI solutions on Microsoft Azure. Develop and maintain data pipelines and lakehouse architectures using Fabric, Databricks, and Azure services; implement CI/CD, optimize production workloads, and collaborate with architects, project teams, and clients.

Owner of company-wide reporting and analytics for Growth, Marketing, Product, Finance and Operations. Build and maintain dashboards, automated reports and data pipelines (dbt), ensure data quality and governance, run growth and product analyses (CAC, ROAS, LTV, retention), support A/B testing and ad-hoc decision support, leverage AI for automation, and coordinate VAs on data tasks.

Build and operate ingestion and transformation pipelines to turn messy insurance data into clean datasets. Design bronze/silver/fact layers, model and tune Postgres and analytical stores, define KPIs and reconciliation checks, orchestrate observable data jobs, and ensure end-to-end data quality for analytics and AI products.

Build and prepare data pipelines: mapping, cleansing, transformation, integration, and wrangling using Python and SQL. Perform feature engineering for structured and unstructured data and support API and web app deployment for data products.

Design, build, and maintain scalable ETL/ELT data pipelines on GCP/BigQuery using Python and Spark. Integrate systems (APIs, Oracle EBS), implement workflow orchestration, ensure data quality and security, monitor performance, and document processes while collaborating with analysts and business teams.

Build and maintain scalable ETL pipelines on GCP, transform large/disconnected datasets, automate and optimize data delivery, support stakeholders, and apply data engineering best practices including testing and release management.

Design, build, and maintain scalable ETL/ELT pipelines and microservices for marketing and product data, ingesting from ad platforms (especially Meta Ads) and event systems. Enable campaign performance tracking, lead funnel analysis, attribution, and revenue reporting. Ensure data quality, observability, governance, and documentation while collaborating with marketing, growth, and analytics to deliver actionable datasets and drive business outcomes.

Design, build, and optimize Snowflake data models and dbt pipelines. Create Power BI reports and paginated RDLs with DAX and row-level security. Manage CI/CD with Azure DevOps, version control with Git, enforce data quality and governance, and optimize warehouse cost and performance while collaborating with business stakeholders.

Data Engineer responsible for building and maintaining ETL pipelines, data processing workflows, and data platforms. Must have strong hands-on experience with Healthcare Revenue Cycle Management and understanding of healthcare data workflows. Role requires hybrid (onsite + offshore) work and immediate availability.

Design, implement, and maintain data pipelines using Elasticsearch and data warehousing solutions, integrate data sources, and ensure data accuracy while collaborating with cross-functional teams.

Design, build, and maintain dbt models and Snowflake data warehouses, own CI/CD and orchestration for pipelines, implement data quality tests, partner with stakeholders to translate requirements into production-ready data models, and optimize performance and observability.

The Data Engineer will design and maintain data models, develop BI solutions, integrate data, and optimize data flows while collaborating with stakeholders.

Design and build a greenfield, multi-layer data warehouse and semantic metrics layer; separate analytics from OLTP; ensure data quality, traceability, tenant isolation, and high SLAs; enable linking of structured records to drone imagery/video; deliver self-service data access, observability, and infrastructure automation to scale across products and tenants.

Build and maintain end-to-end data pipelines using PySpark and SQL on Databricks/Delta. Establish data modeling and pipeline best practices, create AI-ready analytical datasets, troubleshoot pipeline issues, and collaborate with stakeholders to embed business logic and optimize reliability, efficiency, and performance.