Sago Logo

Sago

Data Engineer

Posted 3 Days Ago
In-Office or Remote
Hiring Remotely in Gurugram, Haryana
Mid level
In-Office or Remote
Hiring Remotely in Gurugram, Haryana
Mid level
Design, build, and maintain scalable ETL and ELT pipelines, data transformations, and analytics-ready datasets. Integrate data from databases, APIs, files, SharePoint, and cloud storage. Implement quality checks, monitoring, logging, alerts, and production troubleshooting. Optimize processing performance, cost, and reliability while documenting data mappings and operational procedures. Collaborate with BI analysts, application teams, and stakeholders to deliver dependable data solutions.
The summary above was generated by AI

We are looking for a Data Engineer with 2–5 years of experience to design, build, and maintain reliable data pipelines and analytics-ready datasets. The ideal candidate will have strong SQL and Python or PySpark skills, hands-on experience with cloud data platforms, and the ability to troubleshoot data-quality, performance, and production issues independently.
Key Responsibilities

·    Design, develop, and maintain scalable ETL and ELT pipelines for batch and scheduled data processing.

·    Build and optimize data transformations using SQL, Python, and PySpark.

·    Ingest and integrate data from databases, APIs, files, SharePoint, and cloud storage.

·    Create and maintain curated, analytics-ready datasets for Power BI, Superset, and other reporting platforms.

·    Implement data-quality checks, reconciliation controls, monitoring, logging, and failure alerts.

·    Troubleshoot pipeline failures, schema mismatches, performance bottlenecks, and data discrepancies.

·    Optimize large-scale data processing for runtime, memory, storage, and cost efficiency.

·    Automate recurring workflows and schedule production jobs using orchestration tools such as Apache Airflow.

·    Maintain technical documentation, data mappings, business rules, and operational runbooks.

·    Collaborate with BI analysts, application teams, and business stakeholders to deliver dependable data solutions.


RequirementsRequired Skills and Experience

·    2–5 years of professional experience in data engineering, ETL development, or a similar role.

·    Strong SQL skills, including joins, common table expressions, window functions, data validation, and query optimization.

·    Hands-on experience with Python and/or PySpark for data processing and automation.

·    Practical experience building and supporting ETL or ELT pipelines in production.

·    Experience working with large datasets, incremental loads, upserts, schema changes, and partitioned data.

·    Good understanding of relational databases, dimensional modeling, data warehousing, and file formats such as Parquet, CSV, and JSON.

·    Experience with Git or another version-control system and structured deployment practices.

·    Strong debugging, analytical, documentation, and stakeholder-communication skills.
Preferred Skills

·    Experience with AWS services such as Amazon S3, Athena, EMR, and EMR Serverless.

·    Experience with Apache Spark, Delta Lake, Apache Airflow, Dremio, or Trino-compatible SQL engines.

·    Familiarity with Power BI, Apache Superset, or other downstream reporting tools.

·    Experience with REST APIs, SharePoint integrations, and automated file-delivery workflows.

·    Understanding of data security, access controls, privacy, and production monitoring practices.


Benefits

* 5 Days working
* Remote Job
* Medical Insurance

Similar Jobs

An Hour Ago
In-Office or Remote
India
Entry level
Entry level
Information Technology
Develop and support batch and incremental data pipelines, ETL workflows, SQL transformations, and Airflow orchestration. Investigate data quality issues, perform lineage and reconciliation analysis, support cloud data migrations, validate datasets, resolve production incidents, and build reusable data engineering components. Collaborate with stakeholders and technical teams on data requirements, modernization, monitoring, and process improvements.
Top Skills: Apache AirflowBigQueryCloud ComposerGoogle Cloud PlatformGoogle Cloud StorageKafkaPl/SqlPub/SubPythonSQL
An Hour Ago
In-Office or Remote
India
Entry level
Entry level
Information Technology
Build and support batch and incremental data pipelines, ETL workflows, Airflow DAGs, and BigQuery transformations. Ensure data quality, lineage, reconciliation, and governance across source and downstream systems. Troubleshoot pipeline failures and data discrepancies, support cloud migration initiatives, collaborate with stakeholders, and provide production support while developing reusable engineering components.
Top Skills: Apache AirflowBigQueryCdpCloud ComposerEltETLGoogle Cloud PlatformGoogle Cloud StorageMartech PlatformsPl/SqlPythonSQL
4 Days Ago
In-Office or Remote
India
Junior
Junior
Cloud • Security • Software • Cybersecurity
Build and maintain semantic models, data marts, certified reports, dashboards, and self-service analytics. Partner with business and data teams to define KPIs, reporting requirements, and standards. Analyze data, improve report performance and usability, answer questions about metrics and business processes, and support enterprise analytics strategy using systems such as Oracle, Salesforce, and Workday.
Top Skills: OraclePower BISalesforceSQLTableauWorkday

What you need to know about the Kolkata Tech Scene

When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account