Willis Towers Watson Logo

Willis Towers Watson

Data Engineer

Posted 14 Hours Ago
Be an Early Applicant
In-Office
Kolkata, West Bengal, IND
Senior level
In-Office
Kolkata, West Bengal, IND
Senior level
Build and maintain scalable cloud data pipelines using Azure Databricks, Python, PySpark, and Azure Data Factory. Ingest and transform large datasets, manage governance with Unity Catalog, and develop Azure or AWS data solutions. Monitor, troubleshoot, and optimize production pipelines, support releases and on-call operations, translate business requirements into robust solutions, and maintain technical documentation. Requires strong data engineering, warehousing, SQL, cloud, DevOps, and CI/CD experience.
The summary above was generated by AI

About The Company:

WTW (NASDAQ: WTW) is in the business of people, risk and capital. With roots dating to 1828, our company has over 45,000 colleagues serving more than 140 countries and markets. Our values – client focus, teamwork, integrity, respect and excellence – underlie all that we do, including how we behave and interact with each other. They are part of our WTW DNA. We design and deliver solutions that manage risk, optimize benefits, cultivate talent, and expand the power of capital to protect and strengthen institutions and individuals. Our unique perspective allows us to see the critical intersections between talent, assets, and ideas — the dynamic formula that drives business performance. Together, we unlock potential. We are located on the internet at wtwco.com

 

Role and Responsibility:

 

  • Build and maintain scalable pipelines with Azure Databricks, Python, and PySpark.
  • Orchestrate data movement and workflows with ADF pipelines, triggers, and integration runtimes.
  • Ingest and transform large datasets from sources such as SQL Server and Oracle.
  • Manage data governance and access control with Unity Catalog.
  • Implement cloud-native data solutions following best practices, with experience in the Azure or AWS cloud.
  • Monitor, troubleshoot, and tune pipelines for performance and reliability; take part in the on-call rotation.
  • Turn business requirements into robust data solutions and support production releases.
  • Maintain documentation and runbooks.
Responsibilities

-

Qualifications

Graduate

  • Minimum 5 years of experience in Data Engineering, Data Warehousing, or related areas.
  • Bachelor’s degree in Computer Science, Information Technology, or a related discipline or equivalent practical experience.
  • Strong hands-on experience with Azure Databricks (jobs/workflows, Delta Lake, Unity Catalog) in enterprise-scale environments.
  • Advanced Python skills and experience developing distributed data processing solutions using PySpark.
  • Hands-on experience with Azure Data Factory pipelines and ETL/ELT design, development, and optimization.
  • Strong understanding of Azure cloud services, networking and storage, data modeling, and SQL (T-SQL preferred).
  • Working knowledge of Windows and Linux environments.
  • Experience with CI/CD and DevOps practices for automated deployment of data solutions (GitHub Actions preferred).
  • Proven ability to troubleshoot complex data processing and pipeline issues in production environments.

Similar Jobs

3 Days Ago
In-Office or Remote
India
Expert/Leader
Expert/Leader
Information Technology
Designs and manages scalable data platforms, pipelines, ETL/ELT frameworks, data warehouses, data lakes, and lakehouse architectures. Develops batch and real-time processing solutions using cloud-native services and big data technologies. Ensures data quality, governance, security, and compliance while optimizing large-scale data performance. Supports analytics, reporting, and AI/ML initiatives, contributes to architecture reviews, automates deployments through CI/CD, provides technical leadership, and mentors junior engineers.
Top Skills: Amazon EmrAmazon RedshiftAmazon S3Apache KafkaSparkAws GlueAzure Data FactoryAzure Data Lake StorageAzure DatabricksAzure DevopsAzure Sql DatabaseAzure Synapse AnalyticsCi/CdDelta LakeGitGoogle BigqueryGoogle Cloud StorageGoogle DataflowHadoopJenkinsAzureMicrosoft FabricMySQLOraclePostgresPysparkPythonScalaShell ScriptingSnowflakeSQLSQL Server
4 Days Ago
In-Office or Remote
India
Entry level
Entry level
Information Technology
Develop and support batch and incremental data pipelines, ETL workflows, SQL transformations, and Airflow orchestration. Investigate data quality issues, perform lineage and reconciliation analysis, support cloud data migrations, validate datasets, resolve production incidents, and build reusable data engineering components. Collaborate with stakeholders and technical teams on data requirements, modernization, monitoring, and process improvements.
Top Skills: Apache AirflowBigQueryCloud ComposerGoogle Cloud PlatformGoogle Cloud StorageKafkaPl/SqlPub/SubPythonSQL
21 Days Ago
In-Office or Remote
India
Senior level
Senior level
Information Technology
Build and maintain governed finance data products on Microsoft Fabric and Databricks. Responsibilities include developing PySpark and Python ingestion pipelines, implementing incremental loading and CDC, optimizing Delta Lake tables, managing Azure Data Factory pipelines and Analysis Services cubes, designing Power BI semantic models, and ensuring version control, testing, monitoring, governance, and data contract compliance. The role also involves stakeholder collaboration, mentoring junior engineers, and applying enterprise data architecture standards.
Top Skills: Adls Gen2SparkAzure Analysis ServicesAzure Data FactoryCi/CdDatabricksDelta LakeMicrosoft FabricMicrosoft PurviewPower BIPysparkPythonSQL ServerT-Sql

What you need to know about the Kolkata Tech Scene

When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account