Design, build, and maintain scalable data pipelines and ETL/ELT solutions using Microsoft Azure Fabric, Databricks, and Azure data services. Translate business requirements into technical solutions, optimize data workflows for performance and cost, troubleshoot production issues, and collaborate with architects, analysts, developers, and global stakeholders. Use AI-assisted development and automation to improve engineering productivity while owning delivery quality, timelines, and outcomes.
This role is for one of Weekday’s clients
Min Experience: 5+ years
Location: India
JobType: full-time
This is a full-time Remote role for an experienced Data Engineer who enjoys solving complex data problems and takes ownership from design through delivery. You can work from home (anywhere in INDIA, job location is in India).
This role is ideal for someone who can build scalable data pipelines on Microsoft Azure Fabric, leverage AI to improve engineering productivity, and work closely with business and technical stakeholders.
Requirements
Qualifications:
- 5+ years of hands-on experience as a Data Engineer.
- Strong experience with Microsoft Azure Fabric, Databricks and Azure data services.
- Solid knowledge of SQL and data modeling concepts.
- Experience building enterprise-grade data pipelines and data integration solutions.
- Proficiency in Python, Spark, or similar technologies is preferred.
- Experience working with cloud-based data platforms in production environments.
Key Skills:
- Design, develop, and maintain scalable data pipelines using Microsoft Azure Fabric.
- Build reliable ETL/ELT processes for structured and unstructured data.
- Work with business teams to understand data requirements and translate them into technical solutions.
- Optimize data processing workflows for performance, scalability, and cost.
- Apply AI-assisted development tools and modern engineering practices to improve delivery speed and solution quality.
- Troubleshoot production issues and proactively identify improvements.
- Collaborate with architects, analysts, and developers throughout the project lifecycle.
- Owns their work. Take responsibility for quality, timelines, and outcomes without constant follow-up.
- Thinks beyond the obvious. Actively use AI and automation to solve problems, improve engineering productivity, and deliver better solutions.
- Communicates proactively. Raise risks early, ask questions when something isn't clear, and keep stakeholders informed.
- Adapts quickly. Requirements evolve, and you're comfortable adjusting priorities while maintaining delivery commitments.
- Works collaboratively. Available to engage with global teams and can overlap with the U.S. East Coast during critical discussions (up to 1:00 PM ET, as needed).
Must-have skills
Databricks, Fabric, Data Engineering
Similar Jobs
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Big Data Analytics • Automation
Designs and optimizes scalable data ingestion pipelines for product telemetry and enterprise business data. Builds automated pipelines using Fivetran, Python, APIs, S3 lakehouse architectures, Kafka, Spark, and Snowflake. Applies advanced SQL, incremental loading, CDC, micro-batching, and rate-limit handling to support reliable, analytics-ready datasets. Implements CI/CD and DevOps practices, monitors pipeline performance, and partners with analysts and platform teams to rapidly deliver data solutions.
Top Skills:
Amazon S3SparkBulk ApisCdcCi/CdDevOpsFivetranKafkaPythonSnowflakeSQLVersion Control
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Design, build, and operate Atlassian’s foundational data platform, including Flink streaming ingestion and MPP query systems such as StarRocks. The role owns architecture, production reliability, performance, cost, data quality, observability, code reviews, complex problem resolution, cross-team initiatives, and mentoring. Candidates need strong distributed-systems and data-engineering expertise, coding skills in Java, Scala, or Python, cloud infrastructure experience, and operational experience with high-scale platforms.
Top Skills:
Apache DorisApache FlinkApache PinotSparkAWSGCPJavaPythonScalaStarrocksTrino
Information Technology
Design, build, and deploy secure, scalable cloud data solutions and pipelines for enterprise clients. Translate business requirements into architectures, integrations, and data models; ensure production performance and reliability; lead technical reviews and workshops; create reusable documentation and accelerators; and collaborate with distributed engineering, analytics, platform, and client teams. The role also includes mentoring, delivery ownership, stakeholder communication, and contributing to consulting practice excellence.
Top Skills:
AdlsAirflowAWSAws Data Migration ServiceAws Managed AirflowAzureAzure Data FactoryCassandraDatabricksDbtElasticsearchFivetranGCPGcsGoogle DataprocHadoopHdfsInformatica Intelligent Cloud ServicesKafkaKuduLuigiMatillionNifiPythonS3ScalaSnowflakeSolrSparkSpark StreamingSQLStreamsets
What you need to know about the Kolkata Tech Scene
When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.
