We are looking for a Data Engineer with skills in Python, SQL, and Azure technologies to develop Big Data applications. Responsibilities include working with Spark and Docker to handle large scale data processing and analytics.
This is a remote position.
- Must have - Python, SQL, Spark, Databricks, Azure Data Factory, Azure Synapse, Docker
- Good to have - Knowledge of Teradata, Airflow, AWS, GC
- experience in developing Big Data applications
- Experience in large-scale Big Data & Analytics applications
- Hands on experience in using technologies like Spark, Scala,
- Experience in Azure & Docker are added advantage.
- Strong problem-solving skills, data structures and algorithms
- Experience with distributed systems handling large amounts of data.
Requirements
- Immediate Joiner
- Remote location
- Data Engineer with 2 to 6 Yrs of experience
Similar Jobs
Artificial Intelligence • eCommerce • Software
Design, build, and maintain scalable batch and streaming ETL/ELT pipelines, production data services (REST/gRPC), and cloud-based data infrastructure. Implement CDC and time-travel data architectures, ensure data quality with tests and CI/CD, optimize data models for OLTP/OLAP, and collaborate cross-functionally to deliver reliable production data systems.
Top Skills:
Apache AirflowApache ArrowApache IcebergAWSAws CodepipelineAzureCdcCi/CdDatabricksDbtDelta LakeEtl/EltGCPGitGithub ActionsGrpcKafkaPandasPolarsPythonRest
Healthtech
Design, build, and maintain scalable GCP-based data pipelines and analytic data products. Transform diverse source systems into curated, business-ready datasets, ensure data quality and governance, and partner with stakeholders to translate requirements into production data solutions. Mentor intermediate contributors and lead assigned project efforts.
Top Skills:
BigQueryCloud Composer (Managed Airflow)Cloud FunctionsCloud RunDataflowDataplexDataprocGoogle Cloud Platform (Gcp)MS OfficePythonSASSQL
.jpeg){kind=icon}
Cloud • Enterprise Web • Hardware • Information Technology • Internet of Things • Robotics • Semiconductor
Design, build, and maintain scalable data pipelines and feature engineering workflows. Deploy and monitor ML models for real-time and batch inference, create secure REST APIs for model serving, integrate ML services with systems, troubleshoot production issues, and collaborate with data scientists and engineers to deliver cloud-native ML solutions.
Top Skills:
SparkAWSAzureAzure DatabricksFastapiFlaskGCPPythonRest ApisSQL
What you need to know about the Kolkata Tech Scene
When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.
