Similar Jobs
Fitness • Retail • Hospitality
Design and implement data solutions on Azure, develop ETL pipelines, manage data governance, optimize performance, and automate processes with DevOps tools.
Top Skills:
SparkAzure Data FactoryAzure Data Lake StorageAzure DatabricksAzure DevopsAzure Synapse AnalyticsHadoopPlsqlPowershellPythonScalaSQL
Sharing Economy
The role involves designing and maintaining data infrastructure for integration, storage, processing, and analytics, focusing on Azure and Databricks. Responsibilities include coding, mentoring, and collaborating in an Agile environment to develop data solutions for the aviation industry.
Top Skills:
AzureAzure Data FactoryAzure Data LakeAzure Stream AnalyticsDatabricksDbtDelta LakeDelta Live TablesDelta SharingDevOpsKafkaMongoDBMySQLOraclePostgresPower BIPysparkPythonSQLSQL ServerSynapseUnity Catalog
Hardware • Semiconductor
Design and develop scalable applications on Azure, collaborating with teams to meet business needs while mentoring junior engineers and ensuring cloud security.
Top Skills:
Application InsightsArm TemplatesAzure App ServicesAzure FunctionsAzure Key VaultAzure Kubernetes ServiceAzure MonitorAzure SqlAzure StorageBicepCosmos DbDockerGoKubernetesMicroservices ArchitectureNode.jsNoSQLPythonRestful ApisSQLTerraform
ProArch is hiring a skilled Azure Data Engineer to join our team. As an Azure Data Engineer, you will be responsible for designing, implementing, and maintaining data processing systems using Azure technologies. Additionally, you will collaborate with cross-functional teams to understand business requirements, identify opportunities for data-driven improvements, and deliver high-quality solutions. If you have a strong background in Azure data tools and technologies, excellent problem-solving skills, and a passion for data engineering, we want to hear from you!
Responsibilities:
- Design, develop, and implement data engineering solutions on the Azure platform
- Create and maintain data pipelines and ETL processes
- Optimize data storage and retrieval for performance and scalability
- Collaborate with data scientists and analysts to build data models and enable data-driven insights
- Ensure data quality and integrity through data validation and cleansing
- Monitor and troubleshoot data pipelines and resolve any issues
- Stay up-to-date with the latest Azure data engineering best practices and technologies
- Excellent communication skills
- Strong experience in Python/Pyspark
- The ability to understand businesses concepts and work with customers to process data accurately.
- A solid of understanding Azure Data Lake, Spark for Synapse (or Azure Databricks), Synapse Pipelines (or Azure Data Factory), Mapping Data Flows, SQL Server, Synapse Serverless/Pools (or SQL Data Warehouse).
- Experience with source control, version control and moving data artifacts from Dev to Test to Prod.
- A proactive self-starter, who likes deliver value, solves challenges and make progress.
- Comfortable working in a team or as an individual contributor
- Good data modelling skills (e.g., relationships, entities, facts, and dimensions)
What you need to know about the Kolkata Tech Scene
When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.
