Design and optimize data infrastructure and pipelines, develop ETL processes, and provide mentorship to junior engineers while collaborating with data analysts.
BlackStone eIT is on the lookout for a Senior Data Engineer to join our innovative team. In this role, you will be responsible for the design, development, and optimization of our data infrastructure. You'll play a crucial part in supporting data analytics initiatives across the organization by ensuring we have robust and scalable data pipelines in place.
The ideal candidate is not only an exceptional data engineer but also a problem-solver with a keen ability to analyze complex data sets and translate findings into actionable insights. This position requires a strong background in database systems, data modeling, and ETL processes.
Key Responsibilities
- Design, implement, and maintain scalable data architectures and pipelines.
- Develop ETL processes to facilitate smooth data transfer and transformation from various sources.
- Collaborate with data scientists and analysts to fulfill data needs for analytics and reporting.
- Optimize database performance and maintain data integrity across systems.
- Conduct data quality checks and resolve discrepancies.
- Mentor junior data engineers and provide technical guidance.
- Stay current with emerging technologies and best practices in data engineering.
- Bachelor’s degree in Computer Science, Engineering, or a related field.
- 5+ years of experience in data engineering or a similar role.
- Proficiency in SQL and experience with relational databases.
- Hands-on experience with data pipeline tools and ETL processes.
- Familiarity with big data technologies (e.g., Hadoop, Spark) is a plus.
- Strong analytical and problem-solving skills.
- Excellent communication and teamwork abilities.
- Experience with cloud-based data solutions is an advantage.
- Remote Model
- Time Flexibility
- Relocation after 6months based on performance
Top Skills
ETL
Hadoop
Spark
SQL
Similar Jobs
Artificial Intelligence • Big Data • Logistics • Machine Learning • Software • Transportation
The Senior Data Engineer will architect and develop data pipelines, ensuring optimal data extraction and transformation for the data warehouse platform, with a focus on scalability and maintainability.
Top Skills:
AWSAzureBig DataCassandraHadoopJavaKafkaPostgresPythonSparkSpark-StreamingSQLStorm
Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
The Senior Data Engineer will develop AI applications using LLMs, manage data pipelines, and collaborate with data scientists to enhance productivity and insights.
Top Skills:
BigQueryGeminiGoogle Cloud Platform (Gcp)Hugging FaceLangchainPythonPyTorchTensorFlowVertex Ai
Information Technology • Internet of Things • Marketing Tech
Seeking a skilled Senior Data Engineer to design and maintain data infrastructure, develop backend systems for real-time processing, and collaborate with teams to ensure data reliability and performance.
Top Skills:
AirflowSparkAWSDbtDockerEsFirestoreFlinkGCPGitJavaJavaScriptJenkinsKafkaKubernetesMongoDBMySQLNode.jsPostgresPythonScalaSnowflakeSQLSupersetTableauTerraformTypescript
What you need to know about the Kolkata Tech Scene
When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.
