The Senior Data Engineer will design and optimize data infrastructures and pipelines to support analytics, ensuring data integrity and quality.
BlackStone eIT is on the lookout for a Senior Data Engineer to join our innovative team. In this role, you will be responsible for the design, development, and optimization of our data infrastructure. You'll play a crucial part in supporting data analytics initiatives across the organization by ensuring we have robust and scalable data pipelines in place.
The ideal candidate is not only an exceptional data engineer but also a problem-solver with a keen ability to analyze complex data sets and translate findings into actionable insights. This position requires a strong background in database systems, data modeling, and ETL processes.
Key Responsibilities
- Design, implement, and maintain scalable data architectures and pipelines.
- Develop ETL processes to facilitate smooth data transfer and transformation from various sources.
- Collaborate with data scientists and analysts to fulfill data needs for analytics and reporting.
- Optimize database performance and maintain data integrity across systems.
- Conduct data quality checks and resolve discrepancies.
- Mentor junior data engineers and provide technical guidance.
- Stay current with emerging technologies and best practices in data engineering.
- Bachelor’s degree in Computer Science, Engineering, or a related field.
- 5+ years of experience in data engineering or a similar role.
- Proficiency in SQL and experience with relational databases.
- Hands-on experience with data pipeline tools and ETL processes.
- Familiarity with big data technologies (e.g., Hadoop, Spark) is a plus.
- Strong analytical and problem-solving skills.
- Excellent communication and teamwork abilities.
- Experience with cloud-based data solutions is an advantage.
- Remote Model
- Time Flexibility
- Relocation after 6months based on performance
Top Skills
ETL
Hadoop
Spark
SQL
Similar Jobs
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
As a Senior Data Engineer, you'll build and maintain data pipelines, work on data lakes, and enhance self-service capabilities while transforming vague requirements into actionable solutions.
Top Skills:
AirflowAWSEmrHiveJavaKinesisPythonRdsS3ScalaSparkSQLSqs
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
As a Senior Data Engineer at Atlassian, you'll build and optimize data pipelines and micro-services, working with AWS-based data lakes and enhancing data accessibility for stakeholders while ensuring data quality.
Top Skills:
AirflowAWSDatabricksEmrHiveJavaKinesisPythonRdsS3ScalaSparkSQLSqs
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Join the GTM-DE team to build data lakes and optimize data pipelines, enabling efficient data ingestion and effective use of streaming technologies.
Top Skills:
AirflowAWSEmrHiveJavaKinesisPythonRdsS3ScalaSparkSQLSqs
What you need to know about the Kolkata Tech Scene
When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.