As a Data Engineer, you'll design and build ELT jobs, manage data quality, document system flows, and implement data pipelines for business needs.
Key Responsibilities and accountabilities
- Design, build, and measure complex ELT jobs to process disparate data sources and form a high integrity, high quality, clean data asset.
- Working on a range of projects including batch pipelines, data modeling, and data mart solutions you'll be part of collaborative project teams working to implement robust data collection and processing pipelines to meet specific business need.
Goals
- Design, build, and measure complex ELT jobs to process disparate data sources and form a high integrity, high quality, clean data asset.
- Executes and provides feedback for data modeling policies, procedure, processes, and standards.
- Assists with capturing and documenting system flow and other pertinent technical information about data, database design, and systems.
- Develop data quality standards and tools for ensuring accuracy.
- Work across departments to understand new data patterns.
- Translate high-level business requirements into technical specs.
Required:
- Bachelor's degree in computer science or engineering.
- 3+ years of experience with data analytics, data modeling, and database design.
- 3+ years of coding and scripting (Python, Java, Pyspark) and design experience.
- Experience with ETL methodologies and tools.
- Experience with Vertica
- Expertise in tuning and troubleshooting SQL.
- Strong data integrity, analytical and multitasking skills.
- Excellent communication, problem solving, organizational and analytical skills.
- Able to work independently.
Additional / preferred skills:
- Familiar with agile project delivery process.
- Experience with Airflow.
- Ability to manage diverse projects impacting multiple roles and processes.
- Able to troubleshoot problem areas and identify data gaps and issues.
- Ability to adapt to fast changing environment.
- Experience with Python.
- Basic knowledge of database technologies (Vertica, Redshift, etc.).
- Experience designing and implementing automated ETL processes.
Top Skills
Airflow
ETL
Java
Pyspark
Python
Redshift
SQL
Vertica
Similar Jobs at MassMutual India
Big Data • Fintech • Information Technology • Insurance • Financial Services
The Senior Associate will design and develop Power BI reports, implement security, collaborate with stakeholders, guide BI developers, optimize SQL queries, and ensure adherence to Agile practices.
Top Skills:
AgileDaxJIRAPower BISQL
Big Data • Fintech • Information Technology • Insurance • Financial Services
The Analyst QA will develop test strategies for ETL processes, create test cases, validate data accuracy, and automate tests. Collaboration with business and development teams is required.
Top Skills:
Aws RedshiftDatastageGoogle BigqueryInformaticaOraclePostgresPower BIPythonSeleniumSnowflakeSQLSQL ServerSsisTableauTalendVertica
Big Data • Fintech • Information Technology • Insurance • Financial Services
As an Associate Data Engineer, you'll work with data warehousing, SQL, and Python to support data workflows, utilizing Airflow for orchestration.
Top Skills:
AirflowDwhPythonSQL
What you need to know about the Kolkata Tech Scene
When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.
