The Senior AWS Data Engineer will design and implement data solutions using AWS, ensuring data quality and providing technical leadership.
Job Description
Job Title: Senior AWS Data Engineer
About the Role:
We are seeking an experienced and highly skilled Senior AWS Data Engineer with over 10 years of experience to join our dynamic team. The ideal candidate will have a deep understanding of data engineering principles, extensive experience with AWS services, and a proven track record of designing and implementing scalable data solutions.
Key Responsibilities:
Required Skills and Qualifications:
Job Title: Senior AWS Data Engineer
About the Role:
We are seeking an experienced and highly skilled Senior AWS Data Engineer with over 10 years of experience to join our dynamic team. The ideal candidate will have a deep understanding of data engineering principles, extensive experience with AWS services, and a proven track record of designing and implementing scalable data solutions.
Key Responsibilities:
- Design and implement robust, scalable, and efficient data pipelines and architectures on AWS.
- Develop data models and schemas to support business intelligence and analytics requirements.
- Utilize AWS services such as S3, Redshift, EMR, Glue, Lambda, and Kinesis to build and optimize data solutions.
- Implement data security and compliance measures using AWS IAM, KMS, and other security services.
- Design and develop ETL processes to ingest, transform, and load data from various sources into data warehouses and lakes.
- Ensure data quality and integrity through validation, cleansing, and transformation processes.
- Optimize data storage and retrieval performance through indexing, partitioning, and other techniques.
- Monitor and troubleshoot data pipelines to ensure high availability and reliability.
- Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver solutions.
- Provide technical leadership and mentorship to junior data engineers and team members.
- Identify opportunities to automate and streamline data processes for increased efficiency.
- Participate in on-call rotations to provide 24/7 support for critical systems and services.
Required Skills and Qualifications:
- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
- Over 10 years of experience in data engineering, with a strong focus on AWS services.
- Proficiency in programming languages such as Python, Java, or Scala.
- Extensive experience with SQL and NoSQL databases.
- Strong understanding of data warehousing concepts and technologies.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills.
Top Skills
AWS
Emr
Glue
Java
Kinesis
Lambda
NoSQL
Python
Redshift
S3
Scala
SQL
Similar Jobs at JPMorganChase
Financial Services
As a LEC Analyst, you will oversee financial control and reporting for legal entities, manage accounting processes, and ensure financial accuracy.
Top Skills:
Excel
Financial Services
As a Principal Solution Architect, you will lead architecture initiatives, develop technology roadmaps, and create robust coding frameworks to enhance cloud-based solutions.
Top Skills:
Artificial IntelligenceCloudMachine Learning
Financial Services
As a Software Engineer III, you'll design, develop, and troubleshoot software components, with a focus on data engineering using Ab Initio and Python, while working in an agile environment.
Top Skills:
Ab InitioAirflowAWSCloud SqlControl MDockerJenkinsKubernetesOraclePl/SqlPysparkPythonSQL
What you need to know about the Kolkata Tech Scene
When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.