The Senior Lead Software Engineer will manage Databricks platform, drive migrations, optimize infrastructure, and mentor teams to enhance technology products.
Job Description
Be an integral part of an agile team that's constantly pushing the envelope to enhance, build, and deliver top-notch technology products.
As a Senior Lead Software Engineer at JPMorgan Chase within the Consumer & Community Banking Risk Team, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. Drive significant business impact through your capabilities and contributions, and apply deep technical expertise and problem-solving methodologies to tackle a diverse array of challenges that span multiple technologies and applications.
Job responsibilities
Required qualifications, capabilities, and skills
Preferred qualifications, capabilities, and skills
Be an integral part of an agile team that's constantly pushing the envelope to enhance, build, and deliver top-notch technology products.
As a Senior Lead Software Engineer at JPMorgan Chase within the Consumer & Community Banking Risk Team, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. Drive significant business impact through your capabilities and contributions, and apply deep technical expertise and problem-solving methodologies to tackle a diverse array of challenges that span multiple technologies and applications.
Job responsibilities
- Plan and deliver SAS-to-PySpark migrations on Databricks (cutover, validation, rollback).
- Build and maintain automated conversion utilities and CI/CD pipelines.
- Own data conversion and migration (schema mapping, quality checks, reconciliation, lineage).
- Run office hours for user communities, coach engineers, and drive best practices and standards.
- Optimize Databricks infrastructure (clusters, policies, performance, and cost).
Required qualifications, capabilities, and skills
- Formal training or certification on software engineering concepts and 5+ years applied experience. In addition, 2 + years of experience leading technologists to manage and solve complex technical items within your domain of expertise
- Hands On experience in data/analytics engineering; 5+ years leading large-scale Pyspark/Databricks programs.
- Proven SAS-to-PySpark migration delivery into production with measurable outcomes.
- Track record in data migration, quality assurance, and operational readiness
Preferred qualifications, capabilities, and skills
- Deep PySpark expertise (performance tuning, ETL functionality).
- Databricks platform proficiency (Unity Catalog, SQL Warehouses, job/cluster policies, MLflow basics).
- Automation and CI/CD (build/deploy pipelines, release management).
- Cloud fundamentals (AWS S3, IAM, networking, monitoring)
Top Skills
Aws S3
Ci/Cd
Databricks
Iam
Pyspark
SAS
Similar Jobs at JPMorganChase
Financial Services
The role involves designing and delivering secure technology products, developing scalable software solutions, analyzing large datasets, and contributing to team culture.
Top Skills:
AWSC++CassandraDockerGCPJavaKafkaKubernetesMs AzurePythonScala
Financial Services
The Applied AI ML Lead develops and maintains machine learning pipelines and infrastructure, collaborates with teams to ensure compliance, and enhances operational excellence.
Top Skills:
AirflowDockerEc2EcsEmrJavaKubeflowKubernetesPythonRaySagemakerSparkVertex Ai
Financial Services
As a Manager of Software Engineering, you will lead tech teams, define technology strategies, and ensure the delivery of quality solutions while coaching engineers.
Top Skills:
AWSCassandraFlinkJavaKafkaMongoDBSparkSpringSpring Boot
What you need to know about the Kolkata Tech Scene
When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.
