WEX Inc. Logo

WEX Inc.

Senior Staff, Data Lake Engineering

Posted 18 Days Ago
Be an Early Applicant
Remote
Hiring Remotely in India
Expert/Leader
Remote
Hiring Remotely in India
Expert/Leader
Lead the development of the Data Lake platform, guiding teams in leveraging data and AI, ensuring security, and managing project roadmaps. Mentor engineering teams and drive continuous improvement with a focus on quality results and strategic business solutions.
The summary above was generated by AI

About the Team/Role

Lead and drive the development of technology and platform for the company's Data Lake needs, ensure the functional richness, reliability, performance, and flexibility of the Data Lake Platform. Help design the architecture and lead the implementation of the Data Lake platform and services. Challenge the status quo and hold a high bar to drive for better and better technical solutions to effectively serve all the needs in the broad risk area of Wex. 

How you’ll make an impact

  • Guide your team to leverage data and/or AI technology or tools in your design and development for high productivity and better solution quality. Show strong thought leadership and influence your peers in this area.

  • Closely partner with the other senior engineers across the organizations at Wex to deeply understand the business needs and jointly come up with technical solutions to serve these needs effectively. Demonstrate strong thought leadership and partnership.

  • Partner closely with information security teams to ensure the security and privacy of data, implementing encryption and access controls as required.

  • Partner with solutions architecture and LOB product and engineering orgs on integrations of the Data Lake Platform with their products/systems, and ensure reliable and performed execution.

  • Engage with external partners and vendors to evaluate technologies and services that complement the company’s Data Lake strategy.

  • Create, prioritize, communicate, manage, and execute roadmaps, project plans, and commitments.

  • Report on the status of development, quality, operations, and system performance to management and partners.

  • Drive the technical vision and strategy of Data Lake to serve the business needs for the near term and long term. A close partnership with the Data Engineering teams and the operational reporting teams of applications 

  • Set a high bar, and provide technical guidance and effective training & mentorship to the engineering teams in your group, including engineering principles, skills, and best practices. Uphold strong DORA metrics across the org. Foster an environment of continuous learning and innovation. Build an inclusive, productive, innovative, and engaging Risk group, including attracting high talents from the industry.

  • Set clear, measurable quality goals for your group in a data-driven way.

  • Partner with the security org and SRE org to ensure continuous improvement and meeting of security requirements, SLOs, and error budget.

  • Take strong financial responsibility for your team.

  • Hold yourself and your team accountable for delivering quality results using defined OKRs.

  • Advise Senior Leadership team on highly complex situations that impact our organization and then lead teams through the initiative, driving excellent quality results and achieving defined OKRs across the organization.

  • Provide strategic thought leadership on business initiatives using your deep technical and business industry expertise.

Experience you’ll bring

  • A technically deep and innovative Software Engineer leader able to act and deliver to the business needs.

  • Have 10+ years of software design and development experience at a large scale.

  • Strong software development skills in his or her chosen programming language, but ready and willing to learn and program in Java and Python.

  • Broad understanding of Data Lakehouse formats like Apache Hudi, Apache Iceberg or Delta Lake is a big plus.

  • Demonstrable experience in Spark programming.

  • Experience with Spark on DBT with AWS Glue or Apache Polaris is a plus.

  • Broad understanding of cloud architecture tools and services, such as S3, EMR, Kubernetes, Lambda functions. Experience in AWS and Azure is highly desirable.

  • Deep technically; hands-on in architecture design, development, deployment, and production operation; familiar with agile software development and modern development tools and frameworks; holding strong engineering principles including automation and quality as well as best practices with a high bar. Extensive experience in full software development life cycle E2E including in production monitoring.

  • Rich experience and deep expertise in the areas of Big Data and large scale data platforms, especially in Data Lake.

  • Highly experienced and deep understanding of CI/CD automation.

  • Rich experience in combined engineering practice and agile development. Experienced in leading and guiding teams for effective development using this approach.

  • Excellent analytical skills; Capability in identifying and resolving complex problems.

  • An understanding of and experience in payment organizations is a plus. 

  • A mentor to individual contributors of different seniority levels and expertise.

  • Ability to encourage and foster a culture of visibility and transparency across teams.

  • Strong written and verbal communication skills.

  • Strong philosophy of continuous improvement.

  • Bachelor degree in Computer Science or a related field. A higher degree in a related field is a plus.

Top Skills

Apache Hudi
Apache Iceberg
Apache Polaris
Aws Glue
Ci/Cd
Delta Lake
Emr
Java
Kubernetes
Lambda Functions
Python
S3
Spark

Similar Jobs

2 Hours Ago
Remote
Hybrid
RJ, IND
Senior level
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
The Sr. QA Analyst will execute QA processes for high-quality software, utilizing QA automation and SDLC expertise, ensuring applications meet business requirements.
Top Skills: Adobe Experience CloudCucumberCypressJavaJIRAPercySelenium
4 Hours Ago
Remote
India
Mid level
Mid level
Agency • Digital Media • eCommerce • Professional Services • Software • Analytics • Consulting
As a Cloud Engineer, you will build and maintain cloud infrastructure, automate processes, ensure security, and support development teams with CI/CD and release management.
Top Skills: AWSAws LambdaCi/CdCloudfrontCloudwatchDockerEc2EcsEksIaasIamKubernetesNew RelicNoSQLRdsRoute53S3SnsSQLSslTerraformVpcWaf
11 Hours Ago
Remote
India
Senior level
Senior level
Agency • Digital Media • eCommerce • Professional Services • Software • Analytics • Consulting
As a Senior Frontend Developer, you'll lead the development of scalable frontend solutions, integrate components, optimize performance, and troubleshoot issues while collaborating with teams to enhance user experience.
Top Skills: AngularEmber)GitGraphQLGulpJs Frameworks (ReactNextjsNosql DatabasesRelational DatabasesRestful ApisVuejsWebpack

What you need to know about the Kolkata Tech Scene

When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account