Bottomline Technologies Logo

Bottomline Technologies

Senior Data Engineer

Reposted 24 Days Ago
Be an Early Applicant
India
Senior level
India
Senior level
The Senior Data Engineer leads the design and development of data infrastructure, optimizes pipelines, mentors junior engineers, and ensures best practices in data management.
The summary above was generated by AI
Why Choose Bottomline?

Are you ready to transform the way businesses pay and get paid? Bottomline is a global leader in business payments and cash management, with over 35 years of experience and moving more than $16 trillion in payments annually. We're looking for passionate individuals to join our team and help drive impactful results for our customers. If you're dedicated to delighting customers and promoting growth and innovation - we want you on our team!

Senior Data Engineer 

General Information  

Description: The Senior Data Engineer is responsible for leading the design, development, and optimization of data infrastructure and systems to meet complex business needs. They play a strategic role in developing and managing large-scale data pipelines, ensuring scalability, reliability, and performance. As a key technical expert, the Senior Data Engineer collaborates with cross-functional teams to deliver innovative data solutions and ensures adherence to best practices in data management and governance. 

Responsibilities 

  • Leads the design and development of advanced data pipelines, ensuring seamless ETL/ELT of data into enterprise storage systems. 
  • Oversees data integration from diverse sources, maintaining data consistency, integrity, and compliance with enterprise standards. 
  • Transforms raw data into usable formats through cleansing, aggregation, filtering, and enrichment techniques. 
  • Optimizes data pipelines and workflows for scalability, performance, and cost efficiency. 
  • Establishes robust data validation, quality checks, and error-handling mechanisms to ensure enterprise data integrity. 
  • Mentors junior data engineers, promoting technical growth and team development. 
  • Implements and enforces best practices in data governance, including metadata management and lineage tracking. 
  • Drives the adoption of real-time data streaming and processing workflows to enable advanced analytics and decision-making. 
  • Partners with stakeholders to identify and address complex data challenges, delivering scalable and innovative solutions. 
  • Stays updated with emerging data technologies, evaluating their potential to enhance enterprise capabilities. 
  • Develops and enforces data security protocols to protect sensitive information. 

Job Requirements 

Education 

  • A bachelor’s degree in computer science, data science, software engineering, information systems, or related quantitative field; master’s degree preferred 

Experience 

  • 8+ years of data engineering experience, including expertise in data integration, pipeline optimization, and enterprise-scale data solutions. 
  • Proven leadership in implementing big data solutions (e.g., Snowflake, Databricks) and distributed data systems (e.g., Apache Spark, Flink). 

Skills 

  • Advanced proficiency in Apache technologies (Kafka, Airflow, Spark) and programming languages (Python, Java, Scala). 
  • Expertise in data query tools (SQL, Hive) and database technologies (NoSQL, Hadoop, Teradata). 
  • Strong knowledge of cloud platforms (AWS, Azure, GCP) and modern data architectures. 
  • Experience with real-time streaming data workflows and AI/ML analytics initiatives. 
  • Exceptional analytical and problem-solving skills with debugging expertise in complex systems. 
  • Excellent communication skills to effectively collaborate with technical and non-technical stakeholders. 
  • Strong leadership abilities to mentor teams and influence cross-functional initiatives. 

We welcome talent at all career stages and are dedicated to understanding and supporting additional needs. We're proud to be an equal opportunity employer, committed to creating an inclusive and open environment for everyone.

Top Skills

Apache Airflow
Apache Kafka
Spark
AWS
Azure
GCP
Hadoop
Hive
Java
NoSQL
Python
Scala
SQL
Teradata

Similar Jobs

2 Days Ago
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
Senior level
Senior level
Healthtech • Software • Analytics • Biotech • Pharmaceutical • Manufacturing
As a Senior Data Engineer, you will build and maintain data systems, collaborate with business functions, implement quality processes, and support digital product development.
Top Skills: Aws,Dms,Lambda,Databricks,Sqs,Step Functions,Data Streaming,Graphql,Sql,No-Sql,Python,Pyspark,Jira,Confluence,Git,Jenkins,Terrraform,Postgresql,Mongodb,Dynamodb
2 Days Ago
Easy Apply
Remote or Hybrid
Chennai, Tamil Nadu, IND
Easy Apply
Mid level
Mid level
Artificial Intelligence • Big Data • Logistics • Machine Learning • Software • Transportation
The Senior Data Engineer will architect and develop data pipelines, ensuring optimal data extraction and transformation for the data warehouse platform, with a focus on scalability and maintainability.
Top Skills: AWSAzureBig DataCassandraHadoopJavaKafkaPostgresPythonSparkSpark-StreamingSQLStorm
4 Days Ago
Remote or Hybrid
India
Mid level
Mid level
Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
The Senior Data Engineer will develop AI applications using LLMs, manage data pipelines, and collaborate with data scientists to enhance productivity and insights.
Top Skills: BigQueryGeminiGoogle Cloud Platform (Gcp)Hugging FaceLangchainPythonPyTorchTensorFlowVertex Ai

What you need to know about the Kolkata Tech Scene

When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account