mindcurv group Logo

mindcurv group

Data Engineer ( Databricks Specialist)

Reposted 6 Days Ago
Be an Early Applicant
In-Office
Trivandrum, Thiruvananthapuram, Kerala
Senior level
In-Office
Trivandrum, Thiruvananthapuram, Kerala
Senior level
Design and maintain data pipelines, manage cloud data warehousing solutions, optimize for performance, and lead junior engineers while ensuring data governance practices.
The summary above was generated by AI



About Mindcurv (Part of Accenture Song)

We help our customers rethink their digital business, experiences, and technology to navigate the new digital reality. We do this by designing sustainable and accountable solutions for humans living in a digital world. Mindcurv holistically covers the market’s need to digitalise business processes and customer experiences and take advantage of the cloud following DevOps and agile principles.

 

Your role

We are seeking a highly skilled and experienced Senior Data Engineer to join our growing Data and Analytics team. The ideal candidate will have deep expertise in Databricks and cloud data warehousing, with a proven track record of designing and building scalable data pipelines, optimizing data architectures, and enabling robust analytics capabilities. This role involves working collaboratively with cross-functional teams to ensure the organization leverages data as a strategic asset. Your responsibilities will include:

  • Design, build, and maintain scalable data pipelines and ETL processes using Databricks and other modern tools.
  • Architect, implement, and manage cloud-based data warehousing solutions on Databricks (Lakehouse Architecture)
  • Develop and maintain optimized data lake architectures to support advanced analytics and machine learning use cases.
  • Collaborate with stakeholders to gather requirements, design solutions, and ensure high-quality data delivery.
  • Optimize data pipelines for performance and cost efficiency.
  • Implement and enforce best practices for data governance, access control, security, and compliance in the cloud.
  • Monitor and troubleshoot data pipelines to ensure reliability and accuracy.
  • Lead and mentor junior engineers, fostering a culture of continuous learning and innovation.
  • Excellent communication skills
  • Ability to work independently and along with client based out of western Europe.

Who you are 

  • Bachelor’s or Master’s degree in Computer Science or a related field.
  • 5 years of experience in data engineering roles with a focus on cloud platforms.
  • Proficiency in Databricks, including Spark-based ETL, Delta Lake, and SQL.
  • Strong experience with one or more cloud platforms (AWS preferred).
  • Handson Experience with Delta lake, Unity Catalog, and Lakehouse architecture concepts.
  • Strong programming skills in Python and SQL; experience with Pyspark a plus.
  • Solid understanding of data modeling concepts and practices (e.g., star schema, dimensional modeling).
  • Knowledge of CI/CD practices and version control systems (e.g., Git).
  • Familiarity with data governance and security practices, including GDPR and CCPA compliance.

Nice-to-Have Qualifications

  • Experience with Airflow or similar workflow orchestration tools.
  • Exposure to machine learning workflows and MLOps.
  • Certification in Databricks, AWS
  • Familiarity with data visualization tools such as Power BI

 

 What do we offer you?

Perks, like drinks and snacks, pizza sessions, gaming nights and sensational parties, a pension scheme and a great salary, we’ve got them all.

And if you crave an intellectual challenge, Mindcurv has you covered. Interesting projects involving the latest, hyper innovative tech. An agile, entrepreneurial environment, with lots of freedom and no politics. Work-life balance, a culture of transparency and a management team with their ears to the ground.

We typically are the trailblazers and innovators. A hybrid way of working in which you can work from home. You just come into one of our offices in Essen, Cologne, Düsseldorf, Munich, Frankfurt a.M., Hamburg, Jena, Utrecht, Madrid, Cochin, Coimbatore or Trivandrum when it adds value to be on-site. Looking for a glance behind the scenes?


Our high performers

You know who really thrive with us? Self-starters, team-players and continuous learners, with an uncanny ability to handle ambiguity. We’ll equip you with everything you need to succeed, help you explore the length and breadth of your domain and provide you with constant growth opportunities, to enrich your career.

Ready for change?

Are you ready for the next step in your career? For a role in which you can be fully yourself and bring out the best? In yourself, your colleagues and your clients? Don’t wait any longer and apply for this job right now.

Top Skills

Airflow
AWS
Databricks
Delta Lake
Power BI
Python
Spark
SQL

Similar Jobs

2 Days Ago
Remote or Hybrid
16 Locations
Senior level
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
As a Senior Software Engineer, you will develop software for file format parsing, collaborate on machine learning features, and maintain systems while ensuring quality and optimization.
Top Skills: AWSAzureBitbucketC++GCPGitJenkinsJIRALinuxmacOSPythonRustWindows
2 Days Ago
Remote or Hybrid
16 Locations
Senior level
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
As a Senior SDET, you'll develop test strategies, automate tests, validate features, and optimize CI/CD pipelines while collaborating with data science teams.
Top Skills: AWSAzureBitbucketC++DockerGCPGitJenkinsPythonRust
2 Days Ago
Remote or Hybrid
16 Locations
Senior level
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Lead the Data Engineering team to develop tools, services, and pipelines for data scientists and analysts, while managing a distributed team and collaborating with cross-functional partners.
Top Skills: AWSCassandraCi/CdGoKafkaPython

What you need to know about the Kolkata Tech Scene

When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account