Nacre Capital Logo

Nacre Capital

Data Engineer

Sorry, this job was removed at 05:46 p.m. (IST) on Wednesday, Feb 19, 2025
5 Locations
5 Locations

Description

Data Engineer

About Us

Aquaticode builds artificial intelligence solutions for aquaculture. Our core competency lies at the intersection of biology and artificial intelligence, utilizing specialized imaging technology to detect, identify, and predict traits of aquatic species. We value commitment and creativity in building real-world solutions that benefit humanity.

Position Overview

We are seeking a talented Data Engineer with experience in supporting Machine Learning (ML) research to join our team. The ideal candidate will have a strong background in building robust data pipelines and workflows that facilitate ML projects and eagerness to learn new technologies. This role requires proficiency in data processing technologies and an understanding of the data needs specific to ML research.

Key Responsibilities

· Develop, maintain, and optimize data pipelines and workflows to support ML research and model development.

· Design and implement scalable data architectures for handling large datasets used in ML models.

· Collaborate closely with ML researchers and data scientists to understand data requirements and ensure data availability and quality.

· Work with databases and data integration processes to prepare and transform data for ML experiments.

· Utilize MongoDB and other NoSQL databases to manage unstructured and semi- structured data.

· Write efficient, reliable, and maintainable code in Python and SQL for data processing tasks.

· Implement data validation and monitoring systems to ensure data integrity and performance.

· Support the deployment of ML models by integrating data solutions into production environments.

· Ensure the scalability and performance of data systems through rigorous testing and optimization.

Required Skills & Qualifications

· Proficiency in English (spoken and written).

· Strong experience in Python and SQL.

· Hands-on experience with data processing in Apache Airflow.

· Experience working with databases, including MongoDB (NoSQL) and relational databases.

· Understanding of data modeling, ETL processes, and data warehousing concepts.

· Experience with cloud platforms like AWS, GCP, or Azure.

Good to Have

· Experience with other NoSQL databases like InfluxDB, Elasticsearch, or similar technologies.

· Experience with backend frameworks like FastAPI, Flask, or Django.

· Knowledge of containerization tools like Docker.

· Familiarity with messaging queues like RabbitMQ.

· Understanding of DevOps practices and experience with CI/CD pipelines.

· Experience with front-end development (e.g., React, NextJs).

About Nacre Capital

We were founded by Nacre Capital, a venture builder focused on AI within the life

sciences. Nacre has an impressive track record in creating, building, and growing deep

tech startups, including Face.com (acquired by Facebook), Fairtility, FDNA, and Seed-X.

Similar Jobs

Yesterday
Remote
Hybrid
Bengaluru, Karnataka, IND
Junior
Junior
Cloud • Fintech • Information Technology • Machine Learning • Software • App development • Generative AI
As a Data Engineer, you will maintain and optimize database systems, ensuring their performance and security while collaborating with teams to implement new features and resolve issues. You will analyze system integrity and lead database development adhering to policies and deadlines throughout the software development lifecycle.
2 Days Ago
Easy Apply
Hybrid
Pune, Maharashtra, IND
Easy Apply
Junior
Junior
Healthtech • Information Technology • Software • Telehealth
As a Data Engineer on the Data Pipeline Team, you will design, build, and optimize data pipelines for seamless data ingestion, transformation, and delivery. Your role involves collaborating with teams to ensure data quality and manage workflows for regulatory compliance. Responsibilities include optimizing ETL/ELT processes and maintaining data integrity across diverse sources.
Top Skills: AirflowAWSDagsterDbtFivetranPysparkPythonSnowflakeSQLStitch
2 Days Ago
Hyderabad, Telangana, IND
Mid level
Mid level
Big Data • Fintech • Information Technology • Insurance • Financial Services
The Data Engineer - Associate will design and build complex ELT jobs, create data quality standards, and implement data pipelines to process disparate data sources. Responsibilities include data modeling, troubleshooting SQL, and collaborating across departments to meet business needs.
Top Skills: AirflowETLJavaPysparkPythonSQLVertica

What you need to know about the Kolkata Tech Scene

When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account