Design, develop and maintain Big Data solutions, build data pipelines, collaborate on data modeling, and ensure data integrity.
We are seeking a dedicated and experienced Software Developer to join our Mumbai team. The ideal candidate is energised by working in a cutting-edge environment that enables IMC to continue to be at the forefront of the evolving global financial markets.
Core Responsibilities
Skills and Experience
Core Responsibilities
- Architect, develop and deploy our Big Data environment (Kafka, Hadoop, Dremio, etc.)
- Build, deploy, and monitor our data processing pipelines (Java, Python, Spark, Flink)
- Collaborate with development teams on data modeling, data ingestion, and capacity planning
- Work with users to ensure data integrity and availability
- Act as a Big Data SME and consult on a variety of data-related questions from users and developers
Skills and Experience
- 5+ years' experience working in a mature data engineering environment
- 3+ years of experience building Kafka streaming applications and/or maintaining Kafka clusters
- 2+ years of experience building applications/pipelines with Big Data backends (S3, HDFS, Databricks, Iceberg, etc)
- Experience with Apache Spark, Apache Flink or similar tools
- Strong Java, Python, and SQL development skills
- Experience with common data-science toolkits, especially python-based
- Hands-on experience with Kubernetes and Docker
- Experience with monitoring tools such as Prometheus/Grafana, Alert Manager, Alerta and OpsGenie
- Strong statistical analysis skills
- Demonstrated ability to troubleshoot and conduct root-cause analysis
- Unix scripting experience (bash, python, etc.)
Top Skills
Alert Manager
Alerta
Databricks
Docker
Dremio
Flink
Grafana
Hadoop
Hdfs
Iceberg
Java
Kafka
Kubernetes
Opsgenie
Prometheus
Python
S3
Spark
SQL
Similar Jobs at IMC Trading
.png){kind=avatar}
Fintech • Machine Learning • Software • Financial Services
The Commercial Legal Counsel will draft, review, and negotiate contracts, provide legal advice across departments, and support general in-house legal matters.
Top Skills:
Commercial ContractingLegal Analysis
Fintech • Machine Learning • Software • Financial Services
Responsible for managing and improving data access and processing systems, collaborating with engineers and traders, and implementing automation in a data platform.
Top Skills:
AirflowAWSAzureCassandraDockerDremioGCPGitHdfsHelmKafkaKubernetesLinuxPrefectScyllaSpark
Fintech • Machine Learning • Software • Financial Services
The Linux Engineer will manage and improve large-scale Linux systems, focusing on automation, troubleshooting, and collaborating with teams to enhance server performance and reliability.
Top Skills:
AnsibleBashCi/CdDockerGitGrafanaHieraKubernetesLinuxPrometheusPuppetPython
What you need to know about the Kolkata Tech Scene
When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.
