As a Senior Software Engineer, you will design and develop scalable data pipelines and solutions, mentor junior engineers, and ensure data integrity across various platforms.
Elevate your expertise to new heights at 3Pillar, the premier destination for trailblazing senior software engineers like yourself. Picture collaborating with industry leaders, spearheading transformative projects that redefine urban living, establishing new media channels for enterprise companies, or driving innovation in healthcare. Our mission is to revolutionize the tech landscape, and your skills are integral to achieving this ambitious goal.
Your role extends beyond the realm of code composition; you will architect transformative solutions that reshape entire industries. Join us and spearhead the charge toward a tech future that transcends the ordinary.
Key Responsibilities:
Understanding the business requirements and implementing the technical solution
Design, development, and maintenance of scalable data pipelines using Java and big data technologies
Creating data pipelines, versioning, and change management
Managing the complexity inherent in versioned data pipelines
Working with relational (SQL) and NoSQL databases, ensuring data integrity and performance
Development, maintenance, and troubleshooting of ETL/ELT processes for efficient data ingestion, transformation, and storage.
Automating and optimizing data workflows such as data ingestion, aggregation, and ETL processing
Designing, building, and maintaining batch or real-time data pipelines in production
Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures
Writing secure and scalable data exposing APIs for data consumers Training and mentoring of junior engineers
Executing complex activities within the current methodology and quality standards, showcasing success across diverse engagements
Promoting client success across the team by collaborating with engineers, designers, and managers to understand user pain points, anticipate potential problems, and iterate on solutions that drive client success
Minimum Qualifications:
- Demonstrated expertise with a minimum of 5+ years of experience as a software engineer
- Proficiency in Java 8+ and frameworks like Spring Boot with exposure to Kafka, Spark
- Proficient in data pipeline and workflow management tools like Airflow
- Advanced SQL skills and experience with relational and NoSQL databases like MySQL, and MongoDB
- Exposure to working on Data Lakes & Data Warehouses solutions
- Excellent problem-solving, communication, and organizational skills
- Proven ability to work independently and with a team.
- Nice to have:
- Prior experience working with IOT devices would be an advantage
- Experience with Big Data technologies like Map Reduce, Hadoop, Hive, etc.
- Experience with data visualization tools like PowerBI, Tableau, AWS QuickSight, etc.
- Experience with any public cloud (AWS/Azure/GCP)
At 3Pillar, we offer a world of opportunity:
Imagine a flexible work environment – whether it's the office, your home, or a blend of both.
From interviews to onboarding, we embody a remote-first approach.
You will be part of a global team, learning from top talent around the world and across cultures, speaking English everyday.
Our global workforce enables our team to leverage global resources to accomplish our work in efficient and effective teams.
We’re big on your well-being – as a company, we spend a whole trimester in our annual cycle focused on wellbeing.
Whether it is taking advantage of fitness offerings, mental health plans (country-dependent), or simply leveraging generous time off, we want all of our team members operating at their best.
Our professional services model enables us to accelerate career growth and development opportunities - across projects, offerings, and industries.
We are an equal opportunity employer.
It goes without saying that we live by values like Intrinsic Dignity and Open Collaboration to create cutting-edge technology AND reinforce our commitment to diversity - globally and locally. Join us and be a part of a global tech community!
Check out our Linkedin site and Careers page to learn more about what it’s like to be part of our #oneteam!
Top Skills
Airflow
Java
Kafka
MongoDB
MySQL
Spark
Spring Boot
Similar Jobs
Automotive
This role involves designing interfaces, developing data products, and supporting digital transformations using various programming and database technologies.
Top Skills:
BitbucketCi/CdCSSDockerHibernateHTMLJ2EeJavaJavaScriptJenkinsJIRAJqueryJspKubernetesMs Sql ServerMySQLOracleQuality CenterRestful ApisSpringSpring BootStrutsXML
Other • Analytics • Business Intelligence
The Senior Software Engineer will build and maintain web applications using the Microsoft technology stack, collaborating on enterprise systems and ensuring coding standards.
Top Skills:
AngularArmAsp.Net MvcAzure OpenaiAzure ServicesBicepCoreDevOpsElastic SearchEntity FrameworkFastapiFlaskGitHelm ChartsJasmineJestKubernetesMicrosoft .NetMicrosoft Sql ServerMstestNoSQLNunitPythonRagReactTerraformVisual StudioWebapi
Other • Analytics • Business Intelligence
The Platform Technical Architect will lead architecture and solution development, establish DevOps solutions, research new technologies, and provide technical guidance to teams while ensuring high-quality standards and successful delivery of technology solutions.
Top Skills:
Api ManagementAzureAzure DevopsCorsDevOpsDevsecopsGraphQLHelmKedaKubernetesOauthOidcRestSAMLTls
What you need to know about the Kolkata Tech Scene
When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.
