Design and implement data pipelines, optimize processing and storage, ensure data accuracy and performance, provide technical support, and collaborate with data scientists, analysts, and stakeholders to resolve data issues and meet data requirements.
Data Engineers design and build data systems and pipelines. Responsibilities include developing data processing workflows, optimizing data storage, and ensuring data accuracy. You will collaborate with data scientists and analysts to meet data requirements and resolve data issues. Strong experience in data engineering and problem-solving skills are required.
ResponsibilitiesDesign and implement data pipelines, Optimize data processing and storage, Ensure data solutions meet performance standards, Provide technical support, Collaborate with stakeholders.
QualificationsBachelor's/Master's in Engineering 5-8 years
Similar Jobs
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Design and build data services and pipelines supporting machine learning products. Develop automation tools for model deployment, maintain production data systems, improve infrastructure, participate in code reviews, and collaborate across engineering, data science, and product teams. The role requires expertise in distributed systems, large-scale data processing, CI/CD, container orchestration, and AI-enabled workflow improvements.
Top Skills:
AirflowAWSAws BatchCi/CdDockerEmrGlueGoKafkaKubernetesKv StoresLinuxPythonRelational DatabasesSagemakerSparkSpinnaker
Information Technology • Consulting
Designs and maintains scalable data pipelines and ETL/ELT workflows using Python, SQL, and Azure Databricks. Manages large structured and semi-structured datasets, data models, monitoring, quality controls, troubleshooting, and production support. Integrates LLM and Generative AI capabilities, including APIs, embeddings, prompt engineering, and RAG workflows, into data solutions. Collaborates with engineering, analytics, and business teams while following security, CI/CD, documentation, and maintainability best practices.
Top Skills:
Azure Data FactoryAzure Data Lake Storage (Adls)Azure DatabricksAzure DevopsAzure Openai ServiceAzure SqlAzure Synapse AnalyticsCi/CdEmbeddingsEtl/EltGenerative AiGitLarge Language Models (Llms)Llm ApisPrompt EngineeringPythonRest ApisRetrieval-Augmented Generation (Rag)SQLVector DatabasesVector Search
Information Technology • Database • Consulting
The job description does not provide information about responsibilities, qualifications, technologies, compensation, or other employment requirements.
What you need to know about the Kolkata Tech Scene
When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.
