The Data Engineer role involves analyzing raw data, building data systems, conducting complex analyses, and enhancing data quality by collaborating with data scientists and architects.
This is a remote position.
Responsibilities:
Requirements
Requirements and skills:
Similar Jobs
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead data engineering architecture and execution for large-scale, low-latency analytics. Own technical direction, ensure operational data quality, design streaming and batch pipelines, mentor engineers, coordinate cross-functional teams, and deliver scalable solutions using Spark, Airflow, and AWS or equivalent data platforms.
Top Skills:
AirflowAthenaColumn StoresDatabricksDatabricks ApisEmrFlinkHiveKafkaKappa ArchitectureLambda ArchitectureMaster Data Management (Mdm)Microservices ArchitectureRedshiftSparkSQLStreaming Pipelines
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead and execute data engineering initiatives: define metrics, instrument logging, ingest and model data, build ETL/ELT pipelines, ensure data quality and governance, optimize processing performance, enable analytics/visualization, and lead projects that drive product and business strategy.
Top Skills:
Anomaly DetectionDashboardingData ModelingData QualityData VisualizationEltETLLoggingProduct AnalyticsPythonRelational DatabasesSQL
Healthtech • Biotech
Design, build, and operate ingestion pipelines and normalized security data products for vulnerability risk management. Transform raw evidence into model-ready features, enable ownership routing and remediation workflows, and maintain data quality, lineage, and observability. Partner with security, engineering, and platform teams to support reporting, risk models, and shift-left scanning readiness.
Top Skills:
Business IntelligenceData CatalogData ContractsData LineageEtl/EltLakehouseLlm/Agentic ToolsMedallion ArchitectureObservabilityOrchestrationPythonSQL
What you need to know about the Kolkata Tech Scene
When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.
