Build and maintain modern cloud data platforms, data warehouses, scalable data models, and ETL/ELT pipelines using Databricks, Azure Data Factory, and AWS Glue. Perform data analysis and create dashboards, lead and mentor the Analytics team, establish data quality and governance standards, and manage version control, CI/CD, and releases. Collaborate with clients and cross-functional teams to deliver data-driven solutions.
Senior Data Engineer
We are seeking a highly skilled and self-motivated Senior Data Engineer with strong experience in Databricks, Azure Data Factory, AWS Glue and BI visualisation to build and maintain modern cloud data platforms and lead our Analytics team. You will work closely with clients and cross-functional teams to turn data into insights that drive business decisions.
Key Responsibilities
- Architect, build and maintain data warehouses and our next-gen cloud data platform.
- Design and implement scalable data models and ETL/ELT pipelines using Databricks, Azure Data Factory and AWS Glue.
- Conduct deep data analysis and build insightful dashboards and visualisations for internal and client stakeholders.
- Lead and mentor the Analytics team, setting standards for data modelling, code quality and delivery.
- Ensure data quality, governance and compliance across the data lifecycle.
- Own source version control, CI/CD and release/change management for data products.
- Automate data sourcing, visualisation and analytics products to reduce manual effort.
- Work with cross-functional teams and clients to turn business problems into data-driven solutions.
Must-Have Qualifications
- Bachelor's/Master’s degree in Computer Science, IT, Data Science or related field.
- 5+ years of industry experience in data engineering, cloud services or BI and analytics, including team leadership or mentoring.
- Strong hands-on experience with Databricks (Spark/PySpark), Azure Data Factory and AWS Glue.
- Strong SQL and Python skills.
- Experience with at least one Data Warehousing/Analytics tool (Azure Synapse Analytics, SQL Database, Snowflake, AWS Redshift, RDS).
- Experience with at least one Visualisation tool (Tableau, Power BI, QuickSight, Sisense).
- At least one cloud data certification (Databricks Data Engineer, Microsoft Fabric DP-700, AWS Data Engineer, Snowflake SnowPro).
- Experience with Git, CI/CD and release/change management.
- Excellent communication and collaboration skills, including client-facing work.
Nice-to-Have Skills
- Experience with dbt or Airflow.
- Data governance and privacy compliance in financial services.
- Fintech or lending domain experience, or Salesforce data integration.
- Experience with Delta Lake, Unity Catalog or lakehouse architecture.
CloudKaptan Kolkata, West Bengal, IND Office
Mani Casadona, Action Area 1-2F, New Town, 9W1 and 9W2, , , IN, Kolkata, West Bengal, India, 700156
Similar Jobs
Information Technology • Consulting
Develop and maintain Oracle APEX applications, Oracle Analytics Server/OBIEE reporting solutions, BI Publisher reports, and Oracle database objects. Build dashboards, workflows, integrations, REST APIs, and data models; write complex SQL and PL/SQL; troubleshoot and tune application and database performance; support deployments, testing, production issues, documentation, and stakeholder collaboration.
Top Skills:
Agile/ScrumBi PublisherCi/CdCSSHTMLJavaScriptLinux/UnixObieeOracle Analytics ServerOracle ApexOracle Autonomous DatabaseOracle Cloud InfrastructureOracle Data IntegratorOracle DatabaseOracle Rest Data ServicesPl/SqlRest ApisSource ControlSQL
Software
Build Salesforce Data Cloud solutions that ingest Revenue Cloud, CRM, and billing data using data streams, the Ingestion API, and zero-copy. Design DMOs and identity resolution for a unified customer revenue view, create and validate ARR, MRR, and usage insights, and support CPQ-to-Revenue Cloud migration reconciliation. The role also prepares curated data foundations for Agentforce use cases and requires strong SQL, data modeling, Data Cloud development, and English communication skills.
Top Skills:
AgentforceCpqCRMCrm AnalyticsData Model Objects (Dmos)Data StreamsIdentity ResolutionIngestion ApiRevenue CloudSalesforce Data CloudSQLTableauZero-CopyZuora
Healthtech • Software
Build and maintain scalable Python APIs, data pipelines, and AI/ML model integrations. Collaborate with researchers and product teams on machine learning implementation, data warehouse integration, and AI research. Develop RESTful and GraphQL services, write maintainable code, participate in reviews, mentor junior developers, and contribute to agile software delivery.
Top Skills:
AWSAzureCi/CdDjango Rest FrameworkDockerFastapiFlaskGCPGraphQLKubernetesPythonPyTorchRestScikit-LearnTensorFlow
What you need to know about the Kolkata Tech Scene
When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.

