Provides technical leadership for Azure data engineering projects, including solution architecture, data modeling, pipelines, data integration, code quality, QA, performance optimization, governance, security, and documentation. Collaborates with stakeholders and project managers to define scope, manage risks, and deliver scalable, efficient solutions. Requires strong Python, SQL, PySpark, Databricks, Azure Data Factory, Delta Lake, Synapse, Spark, data warehousing, governance, and Azure DevOps expertise.
Growth through diversity, equity, and inclusion. As an ethical business, we do what is right — including ensuring equal opportunities and fostering a safe, respectful workplace for each of us. We believe diversity fuels both personal and business growth. We're committed to building an inclusive community where all our people thrive regardless of their backgrounds, identities, or other personal characteristics.
Freelance Cooperation – What Does It Mean?
- Open-ended freelance agreement. An active sole proprietorship (B2B) is required throughout the duration of the agreement.
- Part-time engagement. Work up to 50% of full-time workload, depending on current project needs.
- Flexibility that fits your schedule. We’ll reach out whenever a suitable project opportunity comes up. If you’re available and interested, you can choose to join the project. If the timing isn’t right, you’re always free to decline without terminating the agreement.
- No need to worry about the equipment. Freelancers typically work using equipment provided by us. Depending on the project, you may receive access to a virtual machine instead.
Task:
- Provide technical expertise and direction in data engineering, guiding the team in selecting appropriate tools, technologies, and methodologies. Stay updated with the latest advancements in data engineering and ensure the team follows best practices and industry standards.
- Collaborate with stakeholders to understand project requirements, define scope, and create project plans.
- Support project managers to ensure that projects are executed effectively, meeting timelines, budgets, and quality standards. Monitor progress, identify risks, and implement mitigation strategies.
- Oversee the design and architecture of data solutions, collaborating with data architects and other stakeholders. Ensure data solutions are scalable, efficient, and aligned with business requirements. Provide guidance in areas such as data modeling, database design, and data integration.
- Align coding standards, conduct code reviews to ensure proper code quality level.
- Identify and introduce quality assurance processes for data pipelines and workflows.
- Optimize data processing and storage for performance, efficiency and cost savings.
- Evaluate and implement new technologies to improve data engineering processes on various aspects (CICD, Quality Assurance, Coding standards).
- Maintain technical documentation of the project, control validity and perform regular reviews of it.
- Ensure compliance with security standards and regulations.
What we are looking for:
- A Bachelor's or master's degree in computer science, Information Systems, or a related field is typically required. Additional certifications in cloud are advantageous.
- Minimum of 8-10 years of experience in data engineering or a related field.
- Strong technical skills in data engineering, including proficiency in programming languages such as Python, SQL, Pyspark.
- Familiarity with Azure cloud platform viz. Azure Databricks, Data Factory, Data Lake etc., and experience in implementing data solutions in a cloud environment.
- Expertise in working with various data tools and technologies, such as ETL frameworks, data pipelines, and data warehousing solutions.
- In-depth knowledge of data management principles and best practices, including data governance, data quality, and data integration.
- Excellent problem-solving and analytical skills, with the ability to identify and resolve complex data engineering issues.
- Knowledge of data security and privacy regulations, and the ability to ensure compliance within data engineering projects.
- Excellent communication and interpersonal skills, with the ability to effectively collaborate with cross-functional teams, stakeholders, and senior management.
- Continuous learning mindset, staying updated with the latest advancements and trends in data engineering and related technologies.
- Consulting exposure, with external customer focus mindset is preferred.
Must have skills: Databricks, Python, writing SQL queries, Delta lake, Data Lake concept, DWH, ADF, Azure Synapse, spark architecture, Data Governance, Azure Devops.
We offer:
- Established global technology partner. Lingaro has been operating since 2008 and brings together 1,600+ professionals across 7 global locations.
- Flexible collaboration model and working hours. Enjoy working from inspiring locations in line with our remote work policy.
- A diverse, inclusive, and values-driven community.
- Autonomy to choose the way you work. We trust your ideas.
Missing one or two of these qualifications? We still want to hear from you! If you bring a positive mindset, we'll provide an environment where you feel valued and empowered to learn and grow.
Similar Jobs
.jpeg)
Artificial Intelligence • Hardware • Information Technology • Machine Learning
Manages construction quality systems for large-scale industrial and semiconductor projects. Leads QA/QC across civil, structural, MEP, cleanroom, utility, and installation work; oversees inspections, audits, testing, documentation, NCRs, CAPA, contractor performance, and compliance with international standards. Coordinates with engineering, commissioning, procurement, and project teams, supports turnover and startup, drives continuous improvement, and mentors quality personnel.
Top Skills:
AciAnsiAsmeAstmAtexAWSBimCeConstruction Management SoftwareDigital Quality Management SystemsDishFm GlobalGenerative AiIecIpcIsIso 9001NecNfpaPesoSemiUl
Artificial Intelligence • Hardware • Information Technology • Machine Learning
Develop and coordinate architectural and interior designs for semiconductor fabs, cleanrooms, and support facilities. Responsibilities include creating layouts and construction drawings, BIM modeling, regulatory compliance, material and space planning, sustainability integration, stakeholder coordination, construction oversight, and resolving design issues. The role also drives discipline leads, vendors, consultants, and deliverables toward timely, high-quality completion.
Top Skills:
3D ModelingAIBimBreeamGmp StandardsIgbcIso Cleanroom StandardsLeedMs ProjectPrimaveraSemi Standards
Artificial Intelligence • Big Data • Logistics • Machine Learning • Software • Transportation
Own the reference architecture and platform for production AI agents, including agent execution, tool use, state management, recovery, context engineering, model routing, guardrails, and human handoffs. Build shared retrieval, memory, and evaluation infrastructure for offline and online quality measurement. Integrate agents with event-driven systems and customer APIs, review designs, mentor engineers, and connect technical metrics to supply chain business outcomes.
Top Skills:
APIsAWSBertClaudeGCPGeminiGptJavaKafkaKubernetesLlmsMcpMicroservicesOcrPostgresPythonTypescript
What you need to know about the Kolkata Tech Scene
When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.
