Design and oversee data architecture, ensure compliance, create data processing frameworks, and lead data engineering teams. Collaborate with stakeholders to meet business needs.Data governance and performance optimization included.
1
Tasks:
- Acting as a Senior Consultant/Solution Advisor:
- Technology partner: Advise on designing data architectures in Microsoft Azure.
- Empowering customer to spot and leverage business opportunities by unlocking the power of data.
- Providing technical and problem-solving expertise for client representatives and Lingaro project teams.
- Data Integration: Lead data integration efforts, including ETL processes, to ensure seamless data flow.
- Cloud Services Utilization: Leverage Azure, as well as tools like dbt and Databricks, for efficient data pipelines and analytics solutions.
- Advise on security measures and compliance standards in cloud environments.
- Continuously monitor and optimize data solutions for cost-efficiency.
- Data Governance: Advise data governance and quality standards.
- Collaboration: Work with cross-functional teams to understand requirements and provide data solutions.
- Mentoring junior team members in cloud data architecture best practices.
- Daily tasks including:
- implementing data ingestion pipelines from multiple data sources using Azure Data Factory, Azure Databricks and other ETL tools.
- developing scalable and re-usable, self-service frameworks for data ingestion and processing.
- designing, building, and managing SQL server databases in the Azure cloud.
- performing data modelling and integrating data from various systems
- reviewing and implementing best practices for data manipulation
- creating and supporting Azure Data Factory pipelines.
- Integrating end to end data pipelines to take data from data source to target data repositories ensuring the quality and consistency of data.
What we are looking for:
- 11+ years of professional experience in the Data & Analytics area,
- 5+ years of experience in the Senior Consultant role with a strong focus on Azure data solutions.
- Advanced knowledge and understanding of architecture, application design, systems engineering, and integration.
- Very good knowledge of cloud data services, data warehousing, big data technologies, and data lakes. Especially Azure, DataBricks
- Expertise in data modeling, data integration, and ETL processes.
- Proven experience in using of Microsoft ETL tools (Azure Databricks, Azure Data Factory, Data Lake and SSIS)
- Databricks Unity Catalog, Asset Bundles, Data Factory, Microsoft Fabric. Logic App, Function App.
- Programming skills for data analysis (especially PySpark, SparkSQL, Python, SQL)
- Familiarity with data governance, data security, and compliance standards.
- Familiarity with agile methodologies and the ability to apply DevOps and DataOps principles to data pipelines.
- Ability to use ARM templates
- Experience in working with JSON
- Good understanding of business processes and the ability to drive automation through effective management.
- This role involves designing the project architecture. Setup, monitoring Internal Developer Platform. UC migration. Building Databricks Asset Bundles. PR reviews. Data Model / Semantic Layer setup. Model QA automation.
What we offer:
- Stable employment. On the market since 2008, 1500+ talents currently on board in 7 global sites.
- “Office as an option” model. You can choose to work remotely or in the office, depending on your location.
- Flexibility regarding working hours and your preferred form of contract.
- Comprehensive online onboarding program with a “Buddy” from day 1.
- Cooperation with top-tier engineers and experts.
- Unlimited access to the Udemy learning platform from day 1.
- Certificate training programs. Lingarians earn 500+ technology certificates yearly.
- Upskilling support. Capability development programs, Competency Centers, knowledge sharing sessions, community webinars, 110+ training opportunities yearly.
- Internal Gallup Certified Strengths Coach to support your growth.
- Grow as we grow as a company. 76% of our managers are internal promotions.
- A diverse, inclusive, and values-driven community.
- Autonomy to choose the way you work. We trust your ideas.
- Create our community together. Refer your friends to receive bonuses.
- Activities to support your well-being and health.
- Plenty of opportunities to donate to charities and support the environment.
- Modern office equipment. Purchased for you or available to borrow, depending on your location
Top Skills
Azure Data Factory
Databricks
Logic App
Pyspark
Python
SQL
Similar Jobs
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Lead agile teams as Scrum Master, managing projects, coordinating with various teams, and tracking tasks while ensuring customer satisfaction.
Top Skills:
Azure DevopsCi/Cd PipelinesConfluenceJavaJIRAExcelPerlPower BIPythonRallyVersion One
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
The role involves reviewing and researching claims, processing transactions, resolving discrepancies, and ensuring adherence to quality standards in a timely manner.
Top Skills:
ExcelMs Word
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Lead manual and automation testing processes, create frameworks and test scripts, and communicate with stakeholders while analyzing requirements. Ensure robust testing methodologies are applied throughout the development life cycle.
Top Skills:
GitbashGitJavaJenkinsJIRAMS OfficeQtestSeleniumSQLTest Complete
What you need to know about the Kolkata Tech Scene
When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.
