Maintain and monitor web scraping configurations, ingest and transform scraped data into the data lake, detect and resolve pipeline issues, produce stakeholder reports, and build scalable ETL pipelines and data architectures to support analytics.
We are growing! We are currently looking to hire a Data Engineer to work with us remotely.
Who we are:
Founded in 2006, we’re proud to be a global business. From Shanghai to Paris, we have 12 offices and operate across four continents in 70 countries. We are home to over 250 professionals from around the world, working together to serve more than 230 luxury clients.
At CXG, we love to evolve, elevate, and transform experiences while bringing brand promises to life. We offer strategic solutions that impact performance and elevate the customer experience of some of the world’s most iconic premium and luxury brands.
Your duties will also involve:
- Maintain and manage website scraping configurations using Python
- Monitor scraping configurations for errors and potential crashes.
- Oversee retrieved data to detect potential issues and blockages.
- Coordinate with stakeholders to understand scraping task requirements and report issues.
- Prepare and share periodic reports on scraping activities with stakeholders.
- Develop necessary pipelines to ingest data into the Datalake and perform required transformations.
Requirements
What you will bring along:
- Minimum 2 years of experience in a similar role.
- Proven experience in data engineering with expertise in designing and implementing scalable data architectures.
- Strong experience with ETL processes, data modeling, and data warehousing (Airflow & DBT preferred).
- Expertise in database technologies, both relational (SQL) and NoSQL.
- Knowledge of cloud platforms, particularly Azure.
- Solid understanding of data security measures and compliance standards.
- Excellent Python experience for data engineering and automation.
- Strong collaboration skills to work closely with data scientists and analysts.
- Ability to optimize data pipelines for performance and efficiency.
- Ability to build, test, and maintain tasks and projects.
- Experience with version control systems, such as Git.
- Hands-on experience with Airflow and/or DBT.
- Experience with Terraform for infrastructure management.
- Strong academic background in a relevant field.
- Fluent in English (French is a plus).
Top Skills
Python,Airflow,Dbt,Sql,Nosql,Azure,Git,Terraform,Etl,Data Lake,Web Scraping,Data Warehousing,Data Modeling
Similar Jobs
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Lead design and delivery of HIL automation frameworks and infrastructure to accelerate firmware and software validation. Build simulations, integrate hardware test rigs, partner with Firmware/QE, and apply data/AI tools to optimize developer workflows and test coverage.
Top Skills:
Python,Sql,Pandas,Databricks,Linux,Tcp,Uart,Can,Ble,Wifi,Lte,Gnss,Hardware-In-The-Loop Simulation,Rf Testing,Power Supplies,Power Analyzers,Battery Simulators,Gps Simulators,Call Boxes,Embedded Systems,Ai Tools
Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
Responsible for driving business development and sales targets in Data & AI, managing stakeholder engagements, and providing technical support while leading complex sales proposals.
Top Skills:
5G6GAIApi MonetizationBusiness Support SystemsCloudGenaiMicro-Services ArchitectureOperations Support Systems
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
As a Core Account Executive, you will drive sales with large enterprise clients, manage customer relationships, and provide data-driven insights to enhance business operations. Your role includes prospecting, engaging with C-Level stakeholders, and achieving sales quotas in a fast-paced environment.
What you need to know about the Kolkata Tech Scene
When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.
