The role involves building and maintaining automated pipelines for data collection and cleaning from public sources, integrating scrapers with backend systems, and ensuring data accuracy and compliance with platform rules.
Web Scraper / Data Engineer
Location: Remote
Job Type: Full-time
About STERRY
At STERRY, we’re not your average Growth Marketing Agency—we’re the rocket fuel behind crowdfunding and e-commerce success. Since day one, we’ve helped clients pull in over $100 million in trackable online revenue. We build strategies that go beyond brand and marketing—we deliver measurable results rooted in online performance
Role Overview
We’re looking for an experienced Web Scraper / Data Engineer to help us build and maintain automated pipelines that collect, clean, and enrich creator and campaign data from public sources. You’ll be responsible for designing reliable, scalable scrapers and integrating them with our backend.
Responsibilities
Requirements
What We Offer
Location: Remote
Job Type: Full-time
About STERRY
At STERRY, we’re not your average Growth Marketing Agency—we’re the rocket fuel behind crowdfunding and e-commerce success. Since day one, we’ve helped clients pull in over $100 million in trackable online revenue. We build strategies that go beyond brand and marketing—we deliver measurable results rooted in online performance
Role Overview
We’re looking for an experienced Web Scraper / Data Engineer to help us build and maintain automated pipelines that collect, clean, and enrich creator and campaign data from public sources. You’ll be responsible for designing reliable, scalable scrapers and integrating them with our backend.
Responsibilities
- Build scrapers and crawlers to collect creator profile data (followers, engagement, category, contact info, etc.) from social platforms (TikTok, Instagram, YouTube, etc.) and directories
- Parse and clean unstructured data into structured datasets (JSON, CSV, or direct to database)
- Integrate with APIs (YouTube, TikTok, Instagram, etc.) where possible
- Detect and handle rate limits, CAPTCHA, and anti-bot mechanisms
- Implement and monitor scraping tasks using proxy rotation and headless browsers (Puppeteer, Playwright, Selenium, etc.)
- Collaborate with the backend team to feed data into AI recommendation engine
- Maintain high data accuracy, freshness, and compliance with platform TOS and privacy rules
Requirements
- 2+ years experience building web scrapers, crawlers, or data extraction pipelines
- Strong Python or Node.js skills (BeautifulSoup, Playwright, Puppeteer, Scrapy, or similar)
- Experience with APIs, JSON, REST, and rate-limiting management
- Familiarity with databases (MongoDB, PostgreSQL, Firebase, etc.)
- Knowledge of proxies, headless browsers, and data scaling infrastructure
- Attention to detail and ability to deliver clean, well-documented code
- (Bonus) Experience with influencer data, social analytics, or SaaS platforms
What We Offer
- Flexible working hours (remote-first)
- Competitive pay (hourly or project-based)
- Long-term potential to transition into a data engineering role
- Opportunity to shape the foundation of a fast-growing AI SaaS startup
Top Skills
Beautifulsoup
Firebase
JSON
MongoDB
Node.js
Playwright
Postgres
Puppeteer
Python
Rest
Scrapy
Similar Jobs
Artificial Intelligence • Machine Learning
The Senior Product Manager will lead the evolution of platform services, focusing on identity management, multi-tenancy, and UI elements, ensuring adoption and alignment with enterprise standards.
Top Skills:
AIAPIsIamSaaSUi/Ux Design
Artificial Intelligence • Fintech • Hardware • Information Technology • Sales • Software • Transportation
Manage and lead the engineering team for Motive Card, focusing on product features, while developing roadmaps and best practices. Responsible for hiring, team development, and ensuring high-quality operations and execution.
Top Skills:
Agile Product DevelopmentBuild ToolsCloud ComputingDistributed SystemsFront-End EngineeringInfrastructureMobileQa
Artificial Intelligence • Fintech • Hardware • Information Technology • Sales • Software • Transportation
As a Senior People Business Partner, you will support HR services, develop strategies, manage performance processes, and address employee concerns within a dedicated department.
What you need to know about the Kolkata Tech Scene
When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.
