NielsenIQ logo

NielsenIQ

More roles at NielsenIQ

Senior Software Engineer (Web Scraping, Data acquisition, Data collection)

Work from home

Remote role where the employee must remain based in a particular country.

Listed for Portugal

From the listing details: Source listing states candidate location: "Lisbon, Lisbon, Portugal, Lisbon, pt, Remote"

Employer listed it 2 weeks ago · Added 2 weeks ago

Been open since 2 weeks ago, still being checked, but it has been live a while.

Salary

€46k to €70k per year

Location

Listed for Portugal

Timezone

CET ±2

Contract

Full-time

Experience

Senior

Category

Software

Published by the employer

What the advert says

Quoted word for word from the employer's advert. Where it says nothing, we say so.

Working hours
Not mentioned in the advert
Where you can work from
Location eligibility not confirmed
Contract
Not mentioned in the advert
Experience asked for
5+ years of experience with  Python  and large-scale scraping projects.
Pay
Friendly and transparent work culture, competitive salary, flexible hours, and the chance to grow fast in a high-impact role.

Remote flexibility

Work from home

This is a remote role, but the employee must be based in Portugal. It is work from home rather than work from anywhere.

What the employer says

  • Source listing states candidate location: "Lisbon, Lisbon, Portugal, Lisbon, pt, Remote"

What Nomaders makes of it

  • Residency required in Portugal
  • Payroll and tax are likely handled in that country only

The quotes above are the employer's own words; the reading is ours. Always check the original listing and employment terms before working from another country.

Before you apply

Questions worth asking: Nomaders interpretation

  • The advert does not say where you can be based. Ask which countries they can legally employ or contract you from.
  • The advert does not say whether this is employment or a contractor arrangement. Ask, as it affects tax and benefits.

Produced automatically from this advert's text; not reviewed by a person. The employer's own page is the final word.

About the role

At NIQ Digital shelf, scraping isn’t just about collecting data, it’s about  outsmarting the obstacles  that stand in the way of visibility. Every day, we process  tens of billions of data points  from thousands of sources, both web and mobile, and transform them into actionable insights for the world’s top retailers and brands.

You'll join a team of  60+ scrapers , engineers, analysts, and data lovers from across the globe. As part of our scraping and R&D team, you’ll have space to  experiment, push boundaries , and bring bold ideas to life. You’ll collaborate closely with  Customer Success ,  Operations , and  Data  to ensure we extract high-quality, actionable data — fast and at scale.

This isn’t just a coding job. You’ll need to  think like a hacker , move like an engineer, and act like an inventor

Design and build distributed scraping architectures that can scale across thousands of domains.

Reverse engineer APIs and mobile apps using tools like  Frida ,  mitmproxy ,  Charles Proxy, burp and many more.

Detect common anti-bot measures (like JavaScript checks or browser behavior detection) to build crawlers that adjust to appear more human-like.

Lead technical innovation in scraping: identify edge cases, prototype new approaches, and share knowledge with the team.

Set up anomaly detection and monitoring to detect blockers or failures early

5+ years of experience with  Python  and large-scale scraping projects.

Deep understanding of  anti-bot technologies  and how to bypass them, fingerprinting, WAFs, JavaScript challenges, etc.

Experience working with  Scrapy ,  Requests ,  httpx ,  Selenium ,  Playwright , or custom headless browser drivers.

Skilled at handling proxies (residential, datacenter, rotating), session management, cookie injection, and TLS tweaking.

Strong debugging skills across browser, HTTP traffic, and device-level interactions.

You think independently and enjoy solving problems no one has solved before.

Familiarity with structured storage formats (Parquet, Avro), or real-time stream processing.

Good knowledge of databases like MongoDB, InfluxDB, and Redis, including how they work and how to optimize them.

➕  Bonus Skills

Experience with real-device simulation for mobile scraping.

Comfortable building and maintaining distributed task queues (Celery, Kafka, etc.).

Experience scraping high-security platforms or mobile-first environments.

Exposure to Linux or cloud environments (AWS, GCP, etc.).

Basic understanding of Kubernetes, Cloud Run, and Cloud Functions to deploy and orchestrate scraping workloads.

Why Join NIQ Digital shelf

You'll have  ownership  and  freedom  to experiment, backed by a team that thrives on innovation.

Requirements

  • ·Experience with real-device simulation for mobile scraping.
  • ·Comfortable building and maintaining distributed task queues (Celery, Kafka, etc.).
  • ·Experience scraping high-security platforms or mobile-first environments.
  • ·Exposure to Linux or cloud environments (AWS, GCP, etc.).
  • ·Basic understanding of Kubernetes, Cloud Run, and Cloud Functions to deploy and orchestrate scraping workloads.

Benefits

  • ·Flexible working environment
  • ·Volunteer time off
  • ·LinkedIn Learning
  • ·Employee-Assistance-Program (EAP)
  • ·For more information, visit NIQ.com

How to apply

  1. 1Check the flexibility label above, work from home, matches where you plan to live and work.
  2. 2Tailor your CV to the role at NielsenIQ, mentioning your remote working experience and working hours (CET ±2).
  3. 3Apply directly on the employer's careers page using the button below. Nomaders never handles your application.

Found 15d ago. Last checked today. Always confirm the details on the original posting, salary and location can change after publication.

Listing sourced from Company boards.

€46k to €70k per year · You'll be taken to the employer's careers page.