Like in the pagination challenge, each page has a few persons.
But you cannot retrieve all pages from one IP.
to bypass the IP restriction.
git checkout scrapoxy
Install Scrapoxy with the Quick Start
Use AWS provider
with your credential on
(please create a your own account)
Start 2 instances maximum in Scrapoxy
Follow the tutorial:
Integrate Scrapoxy to Scrapy
Start the scraper (see Start instructions)
and check the log
git checkout .
git checkout scrapoxy-soluce