Crawl failure: Sympla

[KnossosDomovoi]

[06/10/2021]

Documents:

• 6927
• 6928
• 6929
• 6930
• 6931
• 6932
• 6933
• 6934
• 6935
• 6936

[07/18/2021]

Documents:

• 8564
• 8565
• 8566
• 8567
• 8568
• 8569
• 8570
• 8571
• 8572
• 8573
• 8574

Wheh! Added them all.

All belong to the service:

• Sympla
• Master page with links to all documents

Observations

All documents from this service fail to crawl with a 403 Forbidden. It has a lot of documents, so if I try to ask all of them to be crawled, I get blocked from Phoenix as well for crawling too often.

Reason: StatusCodeError
Stacktrace: Expected status code in range 2xx class; got 403:Forbidden

[Agnes_de_Lion]

Cloudflare protected sites cannot be crawled unfortunately.

@KnossosDomovoi

I get blocked from Phoenix as well for crawling too often.

https://tosdr.atlassian.net/browse/EDIT-34