# \#crawler

**URL:** https://tosdr.community/tag/crawler/25.md

[Latest](https://tosdr.community/latest.md) · [Categories](https://tosdr.community/categories.md) · [Tags](https://tosdr.community/tags.md)

---

## [Wikipedia crawling parsed a hyperlink tag](https://tosdr.community/t/wikipedia-crawling-parsed-a-hyperlink-tag/3434)

<div class="topic-metadata">

**Author:** [@Dr\_Jeff](https://tosdr.community/u/Dr_Jeff)\
**Replies:** 0\
**Last updated:** [February 24, 2026, 2:09am UTC](https://tosdr.community/t/wikipedia-crawling-parsed-a-hyperlink-tag/3434 "2026-02-24T02:09:03Z")

</div>

While re-crawling the docs for Wikipedia, I came across this quirk. Don’t think I need to explain why I’m making this post.

---

## [6751: Request for Recrawl](https://tosdr.community/t/6751-request-for-recrawl/2762)

<div class="topic-metadata">

**Author:** [@iamflorencejay](https://tosdr.community/u/iamflorencejay)\
**Replies:** 3\
**Last updated:** [January 12, 2023, 1:12pm UTC](https://tosdr.community/t/6751-request-for-recrawl/2762 "2023-01-12T13:12:27Z")

</div>

I added tosdr.txt on odysee, so you can add some stuff like community guidelines, etc. so I will probably request for a recall.

---

## [Crawl failure: Consumidor.gov.br](https://tosdr.community/t/crawl-failure-consumidor-gov-br/1931)

<div class="topic-metadata">

**Author:** [@KnossosDomovoi](https://tosdr.community/u/KnossosDomovoi)\
**Replies:** 7\
**Last updated:** [July 23, 2021, 8:11pm UTC](https://tosdr.community/t/crawl-failure-consumidor-gov-br/1931 "2021-07-23T20:11:10Z")

</div>

I tried to add the service Consumidor.gov.br, however the crawler can’t read any documents there. I tried several different crawlers. Are they all being blocked by the service? The error message: the bot gets the sta…

---

## [How to annotate points without a working crawler](https://tosdr.community/t/how-to-annotate-points-without-a-working-crawler/1475)

<div class="topic-metadata">

**Author:** [@KnossosDomovoi](https://tosdr.community/u/KnossosDomovoi)\
**Replies:** 2\
**Last updated:** [March 22, 2021, 3:43pm UTC](https://tosdr.community/t/how-to-annotate-points-without-a-working-crawler/1475 "2021-03-22T15:43:27Z")

</div>

I’m curious to know how are you annotating points at all, considering the crawler is not working. This is not a criticism, it’s just that I wonder how I could be more helpful. I’ve been trying for months to annotate poi…