lyonl crawler policy
Lyonl Search: No Ads. No Agenda.
Our crawler exists to build an open web search index focused on relevance, transparency, and speed.
Crawler identity
lyonl-crawler/0.1 (+https://lyonl.com/crawler; [email protected])- Policy page:
https://lyonl.com/crawler - Contact:
[email protected]
Respect for site controls
- Robots directives are respected.
robots.txt, meta robots, andX-Robots-Tagare honored.- Per-host politeness and adaptive retries are enforced.
- Sitemaps are discovery hints.
- Conditional fetches reduce unnecessary bandwidth.
For crawl issues, removals, or abuse reports: [email protected].