lyonl crawler policy

Lyonl Search: No Ads. No Agenda.

Our crawler exists to build an open web search index focused on relevance, transparency, and speed.

Crawler identity

Respect for site controls

  • Robots directives are respected.
  • robots.txt, meta robots, and X-Robots-Tag are honored.
  • Per-host politeness and adaptive retries are enforced.
  • Sitemaps are discovery hints.
  • Conditional fetches reduce unnecessary bandwidth.

For crawl issues, removals, or abuse reports: [email protected].