lyonl crawler policy

Lyonl Search — No Ads. No Agenda.

Our crawler exists to build an open web search index focused on relevance, transparency, and speed. We do not run ads and we do not sell placement.

Purpose

lyonl crawls public web content to power a general search engine that aims to reflect the open internet without sponsored ranking manipulation.

Crawler Identity

• User-Agent: lyonl-crawler/0.1 (+https://lyonl.com/crawler; crawler@lyonl.com)
• Policy page: https://lyonl.com/crawler
• Contact: crawler@lyonl.com

Respect for Site Controls

• Robots directives are respected.
• robots.txt, meta robots, and X-Robots-Tag are honored.
• Per-host politeness and adaptive retries are enforced.
• Sitemaps are treated as discovery hints.
• Conditional fetches are used to reduce unnecessary bandwidth where possible.

Removal and Issues

For crawl issues, block requests, or removal concerns, contact crawler@lyonl.com.

Back to search