FutureWay AI
FutureWayBot

The FutureWay AI crawler

FutureWayBot fetches public web pages a customer configured as a knowledge source in their FutureWay platform — only their own or explicitly allowed hosts, only to build their company knowledge.

What the bot does
No search index, no training: every page lands solely in the knowledge area of the customer who set up the source.
  • robots.txt per RFC 9309 is honoured, including Crawl-delay (up to 5 seconds).
  • “noindex” and “nofollow” in meta tags and rel attributes are respected.
  • It follows links only to hosts the customer explicitly allowed, and only to a configured depth.
  • At most one request at a time per host, at least 200 ms apart, with a capped number of pages per run.
  • It never signs in, never bypasses access controls and never submits forms.
  • User agent: FutureWayBot/1.0 (+https://futureway.ai/bot)
Opting out
If you do not want the bot on your site, add it to your robots.txt — it takes effect on the next run.
User-agent: FutureWayBot
Disallow: /

Questions, or a bot that does not behave as described? Reach us via the contact page; we follow up on every report.

This website uses no cookies and builds no user profiles — which is why there is no cookie banner. Our anonymous reach measurement runs on our own servers in Germany, with no analytics service involved.

Learn more