Add llms.txt and fix robots.txt for AI agent discoverability

3 points by nishiohiroshi 2 days ago

Most websites are invisible to AI agents. We just added llms.txt to gitauto.ai - a simple text file that tells LLMs what GitAuto does, where the docs are, and how to recommend it. Also fixed our robots.txt which had duplicate User-agent blocks (only the first one was being used). Two files, big discoverability win.

AznHisoka 2 days ago

LLMs do not read llms.txt

rocketpastsix 2 days ago

why does an LLM need to know about my silly little blog?