More people now ask an assistant what to buy than read a results page. If your robots.txt blocks those crawlers — and plenty of stores block them without meaning to — you are invisible in that answer. This reads your robots.txt the way each assistant does.
Reads your public robots.txt and applies each agent's own rules, including longest-match precedence. Nothing is stored.