Person-agent: [Needed, one or more per team] The rule specifies the name of the automatic shopper called search engine crawler the rule relates to. You have got usage of a great number of free of charge robots.txt generator tools online, a lot of which might be absolutely free. On the https://seotoolstube.com/