The robots protocol is displayed in a public form, that is, you can see the robots protocol of your own website or you can query the robots protocol of other websites.
To view the agreement, use the corresponding URL to query, the URL is: website domain name/robots.txt
For example, to view Taobao's robots agreement is to add robots.txt to Taobao's domain name,
that is, www.taobao.com/robots.txt
. For the meaning of the fields in the robots agreement, you can read my first blog.