The Crawl Robot Set-up fieldset is used to provide websites that you crawl with information about who is crawling them.
The point of this page is to give web owners both contact info for your bot as well as a description of how your bot crawls web sites.