You can follow the discussion on How Can You Manage Access for Spiders, Crawlers and Other Bots on Your Website? Protecting From Content and Personal Data Parsing without having to leave a comment. Cool, huh? Just enter your email address in the form here below and you’re all set.