Look Who’s Crawling Now: Distil Networks’ Good Bot Report Shows Who’s Crawling Your Site

March 25, 2015 Elias Terman

Distil Networks’ Good Bot Report Shows Who’s Crawling Your Site

Search engine and social media bots are key to making sure your site is visible to your prospects and customers. Distil’s Good Bot Report identifies which bots are crawling your website, and how often. You can see a daily breakdown of page requests by good bots such as search engine crawlers like Googlebot, Bingbot, and Yahoo! Slurp, as well as social media crawlers like Twitterbot and Facebook.

  Good Bot Report Traffic  

On the flip side, Distil makes sure you don’t fall victim to bad bots masquerading as good bots by validating that good bot requests map to the correct user agent and IP range.

Accessing the Good Bot Report is easy. It’s already in your Distil Portal under Reports as shown below.

  Good Bot Report  

To be notified of new reports, releases, and updates please ensure you are a part of our mailing list.

Not a Distil Customer? Signup for a Free Trial Today.

Read the Article

About the Author

Elias Terman

Elias Terman is VP of Marketing and is responsible for all aspects of the global marketing and communications strategy. Elias started his career as an entrepreneur, and now enjoys helping grow Silicon Valley startups into industry leaders. He built out the marketing and business development organizations at OneLogin leading to explosive growth, helped establish SnapLogic as the leading independent integration company, and led MindFire Studio to the Inc 500.

Follow on Twitter More Content by Elias Terman
Previous Article
The Dirty Secret About Robots.txt
The Dirty Secret About Robots.txt

Since 1994, webmasters having been creating “robots.txt” files and using them as that proverbial “please do...

Next Article
How to Lower SEO Rank with Duplicate Content
How to Lower SEO Rank with Duplicate Content

Nothing can lower your SEO rank faster than duplicate content. Duplicate content is content that has been ...