How Publishers Can Protect Themselves from Bots That Steal Content

September 22, 2015 Rami Essaid

Before the digital age, content theft was a labor-intensive business. Then computers enabled theft by cut-and-paste. Today, the content theft business is almost entirely automated – and probably happening on your website right now.

Welcome to the age of theft by bot.

WHAT IS A BOT?

Photo by Peyri Herrera on Flickr and used here with Creative Commons license.

Photo by Peyri Herrera on Flickr and used here with Creative Commons license.

Bots are small, automated programs that come in “good” and “bad” forms. Good bots are deployed by web indexers like Google and Bing, and are an essential component of online business. Bad bots, on the other hand, are designed to seek out and steal specific content by “scraping” it from sites and transmitting it to a third party. Why spend time and money creating your own content when you can steal someone else’s for free?

CONTENT THEFT IS JUST THE BEGINNING

Content that’s stolen and repackaged for sale by a third party hurts branding, SEO results (your content is no longer seen as unique by search engines) and customer trust. An example of a company that can’t have its branding hurt by bad bots is Whitepages.com, where Andy Hibbler, Vice President of Brand Advertising and Partnerships promises his clients the company will “serve honest impressions.”

Read the Article

About the Author

Rami Essaid

Rami Essaid is the CEO and Co-founder of Distil Networks, the first easy and accurate way to identify and police malicious website traffic, blocking 99.9% of bad bots without impacting legitimate users. With over 12 years in telecommunications, network security, and cloud infrastructure management, Rami continues to advise enterprise companies around the world, helping them embrace the cloud to improve their scalability and reliability while maintaining a high level of security.

Follow on Twitter More Content by Rami Essaid
Previous Article
Gartner Market Guide for Online Fraud Detection
Gartner Market Guide for Online Fraud Detection

Gartner published their Market Guide for Online Fraud Detection to provide fraud managers and web infrastru...

Next Flipbook
Online Directory Cuts Pageviews in Half by Blocking Bots | CrunchBase Case Study
Online Directory Cuts Pageviews in Half by Blocking Bots | CrunchBase Case Study

Learn how online directory site CrunchBase blocks bot attacks from content scraping & causing website brown...