How Publishers Can Protect Themselves from Bots That Steal Content

September 22, 2015 Rami Essaid

Before the digital age, content theft was a labor-intensive business. Then computers enabled theft by cut-and-paste. Today, the content theft business is almost entirely automated – and probably happening on your website right now.

Welcome to the age of theft by bot.

WHAT IS A BOT?

Photo by Peyri Herrera on Flickr and used here with Creative Commons license.

Bots are small, automated programs that come in “good” and “bad” forms. Good bots are deployed by web indexers like Google and Bing, and are an essential component of online business. Bad bots, on the other hand, are designed to seek out and steal specific content by “scraping” it from sites and transmitting it to a third party. Why spend time and money creating your own content when you can steal someone else’s for free?

CONTENT THEFT IS JUST THE BEGINNING

Content that’s stolen and repackaged for sale by a third party hurts branding, SEO results (your content is no longer seen as unique by search engines) and customer trust. An example of a company that can’t have its branding hurt by bad bots is Whitepages.com, where Andy Hibbler, Vice President of Brand Advertising and Partnerships promises his clients the company will “serve honest impressions.”

Read the Article

About the Author

Rami Essaid is the Chief Product and Strategy Officer and Co-founder of Distil Networks, the first easy and accurate way to identify and police malicious website traffic, blocking 99.9% of bad bots without impacting legitimate users. With over 12 years in telecommunications, network security, and cloud infrastructure management, Rami continues to advise enterprise companies around the world, helping them embrace the cloud to improve their scalability and reliability while maintaining a high level of security.
Follow on Twitter More Content by Rami Essaid

To CAPTCHA or Not to CAPTCHA

To CAPTCHA or Not to CAPTCHA. Distil Networks CAPTCHA study show how CAPTCHAs change user behavior when sub...

Next Flipbook

Online Directory Cuts Pageviews in Half by Blocking Bots | CrunchBase Case Study

Learn how online directory site CrunchBase blocks bot attacks from content scraping & causing website brown...

DISTIL NETWORKS' RESOURCES HUB

How Publishers Can Protect Themselves from Bots That Steal Content

About the Author

Previous Article

Next Flipbook

How Publishers Can Protect Themselves from Bots That Steal Content

About the Author

Previous Article

Next Flipbook

Other content in this Stream

In the 2019 Bad Bot Report you’ll learn what bad bots do, the business behind them, and the tell-tale signs you have a bot problem.

In 2017, the fight against non-human traffic is more complex than ever for publishers and advertisers. View our findings in a report by the 614 Group here.

APIs lack basic capabilities to detect and prevent to automated attacks. Learn how to protect APIs with Bot Defense.

By limiting non-human traffic, Distil improved ad interactions for agency Real Good Media's clients, such as Dailymotion and Sony Pictures. View the case study here!

Distil Networks Analyst Managed Service provide another defense layer. Offload the responsibility of defending against automated site & API attacks to our team of expert team of IT security analysts.

Watch the discussion led by The 614 Group and Distil Networks with commentary from industry luminaries about the fight against non-human traffic. According

Rami Essaid, Co-Founder of Distil Networks explains the differences between blocking and auditing, key use cases for each, and best practices for combating digital ad fraud.

The year bots went mainstream. What makes this report unique is its focus on bad bot activity at the application layer (layer 7 of the OSI model).

Learn how digital publisher Graphiq Saves Engineering Resources & Improves SEO by fighting malicious bots & web scrapers with Distil Networks Appliance & Amazon Cloudfront. Graphiq Case Study.

This data sheets describes how Distil protects your website from fraud, brute force attacks, web scraping, account hijacking, unauthorized vulnerability scans, spam, and man-in-the-middle attacks.

Explore the landscape of non-human traffic in the digital advertising marketplace, approaches to combating the problem, & one publisher’s successful efforts to create a premium ad inventory program.

Learn the key differences between Reverse Proxy Approach & single pixel with ad approach for Digital Ad Fraud Prevention for digital publishers

Malicious bots are getting more sophisticated and bot blocking companies are raising more cash – the arms race is in full swing. Distil Networks, announced $21 million in Series C.

13 Questions You Must Ask Your Bot Mitigation Vendor. Use these questions to help differentiate between solutions and make an informed decision

Yahoo's problems may stem from its troubled ad business. According to Distil Networks ad fraud is a widespread problem not limited to Yahoo.

Gartner used to publish a Gartner Magic Quadrant Fraud, specifically for web fraud detection, but the online transaction fraud market became so fragmented that they started doing a Market Guide instea

Compare the four technology approaches for digital ad fraud solutions: on-page, in-ad exchange, challenge based, & reverse proxy. Which is the best solution?

Field Guide for Validating Premium Ad Inventory, filtering out Non-Human Traffic with anti-fraud forensic scientist Dr. Augustine Fou, Distil Networks CEO, & Whitepages VP Brand Advertising

To CAPTCHA or Not to CAPTCHA. Distil Networks CAPTCHA study show how CAPTCHAs change user behavior when submitting web forms includes infographics.

Learn how online directory site CrunchBase blocks bot attacks from content scraping & causing website brownouts. Eliminated 99.9% of bad bot traffic with Distil Networks.