Get Instant Access

First Name
Last Name
Company Name
Phone Number
By submitting this form, you agree to Distil's Terms of Service and Privacy Policy.
Thank you!
Error - something went wrong!

Defending Online Classifieds and Marketplaces from Web Scraping Bots

October 13, 2015
Bots are the key culprits in degrading classifieds and marketplace sites’ availability, user experience, competitive advantage, and brand trust. Bots now make up 61% of web traffic and their negative impact on your site and business can be substantial:
  • Thieves and unauthorized aggregators use web scraping bots to steal product listing data, repackage it for sale in the form of lead gen programs, or they place it on unauthorized sites-- all of which hurt SEO, negatively impact your brand, and reduce your ability to monetize your content 
  • Massive bot requests can slow down your website, and left unchecked, can even take portions of your site down for extended periods of time 
  • Fake registrations, spammy product listings, and comment spam pollute your site and backend systems, and have negative cascading effects on your site’s success 
  • Hackers use bots to scan your site for vulnerabilities, attempt brute-force login attacks, account takeovers, man-in-the-middle/browser attacks and more 
  • Dealing with bots manually can be a tedious game of whack-a-mole, and place a huge tax on internal teams and web infrastructure
This paper covers the dynamics of the bot threat and how to defend your classified and marketplace site from all these threats-- with special emphasis on web scraping.
Previous Article
Scraping Just Got a Lot More Dangerous
Scraping Just Got a Lot More Dangerous

A Federal Court restricted fair use by upholding the NY Times and The AP’s claim to copyright against Meltw...

Next Article
Look Who’s Crawling Now: Distil Networks’ Good Bot Report Shows Who’s Crawling Your Site
Look Who’s Crawling Now: Distil Networks’ Good Bot Report Shows Who’s Crawling Your Site

With Distil Networks’ Good Bot Report, you can see search engine crawlers & social media crawlers in a repo...