Europe's Top Ecommerce Beauty Retailer Puts an End to Web Scraping | Case Study

July 13, 2015 Distil Networks

“We have a handful of competitors that cause us a lot of headaches. With Distil, we’ve stopped them from scraping our data, which protects our competitive advantage. In addition, we’ve reduced the load by 22%, and as a result, our customers experience faster response times.”

-- Principal Solutions Developer at leading online beauty retailer


One of Europe’s largest independent online beauty retailers offers thousands of products across a broad range of brands. This e-tailer knows who its closest competitors are, and suspected several of them of web scraping. The problem became serious when the scraping became more advanced.

Online retailers are particularly susceptible to the effects of advanced bot threats, including price scraping, product matching, variation tracking and availability targeting. When bots scrape pricing and product information, aggregated data is fed to an analytics engine, allowing competitors to match prices and products quickly.

The online beauty retailer realized they were a victim of advanced site scraping; competitors were following their every move and undercutting them in the market in real-time. With the intent to thwart competitors’ efforts to scrape important pricing data and other information from its website, the retailer sought the help of Distil Networks.


  • Competitors were scraping product and pricing data, using it to lure customers away
  • Traffic from malicious bots was consuming server resources and slowing site performance
  • Tracking suspicious IP addresses manually was a tedious manual process


Distil Cloud CDN


  • Stopped competitors from scraping pricing and product data by blocking bad bots
  • Reduced site errors and latency, lowering bounce rates
  • Eliminated bad bot traffic, cutting server resource needs by 22%
  • Automated and offloaded bot detection, saving a day and a half per week in IT resources

About the Author

Distil Networks, the global leader in bot detection and mitigation, is the first easy and accurate way to identify and police malicious website traffic, blocking 99.9% of bad bots without impacting legitimate users. Distil protects against web scraping, competitive data mining, account hijacking, form spam and click fraud while slashing the high tax that bots place on your internal teams and web infrastructure.

Follow on Twitter More Content by Distil Networks
Previous Article
How the Anti Bot Industry is Mirroring the Antivirus Industry – Only Faster
How the Anti Bot Industry is Mirroring the Antivirus Industry – Only Faster

Bad bots have exploded in volume. As a result, anti bot solutions have had to evolve much faster than antiv...

Next Article
Gartner Market Guide for Online Fraud Detection
Gartner Market Guide for Online Fraud Detection

Gartner used to publish a Gartner Magic Quadrant Fraud, specifically for web fraud detection, but the onlin...