The Rise and Rise of Bad Bots - Part 2 - Beyond Web-Scraping

April 21, 2015 Guest Blogger


Quocirca Insights
IT reflections in an age of change

Anyone who listened to Aleks Krotoski’s 5 short programs on Radio 4 in the UK titled Codes that Changed the World will have been reminded that applications written in COBOL, despite dating from the late 1950s, remain in widespread use.

Although organizations are reliant on these applications they are often impossible to change as the original developers are long gone and the documentation is poor. With the advent of Windows and then web browsers, there was a need to re-present the output of old COBOL applications. This led to the birth of screen-scraping, the reading of output intended for dumb terminals and repurposing it for alternative user interfaces.

The concepts of screen-scraping have been reborn in the 21st Century as web-scraping. Web scrapers are bots that scan web sites for information, when necessary manipulating i/o to get what they need. 

Read the Article

Previous Article
Bots Overtake People on the Web
Bots Overtake People on the Web

Human traffic on the Web dropped from 55% to 41% over the past year, mostly due to "good bots" reflecting a...

Next Article
You’re Probably Chatting with a Bot Every Day
You’re Probably Chatting with a Bot Every Day

Fun fact: only 41 per cent of all online traffic comes from humans. The 2015 Bad Bot Landscape Report from ...