Bot traffic has surpassed humans this year, now accounting for 59 percent of all site visits, according to a report released today by Distil Networks.
By comparison, last year, bots accounted for 45 percent of all traffic to Distil's customers' websites.
The majority of the bot traffic was "good bots," said Distil CEO Rami Essaid, such as that from search engines and social media sites. These bots comply with "robot.txt" files that Website administrators use to tell bots what to do, and bring value to the websites they visit.
He attributed the growth in bot traffic to more aggressive indexing by Bing, and by new search engines coming online.
"The 'good bots' almost doubled as a category this year," he said.
"Good bots" accounted for 36 percent of traffic this year, up from 21 percent last year. "Bad bots" were responsible for 23 percent of traffic this year, down slightly from 24 percent last year -- not because volumes were down, Essaid repeated, but because the number of "good bots" rose dramatically. Human traffic was just 41 percent, down from 55 percent last year.
The company helps customers keep out bad bots, of which the company saw 23 billion last year. The company defines "bad bots" as those that don't respect "robots.txt" files and don't provide value to the sites they visit.