The future is already here – it’s just not evenly distributed.William Gibson
In the last article I raised the apparent discrepancy between the number of web pages and the number of pages indexed by search engines. Those very simple statistics showed a discrepancy of 50%. In other words, the search engines only know about half the pages that are out on the web. Unfortunately, this inconsistency is hopelessly understated. And to know why, we need to look at the clear web, the deep web and the dark web.