I won’t go trough the history of the World Wide Web (WWW) and this post is just a little clarification about what you can find or not in the Web and where to search. Web is huge and continues to grow dramatically and the WEB that everyone usually uses is the tip of the iceberg. Surface Web It is the part who are most familiar with. The Surface Web is anything that can be indexed by a typical search engine like Google, Bing or Yahoo. Traditional search engines create their indices by spidering or crawling surface Web pages. Have a look here to know how Google does it. This crawling technology finds and identifies websites that contains pages that contains links. So it is very static. It is exactly when you start to read/watch something in a website and click and click and click again until you’re asking yourself “WTF! Why am I watching this stupid video ” (Yeah 116,737,298 views!!!) So search engines crawling technologies index every link he finds 🙂 Deep Web The deep Web is qualitatively different from the surface Web. Deep Web sources store their content in searchable databases that only produce results dynamically in response to a direct request. Most of the content located in the Deep Web exists in websites that require a search and is not illicit. Registration-required web forums and dynamically-created pages (Webmails or product pages generated by Amazon after you typed a keyword) are part of this Deep Web. (Deep) Dark Web Dark Web is a small portion of the Deep Web. The Dark Web then is classified as a small portion of the Deep Web that has been intentionally hidden and is inaccessible through standard web browsers. The most famous content that resides on the Dark Web is found in the TOR network. The TOR network is an anonymous network that can only be accessed with a special web browser, called the TOR browser. This is the portion of the Internet most widely known for illicit activities because of the anonymity associated with the TOR network. The Dark Web is associated with the sale of drugs, weapons, counterfeit documents, guns for hire and forbidden pornography. But not everything on the Dark Web is “Dark”. You can find the Tor hidden service WikiLeaks created to accept leaks from anonymous sources. Nowadays it is called SecureDrop. a software that integrates with Tor hidden services to let any news organization receive anonymous submissions. Even Facebook has launched a Dark Web site aimed at better catering to users who visit the site using Tor to evade surveillance and censorship. But yeah maybe some people consider Facebook as a Deep Dark Corporation 🙂 Ok. That’s it for this post. Maybe I will write more if you are interested in using TOR for example. But if you google the Surface web you will find plenty of guides. Dark web – Guns for Hire! The infinite WEB! All right so we have the surface and the Deep Web. But what is the size of the iceberg? The answer given by BrightPlanet.com is : Infinite! These questions are impossible to answer now as the Internet has turned into a rapidly expanding database that can only be classified as infinite. So how big is the biggest database in existence? The answer, “nobody knows”. – BrightPlanet Have a look here if you wanna some answers about what it is nearly impossible to size the WEB. And a nice Infographic I like about the Deep Web:) DeepWeb
