World_Wide_Web_Wanderer

World Wide Web Wanderer

World Wide Web Wanderer

Web crawler


The World Wide Web Wanderer, also simply called The Wanderer, was a Perl-based web crawler that was first deployed in June 1993 to measure the size of the World Wide Web. The Wanderer was developed at the Massachusetts Institute of Technology by Matthew Gray, who also created back in 1993 one of the 100 first web servers in history, www.mit.edu.[1] The crawler was used to generate an index called the Wandex later in 1993. The Wanderer charted the growth of the web until late 1995.

Quick Facts Type of site, Launched ...

The Wanderer was probably the first web robot, and, with its index, clearly had the potential to become a general-purpose WWW search engine. The author, Matthew Gray, does not make this claim.[2] Elsewhere, it is stated that the purpose of the Wanderer was not to be a web search engine.[3]


References

  1. SEO, Doctor (2022). "Evolution of SEO". www.doctor-seo.net.

Share this article:

This article uses material from the Wikipedia article World_Wide_Web_Wanderer, and is written by contributors. Text is available under a CC BY-SA 4.0 International License; additional terms may apply. Images, videos and audio are available under their respective licenses.