3 of 17

Write now Article Tools

Page 2 of 5

the graph formed by the WWW. It can record information about those servers for the creation of an index or search facility." Computer Robot is a software program that works with the speed far beyond that human being can reach. Since the "Robot" to search information crawls among internets like a spider, so the searching engine Robot is called "Spider".

The first real search engine, a Robot, in the world applied to monitoring webs in the sense of a completely automated indexing system is World Wide Web Wanderer, developed by Matthew Gray, a MIT student. It is much better than Archie and Veronica, for Archie and Veronica were for the most part indexed manually, though they could search automatically. Though Wanderer robot was intended to track the growth of the Web counting only web servers initially, it captured URLs as well soon after its launch. This list formed the first database of websites, called Wandex.

Though Robots at that time could search very fast, they were quite controversial, because they occupied a large portion of network bandwidth and they crashed servers, which was very common.In order to solve the problems caused by Robots which automated indexing of the Web, in October 1993, Martjin Koster created Aliweb, which is Archie Like Indexing of the Web, an HTTP edition. This was the first attempt to create a directory for just the Web, similar to Yahoo search engine which is well known to us. Instead of using a robot, webmasters submit a file with their URL and their own description of it, which allowed for a more accurate, detailed listing. Unfortunately, the application file was difficult to fill out, and so many websites were never listed with Aliweb.

With the rapid development of internet, it became more and more difficult to search the newly created web pages. Hence, on the base of Matthew Gray's Wanderer, some programmers improved the traditional "Spider" program. They thought that since all the web pages were most possible linked with each other, it was possible to search all the webs by tracing the links of one web site. By the end of 1993, many search engines based on this theory appeared. Among them, there were three most famous search engines: JumpStation, The World Wide Web Worm(developed by Oliver McBryan in 1994, bought out by Goto.com in 1998, today's Overture), Repository-Based Software Engineering (RBSE) spider. However, JumpStation and WWW Worm list the searching result according to the information in the data base, no much relevancy

• << previous page
• 1
• 2
• 3
• 4
• 5
• next page >>

Add your voice

Know something about Search engine evolution: Where they started and where they are today?
We want to hear your view. Write now!