RESEARCH

The Power of a Web Search Engine



The Power of a Web Search Engine

IntroductionInformation retrieval if facing new challenges which are creating by the web. Information available on the web and inexperience web searchers is rapidly growing. Automated search engine rely on matching keywords, which lead them to low quality search. Google is a very large scale search engine; Google also refers to 10100 which fit the profile (Brin 1998).

1994 (WWWW) World Wide Web Worm was only search engine Search engine, and it had a index of “110,000” web pages and other files which can be count as web accessible. In 1997 its index claims to reach 100 million and in 2000 it reached to billion documents. 1500 queries per day were received by World Wide Web Worm 1994. In November 1997 it claimed to handle over 20 million queries per day. In 2000 top search engine handled hundreds of millions queries per day through automated system (Brin 1998).

Crawling technology can be define, technology which is used to collect the documents of web and up to date time by time. Storage space should be used effectively. To be effective indexing system must interpret and process data effectively million of gigabytes. Queries should be handled fast, “at a rate of hundreds to thousands per second”. Work become difficult as web sites grows (Brin 1998).

Goal that should be achieved is to improve web search engine quality. People believed in 1994 that complete search engine can find anything easily. "The best navigation service should make it easy to find almost anything on the Web (once all the data is entered)."  Completeness is not counted as a one factor required for the quality of search engine. Research show that searcher only look for or willing to look at the top ten results, through which search engine optimization and search engine marketing concepts pop up. Search engine optimizations are the technique to put your web site on the top 10 list. Search engine marketing is technique to promote your web by using right key words, title page and etc (Brin 1998).

Web is becoming commercial over time. 1993 .com domain was serving 1.5% webs but .com domain increase to 60% in 1997. There are very less publication of the details about techniques on search engine techniques development which mean engine search technology have to become a unknown art and also towards advertising (Brin 1998).

Searching has 9 steps.

WordIDs are made by words.

Look for the doclist to match the input word.

Copy from avaliable doclists till finds a file that matches.

Ranking document for the query.

“Go to step 4 again if we are in the short barrels and at the end of any doclist, seek to the start of the doclist in the full barrel for every word”

Back to process four if we are not capture the goal to reach the end of any doclist

“If we are in the short barrels and at the end of any doclist, seek to the start of the doclist in the full barrel ...