Well, almost.Secret ingredientsWhile all of the major search engines follow this basic recipe, if all search engines worked exactly same way, then we would only need one search engine. If someone is using the search engine to find the words "Marx Brothers", the search engine will check to see:Which pages have these words in the .Which pages one or both of the words appear on.How close to the top the words appear, assuming that the closer the words are to the beginning of a page the more relevant that page is.How frequently the words appear on the page.How close the words appear together.And after considering all of these criteria, it produces the list of sites in order of relevancy. So, how does the search software make the crucial decision as to which pages are more relevant, and thus closer to the top of the list, than others?Ranking Web sitesMost search engines that use a crawler to produce the massive amounts of data used to search, determine relevancy by following a set of rules that stay more or less consistent across products. If the search engine uses a directory, then only the titles, URLs, and descriptions of Web pages are included in the index.The Search Software: When a visitor uses a search engine, they first enter one or more keywords. The index is then sifted through by search software which matches the key word(s) to Web pages and ranks them in order of relevance. If the search engine uses a spider, then this massive database can contain every page that has been crawled, making it a carbon copy of the Web.

This allows you to deploy the advantages of both techniques at the same time.The parts of a search engineWhether the search engine uses a crawler or a registration directory to get its data, they all have at least two parts in common: the index and the search software.The Index: All of the content that gets crawled by the spider, and/or all of the entries in the directory get placed into the index. The other great advantage of a directory is that the searcher can actually bypass the search engine, and find what they are looking for by narrowing down the subject by selecting from lists of increasingly specific topics.Hybrid Search Engines: Several search engines, for example, Yahoo!, will allow you to search indexes created both by crawlers and directories simultaneously. The advantage of a directory such as Yahoo! or DMOZ, is that they are far more selective as to what content is indexed, so searches tend to be more focused and produce more accurate results. However, directories are also harder to keep up to date, especially if a site has to be checked by a human being before entry. The World Wide Web is a really big place, so it might take a while for the spider to get back again.Directories: Unlike the active crawlers, passive directories require website creators (or whoever wants to do it) to register a site in their index. However, if a change is made to a Web page, the spider has to crawl through that page again before the change is detected. Visitors can then search through the results that the spider finds.

These two methods differ primarily in the ways that they gather the data from which they create their index of sites, which is then searched.Crawlers: Crawlers, such as AltaVista or Excite, use a program called a spider, which "crawls" through the Web, indexing pages along the way. Yet, you are potentially competing against thousands of other Web pages that have the key words "Marx" and "Brothers" on them, some of which might be extolling the virtues of the proletariat rather then containing the comedic genius.So, how do you separate Karl Marx's philosophies from the Groucho Marx's shtick? Vladimir Lenin's revolution from John Lennon's "Revolution?" How do you make sure that the content you have gets found by the people who need it?The place to start is by understanding how the search engines that your potential visitors will be using work.Different flavoursAlthough the outcome is often the same - a list of search results - there are really two different types of search engines on the Web: crawlers and directories. They type in a description of what they are seeking - say, a Marx Brothers movie clip from A Night at the Opera - so they type in "Marx Brothers", hit "search" and are whisked away to what is usually a massive list of possible Web pages that might, just might, have information that is relevant to them. Naturally if you have that famous movie clip of Groucho trying to stuff the entire crew of the cruise ship into his cabin, then you want one of those websites placed towards the top, if not at the very top, of the search results list. Most people, both novice and experienced Net users, will start their quest for information with one of the many search engines. IT IS universally agreed that finding information on the Web can be damn irritating It's not impossible, of course If it was, no one would use it (and we'd be out of jobs). Happily, he has often been correct, but nobody bats 100 per cent. The metallic windows (along with Apple's round mouse) are widely despised, and Apple should listen to its customers." They could also listen to the rush of downloads from Guttierez's site.Raul Guttierez's Sherlock and QuickTime 4 patches are at http:// <a href="http://www.teamdraw /raul/stuff/stuff.htmlcarthur independent.co.uk">www.teamdraw /raul/stuff/stuff.htmlcarthur independent.co.uk.