Posts

Showing posts with the label crawler spider

Search Engine Work Flow | SEO Expert | Gaurav

Image
How Search Engine Work There are 3 parts to a search engine: 1. The search engines use robots (also known as spiders) to search the internet for websites . 2. The results of the spiders' travels are put in an database which is then indexed based on words found and where these words were found . 3.The users of search engines search for words or phrases related to what they are looking for and the search engine index returns related sites . INTRODUCTION OF SPIDER The term search engine spider can be used interchangeably with the term search engine crawler. A spider is a program that a search engine uses to seek out information on the World Wide Web, as well as to index the information that it finds so that actual search results appear when a search query for a keyword is entered. The search engine spider "reads" the text on the web page or collection of web pages, and records any hyperlinks it finds. The search engine spider then follows these URLs, spider...