0 LIKES LikeUnLike
i am new in internet field and i just heard these new terms. can you please explain them.
Tags: bots, crawler, difference, spiders, Web
Report (1) (0) | 12 years, 8 month(s) ago
Report (0) (0) | 12 years, 8 month(s) ago
Spider - a browser like program that downloads web pages.
Crawler – a program that automatically follows all of the links on each web page.
Robots - An automated computer program that visit websites & perform predefined task. They are guided by search engine algorithms & are able to perform different tasks instead of just one crawling task. They can combine the tasks of crawler & spider together and help in indexing and ranking of websites on any particular search engine.
Latest activity: 13 years, 5 month(s) ago. This question has 3 answers.