Basic terms of web robot.txt – Blogs PalaceBlogs Palace
- Published
- Genre
- SEO
External source
blogspalace.com External website
You are viewing the Vahuk Story page. The link above opens the shared source website.
What is a Web robot:
In basic, web robot is simply a program. Robot is used to automatically and recursively traverses a Web site to retrieve document content and information. Search engine spiders is the most common types of Web robots. These robots visit Web sites and follow the links to add more information to the search engine database.
Web robots often go by different names. You may hear them called:
Community reactions
Karma 18.9
0
reactions
Discussion
0 comments
No comments yet. Be the first to join the discussion.