|Nifter Multimedia Download Center||Search Home|
Multimedia Resources Home
Free Birthday Songs / Music
Free Background Image Tiles
Free Sound Effects
Free TV Theme Songs
Free Computer Wallpapers
Free Icons Collections
Windows Movie Maker
Free Computer Clipart Images
Free Website Templates
Free Fonts Downloads
Mega-Paks File Archives
Free Website Page Graphics
Articles, Tutorials & Trivia
Free Cool Tools Online
Free MIDI Karaoke Songs
Nifter Media on YouTube
Casey Anthony Case Videos
Link to Nifter.com
Free Online Masters Courses
WAHM - Work at Home Mom
Webmaster Business Course
Service Business / Sellers
Local Business Course
Robots Meta Tag Element - Attributes, Uses and Other Information
Home > Free Multimedia Download Center > Information, Articles, Tutorials > The Robots Meta Tag Element
The Robots Meta Tag Element - Metadata Elements (Meta Tags)
Before jumping into this article it would only be purdent to mention that there is an alternative to using the Robots Meta Tag, which must be added to every web page it is necessary to use it on. The alternative is to use a robots text file (robots.txt) We recommend you look over the Wikipedia article on the Robots Text File if you want to learn more. Robots.txt at Wikipedia can be found here.
Not everyone has permission to access their web server and upload a robots.txt file. The use of a free web site host is an example of where this can happen. There may be other reasons where it is a good idea to use the Robots Meta Tag also, regardless of whether you are using the robots.txt file or not. In any case, this article will help you understand more about this metadata element, an important bit of knowledge for any webmaster.
About the Robots Meta Tag
The Robots Meta Tag is a useful element whose purpose is to disallow specific actions by web robots and spiders. For example, you wouldn't want a page that users have paid a fee to access appearing on Google search results pages. And even when you have disallowed indexing of the page, you still don't want a robot following links on the page that lead to other members-only areas. The Robots Meta Tag will help you control this type of access plus other actions that are commonly performed by web robots.
The Robots Meta Tag is written like this with no regard to letter case:A comma delimited list of the terms you choose to use goes in the area that we have labelled ATTRIBUTES_HERE in the above example. Common terms for the Robots Meta Tag include the following:
all index noindex follow nofollowOther terms can be added as part of the comma delimited (separated) list as shown in the table at the end of this article.
The word service (or services) is used here to signify the organization(s) using the robot that is searching the web page. Examples: Google, Bing, Yahoo etc.
The default action for a robot is to index each page it finds and follow all links on that pages to find more pages. If no Robots Meta Tag exists, the default action is taken. Note that the default action is identical to using the Robots Meta Tag like this:
<meta name="robots" content="index, follow">In other words, using index or follow provides no different result than if you didn't use them at all. Many people include one of these terms in robots tags that are using both, but it isn't necessary. In fact, if you want a robot to handle a web page in the default manner, you don't need to include the Robots Meta Tag at all. Take a look at this example:
The tagThe default action (index, follow) is taken when any of the following conditions are found:
<meta name="robots" content="noindex, follow, noindex">
Using the Robots Meta Tag Properly
We will end this section of the article with some more examples of the Robots Meta Tag used in ways that conform to the standard for this tag. An explanation of the actions that would be taken by the robot follow. We have also included comparison tags to help you complete your understanding of this tag.
Example: <meta name="robots" content="noindex, follow">This is often done because it gives the coder a clear picture of the actions he being allowed and/or disallowed. How you put your Robots Meta Tags together is up to you; just remember to keep the format proper and do not duplicate attributes. Doing so will ensure that most web robots respect your wishes. Not all, but the important ones will, and that's what counts.
Robots Meta Tag Elements - Which are Used by Who?
This table provides a list of Robots Meta Tag elements and the search services that include them in their indexing process.
Note that all of these services use the main robots tag elements, noindex, nofollow and noarchive, a less common but useful attribute in specific situations.
Articles, Information and Tutorials - Free Website Content
Free Multimedia Download Center
Download Center Nifter's Nuts
|Nifter Media Group||Copyright © 2009 - Nifter.com - All Rights Reserved|