Managing Robots META Tags with Tridion or any CMS*

*"Any CMS" refers to any system that lets you configure your own authorable-fields to be rendered as you prefer, in this case <META> tags with name attribute set to "ROBOTS."

I often see requirements that have likely made their way from an original Request for Proposal (RFP) to a CMS Functional Design that reads something like: "authors should have the ability to set page-level meta tags including the Robots meta tag."

This meta tag "tells" search engines how to index content on a given Web page and its links.*

Valid Content values for <META NAME="ROBOTS"> includes:

• INDEX
• NOINDEX
• FOLLOW
• NOFOLLOW

And if absent, the default is INDEX,FOLLOW. See the Web Robots Pages for the details.

*Bots aren't forced to actually listen to these instructions, though I'd say most search engines try to play nice. 

Tame the Content Injection Monster

Content Injection, or rendering Content Types (Component Presentations in Tridion) within the context of another Content Type (Component Presentation) is a powerful content management option.

But be careful it doesn't wreck havoc in your implementations and become a monster to manage.

Run! It's the multi-level, deeply-nested content injected monster!
Source: TridionWorld, with a minor tweak and much respect to the authors--
I regularly cite this article in my own engagements..