Apex Code Development You need to sign in to do that
Don't have an account?
Salesforce Pages Have Google PR3 ?!?
I just noticed my authenticated Salesforce pages now have PageRank from Google (PR3), which means Google spiders are holding URLs like https://na1.salesforce.com/home/home.jsp in their index.
Very odd since robots.txt in the root disallows this.
https://na1.salesforce.com/robots.txt
#
# robots.txt for sfdc appservers.
#
# For use by salesforce.com
#
User-agent: * # applies to all robots
Disallow: / # disallow indexing of all pages
Perhaps the spiders need some more specific NOINDEX, NOFOLLOW instructions in the page template? Such as:
<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">
... some may be concerned that anything with Google PR is accessible via the web, although I know that's not the case here.
Very odd since robots.txt in the root disallows this.
https://na1.salesforce.com/robots.txt
#
# robots.txt for sfdc appservers.
#
# For use by salesforce.com
#
User-agent: * # applies to all robots
Disallow: / # disallow indexing of all pages
Perhaps the spiders need some more specific NOINDEX, NOFOLLOW instructions in the page template? Such as:
<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">
... some may be concerned that anything with Google PR is accessible via the web, although I know that's not the case here.
Page Rrank doesn't necessarily mean we are indexed - it only means we have links pointing to us.