|
womble -> Includes, robots.txt and search engines (2/18/2006 18:46:35)
|
I'm working on a site at the moment that has php includes on some pages. At the moment they've just got lorem ipsum in them, but the finished thing will have Adsense and links to related sites in them along with some stuff I do want SEs to pick up on. I've got a robots.txt in place blocking the includes folder at the moment, but it's just occured to me, could that disadvantage me with the includes folder being blocked, or do the SEs go on generated content?
|
|
|
|