- General
- Accommodation
- Adobe Flex
- Alnwick
- Apple
- Audio
- Beaches
- blogging
- Bring up children
- Clients
- complaining
- Concrete 5
- Consumer
- Cumbria
- Drupal
- Environmental Issues
- Evernote
- Firebug
- Friends
- FTP
- Funstuff
- Garden Design
- Gardening
- Gardens
- Great cafes
- Great Places
- imagecache
- Internet / Web
- iPhone
- iPhone Applications FREE
- iPhone Applications Paid
- iPhone Development
- iPlus
- ipod
- IRD
- itunes
- Macclesfield
- MAMP
- Northumberland
- OSX
- OS X Tricks
- Outdoor Equipment for Children
- Parenting
- Penrith
- Poor Service
- Programming
- Property Market
- Reviews
- robots.txt
- Screencasts
- Self Catering
- Snow Leopard
- Social Networking
- Social Networking Case Studies
- Software
- Street Furniture
- Things to do with Children in Cheshire
- Time Machine
- Tutorials
- Ubercart
- UK Housing Market
- Unix
- Unix Commands
- User Interfaces
- Widgets
robots.txt
Why are my pages on Google even though I excluded them in the robots.txt
This is a video from Matt Cutts of Goolge explaining their policy on indexing sites and handling robots.txt directives.
Bookmark/Search this post with:
Recent popular content
Recent blog posts
- Excluding IP Address ranges from Google Analytics reporting
- Antisocial behaviour by Macclesfield Council - An open letter
- The iPhone buying process parodised
- Show hidden files in an Open or Save dialogue in Snow Leopard
- Eden Ostrich World Cafe - great for toddlers
- A537 Average speed cameras
- New narrow gauge railway - High Leigh Garden Centre Warrington
- John Lewis Cafe Cheadle, dreadful slow service Fail!
- National Trust iPhone App - Free
- "Saving Private Ryan" and "Up"
Syndicate