User-agent: * Disallow /blog/wp*.* Disallow: *.js Disallow: *.css Disallow: *.jpg Disallow: *.gif Disallow: *.htm Disallow: *.txt