Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

But Google also always respects robots.txt. If you don't want your content to appear just put a deny all for all domains. You can easily set that up in nginx by returning static content, you don't even need to create a file in the right directories.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: