Bot, you must obey /robots.txt.