robots.txt: allowing asqatasun crawler access to all content