No syntax check of robots.txt

[bortzmeyer]

If we try to parse an invalid robots.txt (containing just garbage), parse still returns ok (with an empty set of rules).