The vendor review you're failing without knowing it — and the layer that decides whether a crawler gets in.
Reads the response headers and the HTML of one public URL. We store the domain, the result and your contact details. No report is published. Sixty tests per hour — the second instrument and each site you add to a comparison each count as one.