Crawler identity
CNCMachineToolSalesBot/1.0
Automated crawler operated by CNC Machine Tool Sales (cncmachinetoolsales.co.uk). Used only to discover CNC machine-tool lots for a public directory. Not a browser impersonator. Not a challenge-defeat tool.
User-Agent
CNCMachineToolSalesBot/1.0 (+https://cncmachinetoolsales.co.uk/bot)
Hosts fetched
Only these hosts are on the allow-list. Anything else is refused before HTTP:
www.1stmachineryauctions.com— lot index and lot pages (catalogue evidence; closed 2020 auctions are not published as live inventory)www.cottandco.com— EN auction pages and lot pages (live Phase 1 inventory source)
Paths requested: public lot/auction HTML only. The Cottrill bid platform host cottandco.o.gg is hard-blocked (Disallow: /).
Rate and robots.txt
- 1 request per second per host
robots.txtis fetched and honoured before the first content request for a host (cached, refreshed daily)- On Disallow: the URL is skipped and logged — it is not fetched and not ingested
Opt out
Email [email protected] with the host or paths to exclude. Opt-out requests are honoured. You can also Disallow this User-Agent in your robots.txt.
What we do not do
- Never impersonate a consumer browser User-Agent
- Never defeat CAPTCHAs, JS challenges or paywalls
- Never republish dealer photographs or verbatim listing copy
Our own robots.txt allows marketplace pages and points operators here.