Our crawler
If you found LeadOceanBot/1.0 (+https://leadocean.io/bot) in your server logs, this is what it was doing, and how to keep it out.
Two requests per company website: /robots.txt, then the home page, once. It follows up to five redirects, reads at most 100 KB of the page, and does not load images, scripts, stylesheets or any other page. It does not fill in forms, log in, or run JavaScript.
LeadOcean is a B2B company database. From the home page we record which publicly visible technologies a company uses: its CMS, analytics, chat widget, payment provider and the like. That is firmographic information about the business, not personal data about anyone.
A site is fetched at most once every few months. The bot keeps one connection open per site, waits for each response before the next request, and never fetches more than one page per site in a run.
The bot reads robots.txt before every fetch and honours both a rule for its own name and a rule for all agents:
User-agent: LeadOceanBot Disallow: /
A disallowed site is recorded as "not permitted" and is not fetched again. If you would rather tell us directly, email support@leadocean.io with the domain, and we exclude it within a working day.
Requests carry the User-Agent above. If you see that name from an address that does not belong to us, it is not our bot; tell us and we will say which addresses are ours.
People whose professional details are in our database are covered on the privacy page, including how to be removed.