AuctionsNearMe is an auction discovery directory operated by Auctify B.V. (Netherlands). To keep the directory current we periodically fetch the public homepage and public "upcoming auctions" pages of auction houses. This page explains exactly what the crawler does and how to stop it.
Mozilla/5.0 (compatible; AuctionsNearMeBot/2.0; +https://auctionsnearme.com/bot/)
Every request carries this User-Agent. The crawler never logs in, never bypasses access controls, never solves captchas, and does not use proxies or rotating identities.
robots.txt, then your homepage and public auction-calendar pages.Crawl-delay if longer).Fetched text is used to write a short, AI-generated summary of your auction house and to extract keyword topics. We do not republish your pages, photos or contact details.
Add either of these to https://yourdomain/robots.txt:
User-agent: AuctionsNearMeBot Disallow: /
User-agent: * Disallow: /
The crawler also honours <meta name="robots" content="noindex">, noai, noimageai, the X-Robots-Tag header and a tdm-reservation: 1 header or meta tag. Blocking the crawler this way also removes your listing from AuctionsNearMe automatically within about a week, and it stays removed for as long as the block is in place.
You do not need to change anything on your site: use the removal form. Requests from an email address on your own domain are processed automatically after a confirmation click; any other request is reviewed by a person. You can also email info@auctionsnearme.com.
Once removed, your domain is added to our exclusion list so the listing is not recreated by future discovery runs.
If the crawler is misbehaving on your server, email info@auctionsnearme.com with your domain and a log excerpt and we will exclude it immediately.