LotLinkBot

LotLinkBot reads vehicle inventory from car dealership websites for LotLink, a service that gives a dealership's own salespeople personal websites showing that store's vehicles. It identifies itself as LotLinkBot/1.0 (+https://lotlink.live/bot).

What it does

• Only reads inventory for dealerships whose salespeople use LotLink.
• Reads the public vehicle listings (year, make, model, price, photos, VIN) the same way a visitor's browser loads the inventory search page, logged out, with no accounts or credentials.
• Links every vehicle back to its page on the dealership's own site.

How it behaves

• Obeys robots.txt, including Crawl-delay. Disallow LotLinkBot and it stops.
• One request at a time per site, at most one every 3 seconds.
• On HTTP 429 or 503 it waits exactly as long as Retry-After says (or 30 minutes, then 2 hours, then until the next day), and it stops a run after 3 rate-limit answers.
• Never tries to get past CAPTCHAs, bot challenges or blocks.
• Reads each store once a day around 5 AM Eastern, plus a light midday check of the listings to take sold vehicles off.

Contact

Questions, or want us to stop? Email [email protected]. LotLink is operated by JCGreen LLC.