RedtieProspectBot
If you saw this name in your website logs, it was us. Here is what it does, why, and how to stop it.
What it is
RedtieProspectBot is a small web crawler run by Redtie. See our Privacy Policy for who we are. The crawler identifies itself with this User-Agent:
RedtieProspectBot/1.0 (+https://www.getredtie.com/bot) Why we run it
Redtie gives small businesses a phone number answered by an AI assistant. The crawler looks for small businesses whose website lists no phone number, because those are the businesses Redtie can help most.
What it fetches
- Your robots.txt first. If it blocks us, we fetch nothing else. If it can't be read because of a server error, we don't crawl.
- Your public homepage, plus at most a few pages linked from it that look like contact, about, team or services pages. That is at most 5 pages per visit, plus robots.txt. We may check again later, for example before we get in touch.
- Slowly: a few seconds between requests to your site.
- Plain HTML only. We don't run scripts on your pages or follow search or query links.
From those pages we note whether a phone number is shown, and the contact details the site publishes, such as a business email address. We may use them to email the business about Redtie.
What it does not do
- It never submits forms.
- It never logs in or tries to reach anything that isn't public.
- This crawler only reads your public pages. We don't buy personal data to find you.
How to block it
Add this to your site's robots.txt:
User-agent: RedtieProspectBot
Disallow: / We check robots.txt before every visit.
How to opt out entirely
Email hello@getredtie.com with your website's domain. We add your domain to our do-not-contact list, usually within two business days. After that we won't crawl your site or send you marketing email.