Activity by Crawler DotBot/1.1
Crawler
| Name | DotBot/1.1 |
|---|---|
| Type | Indexer/Scraper |
| Type Description | Identifies HTML pages for indexing and/or scraping |
| Is Identified | Yes |
| Web Page | http://www.opensiteexplorer.org/dotbot |
| Email Address | help@moz.com |
| Note | |
| User Agent Strings | 1 |
| IP Addresses | 3 | Resources | 8 |
| Requests | 16 |
| Requests for robots.txt | 6 |
| Earliest Request | 2025-06-25 09:05:04 |
| Latest Request | 2025-06-26 15:47:31 |
User Agent String ▼
| ID⭡ | User Agent String⭥ | Requests⭥ |
|---|---|---|
| 764 | Mozilla/5.0 (compatible; DotBot/1.1; http://www.opensiteexplorer.org/dotbot, help@moz.com) | 16 |
IP Addresses ▼
| IP Address⭡ | Host | Crawler⭥ | Requests⭥ |
|---|---|---|---|
| 3.236.148.199 | ec2-3-236-148-199.compute-1.amazonaws.com | DotBot/1.1 | 7 |
| 18.234.51.197 | ec2-18-234-51-197.compute-1.amazonaws.com | DotBot/1.1 | 3 |
| 54.242.40.127 | ec2-54-242-40-127.compute-1.amazonaws.com | DotBot/1.1 | 6 |
Resources ▼
Domain conradhalling.com ▼
Resources Found ▼
| Resource | Resource Type | Status Code | Requests |
|---|---|---|---|
| /audiobooks/index.cgi | HTML | 200 | 1 |
| /blog/ | HTML | 200 | 3 |
| /robots.txt | Text | 200 | 3 |
Resources Refused or Not Found ▼
| Resource | Resource Type | Status Code | Requests |
|---|---|---|---|
| / | Redirect | 302 | 2 |
Domain sphaerula.com ▼
Resources Found ▼
| Resource | Resource Type | Status Code | Requests |
|---|---|---|---|
| /blog/ | HTML | 200 | 2 |
| /cgi/crawlers.cgi?summary | HTML | 200 | 1 |
| /robots.txt | Text | 200 | 2 |
Resources Refused or Not Found ▼
| Resource | Resource Type | Status Code | Requests |
|---|---|---|---|
| / | Redirect | 302 | 1 |
| /robots.txt | Text | 301 | 1 |
Requests ▼
| ID⭥ | Method⭥ | Domain⭥ | Resource⭥ | Referrer⭥ | Status⭥ | IP Address⭥ | User Agent String ID⭥ | Timestamp⭣ | Crawler⭥ |
|---|---|---|---|---|---|---|---|---|---|
| 167049 | GET | sphaerula.com | /robots.txt | 301 | 3.236.148.199 | 764 | 2025-06-25 09:05:04 | DotBot/1.1 | |
| 238912 | GET | sphaerula.com | /robots.txt | 200 | 3.236.148.199 | 764 | 2025-06-25 09:05:05 | DotBot/1.1 | |
| 238913 | GET | sphaerula.com | / | 302 | 3.236.148.199 | 764 | 2025-06-25 09:05:25 | DotBot/1.1 | |
| 238914 | GET | sphaerula.com | /blog/ | 200 | 3.236.148.199 | 764 | 2025-06-25 09:05:56 | DotBot/1.1 | |
| 238917 | GET | sphaerula.com | /robots.txt | 200 | 3.236.148.199 | 764 | 2025-06-25 09:22:37 | DotBot/1.1 | |
| 238918 | GET | sphaerula.com | /blog/ | 200 | 3.236.148.199 | 764 | 2025-06-25 09:22:37 | DotBot/1.1 | |
| 238919 | GET | sphaerula.com | /cgi/crawlers.cgi?summary | 200 | 3.236.148.199 | 764 | 2025-06-25 09:22:38 | DotBot/1.1 | |
| 104283 | GET | conradhalling.com | /robots.txt | 200 | 18.234.51.197 | 764 | 2025-06-25 19:33:59 | DotBot/1.1 | |
| 104284 | GET | conradhalling.com | / | 302 | 18.234.51.197 | 764 | 2025-06-25 19:34:21 | DotBot/1.1 | |
| 104285 | GET | conradhalling.com | /blog/ | 200 | 18.234.51.197 | 764 | 2025-06-25 19:34:49 | DotBot/1.1 | |
| 105089 | GET | conradhalling.com | /robots.txt | 200 | 54.242.40.127 | 764 | 2025-06-26 15:26:30 | DotBot/1.1 | |
| 105090 | GET | conradhalling.com | / | 302 | 54.242.40.127 | 764 | 2025-06-26 15:26:53 | DotBot/1.1 | |
| 105091 | GET | conradhalling.com | /blog/ | 200 | 54.242.40.127 | 764 | 2025-06-26 15:27:38 | DotBot/1.1 | |
| 105095 | GET | conradhalling.com | /robots.txt | 200 | 54.242.40.127 | 764 | 2025-06-26 15:47:31 | DotBot/1.1 | |
| 105096 | GET | conradhalling.com | /blog/ | 200 | 54.242.40.127 | 764 | 2025-06-26 15:47:31 | DotBot/1.1 | |
| 105097 | GET | conradhalling.com | /audiobooks/index.cgi | 200 | 54.242.40.127 | 764 | 2025-06-26 15:47:31 | DotBot/1.1 |