Activity by Crawler SemrushBot
Crawler
| Name | SemrushBot |
|---|---|
| Type | Indexer/Scraper |
| Type Description | Identifies HTML pages for indexing and/or scraping |
| Is Identified | Yes |
| Web Page | http://www.semrush.com/bot.html |
| Email Address | |
| Note | |
| User Agent Strings | 1 |
| IP Addresses | 1 | Resources | 2 |
| Requests | 4 |
| Requests for robots.txt | 2 |
| Earliest Request | 2025-06-13 15:28:47 |
| Latest Request | 2025-06-13 15:28:59 |
User Agent String ▼
| ID⭡ | User Agent String⭥ | Requests⭥ |
|---|---|---|
| 1243 | Mozilla/5.0 (compatible; SemrushBot; +http://www.semrush.com/bot.html) | 4 |
IP Address ▼
| IP Address⭡ | Host | Crawler⭥ | Requests⭥ |
|---|---|---|---|
| 85.208.98.18 | bot.semrush.com | SemrushBot | 4 |
Resources ▼
Domain sphaerula.com ▼
Resources Found ▼
| Resource | Resource Type | Status Code | Requests |
|---|---|---|---|
| /robots.txt | Text | 200 | 1 |
Resources Refused or Not Found ▼
| Resource | Resource Type | Status Code | Requests |
|---|---|---|---|
| /robots.txt | Text | 301 | 1 |
| /wordpress/computing/random-shuffle-algorithms/ | Nonexistent | 301 | 1 |
| /wordpress/computing/random-shuffle-algorithms/ | Nonexistent | 404 | 1 |
Requests ▼
| ID⭥ | Method⭥ | Domain⭥ | Resource⭥ | Referrer⭥ | Status⭥ | IP Address⭥ | User Agent String ID⭥ | Timestamp⭣ | Crawler⭥ |
|---|---|---|---|---|---|---|---|---|---|
| 163789 | GET | sphaerula.com | /robots.txt | 301 | 85.208.98.18 | 1243 | 2025-06-13 15:28:47 | SemrushBot | |
| 226660 | GET | sphaerula.com | /robots.txt | http://sphaerula.com/robots.txt | 200 | 85.208.98.18 | 1243 | 2025-06-13 15:28:48 | SemrushBot |
| 163790 | HEAD | sphaerula.com | /wordpress/computing/random-shuffle-algorithms/ | 301 | 85.208.98.18 | 1243 | 2025-06-13 15:28:59 | SemrushBot | |
| 226661 | HEAD | sphaerula.com | /wordpress/computing/random-shuffle-algorithms/ | http://sphaerula.com/wordpress/computing/random-shuffle-algorithms/ | 404 | 85.208.98.18 | 1243 | 2025-06-13 15:28:59 | SemrushBot |