Activity by Crawler SurdotlyBot/1.0

Crawler

Name SurdotlyBot/1.0
Type Indexer/Scraper
Type Description Identifies HTML pages for indexing and/or scraping
Is Identified Yes
Web Page ttp://sur.ly/bot.html
Email Address
Note
User Agent Strings 1
IP Addresses 2
Resources 3
Requests 22
Requests for robots.txt 3
Earliest Request 2025-04-04 02:34:14
Latest Request 2025-08-19 11:14:18

User Agent String

1 User Agent String
ID User Agent String Requests
1500 Mozilla/5.0 (compatible; SurdotlyBot/1.0; +http://sur.ly/bot.html) 22

IP Addresses

2 IP Address–Crawler Combinations
IP Address Host Crawler Requests
34.232.23.139 ec2-34-232-23-139.compute-1.amazonaws.com SurdotlyBot/1.0 5
52.206.84.190 ec2-52-206-84-190.compute-1.amazonaws.com SurdotlyBot/1.0 17

Resources

Domain sphaerula.com

Resources Found

3 Resource–Status Code Combinations, 12 Requests
Resource Resource Type Status Code Requests
/ Redirect 200 1
/blog/ HTML 200 9
/robots.txt Text 200 2

Resources Refused or Not Found

2 Resource–Status Code Combinations, 10 Requests
Resource Resource Type Status Code Requests
/ Redirect 302 9
/robots.txt Text 404 1

Requests

22 Requests
ID Method Domain Resource Referrer Status IP Address User Agent String ID Timestamp Crawler
181889 GET sphaerula.com / 302 34.232.23.139 1500 2025-04-04 02:34:14 SurdotlyBot/1.0
181890 GET sphaerula.com /blog/ 200 34.232.23.139 1500 2025-04-04 02:34:14 SurdotlyBot/1.0
181937 GET sphaerula.com / 302 52.206.84.190 1500 2025-04-04 06:19:34 SurdotlyBot/1.0
181938 GET sphaerula.com /blog/ 200 52.206.84.190 1500 2025-04-04 06:19:35 SurdotlyBot/1.0
181939 GET sphaerula.com / 302 52.206.84.190 1500 2025-04-04 06:19:35 SurdotlyBot/1.0
181940 GET sphaerula.com /blog/ 200 52.206.84.190 1500 2025-04-04 06:19:35 SurdotlyBot/1.0
181941 GET sphaerula.com /robots.txt 404 52.206.84.190 1500 2025-04-04 06:19:35 SurdotlyBot/1.0
189093 GET sphaerula.com / 302 34.232.23.139 1500 2025-04-28 09:04:03 SurdotlyBot/1.0
189094 GET sphaerula.com /blog/ 200 34.232.23.139 1500 2025-04-28 09:04:03 SurdotlyBot/1.0
225868 GET sphaerula.com / 302 52.206.84.190 1500 2025-06-13 03:59:24 SurdotlyBot/1.0
225869 GET sphaerula.com /blog/ 200 52.206.84.190 1500 2025-06-13 03:59:24 SurdotlyBot/1.0
225870 GET sphaerula.com / 302 52.206.84.190 1500 2025-06-13 03:59:25 SurdotlyBot/1.0
225871 GET sphaerula.com /blog/ 200 52.206.84.190 1500 2025-06-13 03:59:25 SurdotlyBot/1.0
225872 GET sphaerula.com /robots.txt 200 52.206.84.190 1500 2025-06-13 03:59:25 SurdotlyBot/1.0
235843 GET sphaerula.com / 302 52.206.84.190 1500 2025-06-22 03:14:00 SurdotlyBot/1.0
235844 GET sphaerula.com /blog/ 200 52.206.84.190 1500 2025-06-22 03:14:00 SurdotlyBot/1.0
307795 GET sphaerula.com / 302 52.206.84.190 1500 2025-08-19 06:21:26 SurdotlyBot/1.0
307796 GET sphaerula.com /blog/ 200 52.206.84.190 1500 2025-08-19 06:21:26 SurdotlyBot/1.0
307797 GET sphaerula.com / 302 52.206.84.190 1500 2025-08-19 06:21:27 SurdotlyBot/1.0
307798 GET sphaerula.com /blog/ 200 52.206.84.190 1500 2025-08-19 06:21:27 SurdotlyBot/1.0
307799 GET sphaerula.com /robots.txt 200 52.206.84.190 1500 2025-08-19 06:21:27 SurdotlyBot/1.0
307876 GET sphaerula.com / 200 34.232.23.139 1500 2025-08-19 11:14:18 SurdotlyBot/1.0