Activity by Crawler Screaming Frog SEO Spider/20.2

Crawler

Name Screaming Frog SEO Spider/20.2
Type Indexer/Scraper
Type Description Identifies HTML pages for indexing and/or scraping
Is Identified Yes
Web Page https://www.screamingfrog.co.uk/seo-spider/
Email Address
Note
User Agent Strings 1
IP Addresses 4
Resources 6
Requests 7
Requests for robots.txt 0
Earliest Request 2025-04-06 04:13:11
Latest Request 2025-08-20 23:10:19

User Agent String

1 User Agent String
ID User Agent String Requests
257 Screaming Frog SEO Spider/20.2 7

IP Addresses

4 IP Address–Crawler Combinations
IP Address Host Crawler Requests
42.118.115.94 Screaming Frog SEO Spider/20.2 2
45.133.172.140 Screaming Frog SEO Spider/20.2 2
118.68.23.75 Screaming Frog SEO Spider/20.2 2
173.239.194.50 Screaming Frog SEO Spider/20.2 1

Resources

Domain conradhalling.com

Resources Found

1 Resource–Status Code Combination, 1 Request
Resource Resource Type Status Code Requests
/blog/ HTML 200 1

Resources Refused or Not Found

2 Resource–Status Code Combinations, 2 Requests
Resource Resource Type Status Code Requests
/ Redirect 302 1
/index.php?route=information/sitemap Nonexistent 404 1

Domain sphaerula.com

Resources Found

1 Resource–Status Code Combination, 1 Request
Resource Resource Type Status Code Requests
/blog/ HTML 200 1

Resources Refused or Not Found

3 Resource–Status Code Combinations, 3 Requests
Resource Resource Type Status Code Requests
/ Redirect 302 1
/index.php?route=information/sitemap Nonexistent 301 1
/index.php?route=information/sitemap Nonexistent 404 1

Requests

7 Requests
ID Method Domain Resource Referrer Status IP Address User Agent String ID Timestamp Crawler
137183 GET sphaerula.com / 302 118.68.23.75 257 2025-04-06 04:13:11 Screaming Frog SEO Spider/20.2
137310 GET sphaerula.com /blog/ 200 118.68.23.75 257 2025-04-06 18:27:05 Screaming Frog SEO Spider/20.2
32797 GET conradhalling.com / 302 42.118.115.94 257 2025-04-21 16:50:46 Screaming Frog SEO Spider/20.2
33350 GET conradhalling.com /blog/ 200 42.118.115.94 257 2025-04-22 08:30:45 Screaming Frog SEO Spider/20.2
289337 GET sphaerula.com /index.php?route=information/sitemap 301 45.133.172.140 257 2025-08-03 19:53:17 Screaming Frog SEO Spider/20.2
292254 GET sphaerula.com /index.php?route=information/sitemap 404 45.133.172.140 257 2025-08-03 22:03:43 Screaming Frog SEO Spider/20.2
309665 GET conradhalling.com /index.php?route=information/sitemap 404 173.239.194.50 257 2025-08-20 23:10:19 Screaming Frog SEO Spider/20.2