Activity by Crawler Scrapy/2.12.0

Crawler

Name Scrapy/2.12.0
Type Indexer/Scraper
Type Description Identifies HTML pages for indexing and/or scraping
Is Identified Yes
Web Page https://scrapy.org
Email Address
Note
User Agent Strings 1
IP Addresses 16
Resources 4
Requests 33
Requests for robots.txt 0
Earliest Request 2025-04-16 10:10:18
Latest Request 2025-08-24 21:46:28

User Agent String

1 User Agent String
ID User Agent String Requests
261 Scrapy/2.12.0 (+https://scrapy.org) 33

IP Addresses

16 IP Address–Crawler Combinations
IP Address Host Crawler Requests
34.34.21.42 42.21.34.34.bc.googleusercontent.com Scrapy/2.12.0 2
34.34.49.206 206.49.34.34.bc.googleusercontent.com Scrapy/2.12.0 2
34.90.118.162 162.118.90.34.bc.googleusercontent.com Scrapy/2.12.0 1
34.90.220.251 251.220.90.34.bc.googleusercontent.com Scrapy/2.12.0 2
34.91.65.13 13.65.91.34.bc.googleusercontent.com Scrapy/2.12.0 2
34.91.100.7 7.100.91.34.bc.googleusercontent.com Scrapy/2.12.0 2
34.91.125.183 183.125.91.34.bc.googleusercontent.com Scrapy/2.12.0 2
34.141.147.241 241.147.141.34.bc.googleusercontent.com Scrapy/2.12.0 3
34.141.189.20 20.189.141.34.bc.googleusercontent.com Scrapy/2.12.0 4
34.141.217.239 239.217.141.34.bc.googleusercontent.com Scrapy/2.12.0 2
34.141.229.34 34.229.141.34.bc.googleusercontent.com Scrapy/2.12.0 2
34.147.16.58 58.16.147.34.bc.googleusercontent.com Scrapy/2.12.0 4
34.147.27.237 237.27.147.34.bc.googleusercontent.com Scrapy/2.12.0 2
34.147.28.155 155.28.147.34.bc.googleusercontent.com Scrapy/2.12.0 1
34.147.80.73 73.80.147.34.bc.googleusercontent.com Scrapy/2.12.0 1
35.204.16.32 32.16.204.35.bc.googleusercontent.com Scrapy/2.12.0 1

Resources

Domain conradhalling.com

Resources Found

1 Resource–Status Code Combination, 5 Requests
Resource Resource Type Status Code Requests
/blog/ HTML 200 5

Resources Refused or Not Found

2 Resource–Status Code Combinations, 10 Requests
Resource Resource Type Status Code Requests
/ Redirect 302 5
/ Redirect 429 5

Domain sphaerula.com

Resources Found

2 Resource–Status Code Combinations, 10 Requests
Resource Resource Type Status Code Requests
/ Redirect 200 2
/blog/ HTML 200 8

Resources Refused or Not Found

1 Resource–Status Code Combination, 8 Requests
Resource Resource Type Status Code Requests
/ Redirect 302 8

Requests

33 Requests
ID Method Domain Resource Referrer Status IP Address User Agent String ID Timestamp Crawler
185241 GET sphaerula.com / 302 34.141.147.241 261 2025-04-16 10:10:18 Scrapy/2.12.0
185242 GET sphaerula.com /blog/ 200 34.141.147.241 261 2025-04-16 10:10:18 Scrapy/2.12.0
33371 GET conradhalling.com / 302 34.91.65.13 261 2025-04-22 10:05:31 Scrapy/2.12.0
33372 GET conradhalling.com /blog/ 200 34.91.65.13 261 2025-04-22 10:05:31 Scrapy/2.12.0
34311 GET conradhalling.com / 429 34.141.229.34 261 2025-04-24 03:18:05 Scrapy/2.12.0
189600 GET sphaerula.com / 302 34.91.125.183 261 2025-04-29 19:06:23 Scrapy/2.12.0
189601 GET sphaerula.com /blog/ 200 34.91.125.183 261 2025-04-29 19:06:24 Scrapy/2.12.0
249902 GET sphaerula.com / 302 34.34.21.42 261 2025-05-14 21:33:12 Scrapy/2.12.0
249903 GET sphaerula.com /blog/ 200 34.34.21.42 261 2025-05-14 21:33:12 Scrapy/2.12.0
62032 GET conradhalling.com / 429 34.141.229.34 261 2025-05-22 10:44:29 Scrapy/2.12.0
63725 GET conradhalling.com / 302 34.91.100.7 261 2025-05-24 03:19:49 Scrapy/2.12.0
63726 GET conradhalling.com /blog/ 200 34.91.100.7 261 2025-05-24 03:19:49 Scrapy/2.12.0
259480 GET sphaerula.com / 302 34.147.27.237 261 2025-05-29 14:08:17 Scrapy/2.12.0
259481 GET sphaerula.com /blog/ 200 34.147.27.237 261 2025-05-29 14:08:17 Scrapy/2.12.0
227044 GET sphaerula.com / 302 34.141.189.20 261 2025-06-13 22:05:48 Scrapy/2.12.0
227045 GET sphaerula.com /blog/ 200 34.141.189.20 261 2025-06-13 22:05:48 Scrapy/2.12.0
101327 GET conradhalling.com / 302 34.141.217.239 261 2025-06-23 12:32:21 Scrapy/2.12.0
101328 GET conradhalling.com /blog/ 200 34.141.217.239 261 2025-06-23 12:32:21 Scrapy/2.12.0
101506 GET conradhalling.com / 302 34.147.16.58 261 2025-06-23 21:55:19 Scrapy/2.12.0
101507 GET conradhalling.com /blog/ 200 34.147.16.58 261 2025-06-23 21:55:19 Scrapy/2.12.0
243095 GET sphaerula.com / 302 34.34.49.206 261 2025-06-30 02:43:52 Scrapy/2.12.0
243096 GET sphaerula.com /blog/ 200 34.34.49.206 261 2025-06-30 02:43:53 Scrapy/2.12.0
199245 GET sphaerula.com / 302 34.90.220.251 261 2025-07-13 23:56:22 Scrapy/2.12.0
199246 GET sphaerula.com /blog/ 200 34.90.220.251 261 2025-07-13 23:56:22 Scrapy/2.12.0
134205 GET conradhalling.com / 302 34.141.189.20 261 2025-07-24 10:04:46 Scrapy/2.12.0
134206 GET conradhalling.com /blog/ 200 34.141.189.20 261 2025-07-24 10:04:46 Scrapy/2.12.0
134415 GET conradhalling.com / 429 34.147.80.73 261 2025-07-24 20:47:23 Scrapy/2.12.0
262818 GET sphaerula.com / 200 34.147.28.155 261 2025-07-25 19:14:41 Scrapy/2.12.0
297941 GET sphaerula.com / 302 34.147.16.58 261 2025-08-12 22:00:50 Scrapy/2.12.0
297942 GET sphaerula.com /blog/ 200 34.147.16.58 261 2025-08-12 22:00:50 Scrapy/2.12.0
313250 GET conradhalling.com / 429 34.141.147.241 261 2025-08-23 10:26:25 Scrapy/2.12.0
313555 GET conradhalling.com / 429 34.90.118.162 261 2025-08-23 22:15:51 Scrapy/2.12.0
323076 GET sphaerula.com / 200 35.204.16.32 261 2025-08-24 21:46:28 Scrapy/2.12.0