Activity by Crawler VelenPublicWebCrawler/1.0

Crawler

Name VelenPublicWebCrawler/1.0
Type Indexer/Scraper
Type Description Identifies HTML pages for indexing and/or scraping
Is Identified Yes
Web Page https://velen.io
Email Address
Note
User Agent Strings 1
IP Addresses 3
Resources 79
Requests 90
Requests for robots.txt 6
Earliest Request 2025-06-10 00:30:08
Latest Request 2025-06-30 18:05:38

User Agent String

1 User Agent String
ID User Agent String Requests
1076 Mozilla/5.0 (compatible; VelenPublicWebCrawler/1.0; +https://velen.io) 90

IP Addresses

3 IP Address–Crawler Combinations
IP Address Host Crawler Requests
34.34.187.232 232.187.34.34.bc.googleusercontent.com VelenPublicWebCrawler/1.0 4
35.205.80.180 180.80.205.35.bc.googleusercontent.com VelenPublicWebCrawler/1.0 5
35.205.81.8 8.81.205.35.bc.googleusercontent.com VelenPublicWebCrawler/1.0 81

Resources

Domain sphaerula.com

Resources Found

39 Resource–Status Code Combinations, 43 Requests
Resource Resource Type Status Code Requests
/blog/ HTML 200 2
/blog/about/ HTML 200 1
/blog/archives/ HTML 200 1
/blog/categories/ HTML 200 1
/blog/categories/blogging/ HTML 200 1
/blog/categories/computing/ HTML 200 1
/blog/categories/science/ HTML 200 1
/blog/categories/technology/ HTML 200 1
/blog/now/ HTML 200 1
/blog/page2/ HTML 200 1
/blog/page3/ HTML 200 1
/blog/page4/ HTML 200 1
/blog/page5/ HTML 200 1
/blog/posts/a-series-of-fortunate-events/ HTML 200 1
/blog/posts/experimenting-with-fonts/ HTML 200 1
/blog/posts/generating-and-installing-ssh-key-pair/ HTML 200 2
/blog/posts/henrietta-leavitt-overlooked-no-more/ HTML 200 1
/blog/posts/i-want-to-write/ HTML 200 1
/blog/posts/introduction-to-astrochemistry/ HTML 200 1
/blog/posts/iphone-cameras/ HTML 200 1
/blog/posts/jekyll-chirpy-theme-blog-customization/ HTML 200 1
/blog/posts/jekyll-chirpy-theme-text-and-typography/ HTML 200 1
/blog/posts/job-hunting/ HTML 200 1
/blog/posts/modifying-the-jekyll-chirpy-theme/ HTML 200 1
/blog/posts/monitoring-wordpress-failed-login-attempts/ HTML 200 1
/blog/posts/my-computers/ HTML 200 1
/blog/posts/new-science-books/ HTML 200 1
/blog/posts/orbital-mechanics/ HTML 200 1
/blog/posts/playing-with-ai/ HTML 200 1
/blog/posts/python-bytes-podcast/ HTML 200 1
/blog/posts/python-virtual-environments-in-a-dreamhost-shared-hosting-account/ HTML 200 1
/blog/posts/sean-m-carrolls-the-biggest-ideas-in-the-universe/ HTML 200 1
/blog/posts/strip-metadata-from-your-photos/ HTML 200 1
/blog/posts/the-horse-the-wheel-and-language/ HTML 200 1
/blog/posts/using-apache-httpd-mod_rewrite/ HTML 200 1
/blog/posts/using-sqlite3-with-python/ HTML 200 1
/blog/posts/web-bots-and-crawlers/ HTML 200 1
/blog/posts/wsgi-and-cgi-apps-in-a-dreamhost-shared-hosting-account/ HTML 200 1
/robots.txt Text 200 3

Resources Refused or Not Found

42 Resource–Status Code Combinations, 47 Requests
Resource Resource Type Status Code Requests
/ Redirect 301 1
/ Redirect 302 2
/blog Nonexistent 301 1
/blog/about Nonexistent 301 1
/blog/archives Nonexistent 301 1
/blog/categories Nonexistent 301 1
/blog/categories/blogging Nonexistent 301 1
/blog/categories/computing Nonexistent 301 1
/blog/categories/science Nonexistent 301 1
/blog/categories/technology Nonexistent 301 1
/blog/now Nonexistent 301 1
/blog/page2 Nonexistent 301 1
/blog/page3 Nonexistent 301 1
/blog/page4 Nonexistent 301 1
/blog/page5 Nonexistent 301 1
/blog/posts/a-series-of-fortunate-events Nonexistent 301 1
/blog/posts/experimenting-with-fonts Nonexistent 301 1
/blog/posts/generating-and-installing-ssh-key-pair Nonexistent 301 3
/blog/posts/henrietta-leavitt-overlooked-no-more Nonexistent 301 1
/blog/posts/i-want-to-write Nonexistent 301 1
/blog/posts/introduction-to-astrochemistry Nonexistent 301 1
/blog/posts/iphone-cameras Nonexistent 301 1
/blog/posts/jekyll-chirpy-theme-blog-customization Nonexistent 301 1
/blog/posts/jekyll-chirpy-theme-text-and-typography Nonexistent 301 1
/blog/posts/job-hunting Nonexistent 301 1
/blog/posts/modifying-the-jekyll-chirpy-theme Nonexistent 301 1
/blog/posts/monitoring-wordpress-failed-login-attempts Nonexistent 301 1
/blog/posts/my-computers Nonexistent 301 1
/blog/posts/new-science-books Nonexistent 301 1
/blog/posts/orbital-mechanics Nonexistent 301 1
/blog/posts/playing-with-ai Nonexistent 301 1
/blog/posts/python-bytes-podcast Nonexistent 301 1
/blog/posts/python-virtual-environments-in-a-dreamhost-shared-hosting-account Nonexistent 301 1
/blog/posts/sean-m-carrolls-the-biggest-ideas-in-the-universe Nonexistent 301 1
/blog/posts/strip-metadata-from-your-photos Nonexistent 301 1
/blog/posts/the-horse-the-wheel-and-language Nonexistent 301 1
/blog/posts/using-apache-httpd-mod_rewrite Nonexistent 301 1
/blog/posts/using-sqlite3-with-python Nonexistent 301 1
/blog/posts/web-bots-and-crawlers Nonexistent 301 1
/blog/posts/wsgi-and-cgi-apps-in-a-dreamhost-shared-hosting-account Nonexistent 301 1
/cgi/crawlers.cgi HTML 404 1
/robots.txt Text 301 3

Requests

90 Requests
ID Method Domain Resource Referrer Status IP Address User Agent String ID Timestamp Crawler
162804 GET sphaerula.com /robots.txt 301 35.205.80.180 1076 2025-06-10 00:30:08 VelenPublicWebCrawler/1.0
162805 GET sphaerula.com /blog/posts/generating-and-installing-ssh-key-pair 301 35.205.80.180 1076 2025-06-10 00:30:11 VelenPublicWebCrawler/1.0
220748 GET sphaerula.com /robots.txt http://sphaerula.com/robots.txt 200 35.205.80.180 1076 2025-06-10 00:30:11 VelenPublicWebCrawler/1.0
220749 GET sphaerula.com /blog/posts/generating-and-installing-ssh-key-pair http://sphaerula.com/blog/posts/generating-and-installing-ssh-key-pair 301 35.205.80.180 1076 2025-06-10 00:30:14 VelenPublicWebCrawler/1.0
220750 GET sphaerula.com /blog/posts/generating-and-installing-ssh-key-pair/ https://sphaerula.com/blog/posts/generating-and-installing-ssh-key-pair 200 35.205.80.180 1076 2025-06-10 00:30:16 VelenPublicWebCrawler/1.0
162856 GET sphaerula.com /robots.txt 301 35.205.81.8 1076 2025-06-10 03:22:39 VelenPublicWebCrawler/1.0
220973 GET sphaerula.com /robots.txt http://sphaerula.com/robots.txt 200 35.205.81.8 1076 2025-06-10 03:22:42 VelenPublicWebCrawler/1.0
162857 GET sphaerula.com / 301 35.205.81.8 1076 2025-06-10 03:22:44 VelenPublicWebCrawler/1.0
220975 GET sphaerula.com / http://sphaerula.com 302 35.205.81.8 1076 2025-06-10 03:22:46 VelenPublicWebCrawler/1.0
220976 GET sphaerula.com /blog/ https://sphaerula.com/ 200 35.205.81.8 1076 2025-06-10 03:22:49 VelenPublicWebCrawler/1.0
220977 GET sphaerula.com /blog 301 35.205.81.8 1076 2025-06-10 03:22:53 VelenPublicWebCrawler/1.0
220978 GET sphaerula.com /blog/about 301 35.205.81.8 1076 2025-06-10 03:22:55 VelenPublicWebCrawler/1.0
220979 GET sphaerula.com /blog/about/ https://sphaerula.com/blog/about 200 35.205.81.8 1076 2025-06-10 03:22:58 VelenPublicWebCrawler/1.0
220980 GET sphaerula.com /blog/now 301 35.205.81.8 1076 2025-06-10 03:23:00 VelenPublicWebCrawler/1.0
220981 GET sphaerula.com /blog/now/ https://sphaerula.com/blog/now 200 35.205.81.8 1076 2025-06-10 03:23:03 VelenPublicWebCrawler/1.0
220982 GET sphaerula.com /blog/archives 301 35.205.81.8 1076 2025-06-10 03:23:06 VelenPublicWebCrawler/1.0
220983 GET sphaerula.com /blog/archives/ https://sphaerula.com/blog/archives 200 35.205.81.8 1076 2025-06-10 03:23:08 VelenPublicWebCrawler/1.0
220985 GET sphaerula.com /blog/page2 301 35.205.81.8 1076 2025-06-10 03:23:12 VelenPublicWebCrawler/1.0
220986 GET sphaerula.com /blog/page2/ https://sphaerula.com/blog/page2 200 35.205.81.8 1076 2025-06-10 03:23:14 VelenPublicWebCrawler/1.0
220987 GET sphaerula.com /blog/page3 301 35.205.81.8 1076 2025-06-10 03:23:17 VelenPublicWebCrawler/1.0
220988 GET sphaerula.com /blog/page3/ https://sphaerula.com/blog/page3 200 35.205.81.8 1076 2025-06-10 03:23:19 VelenPublicWebCrawler/1.0
220989 GET sphaerula.com /blog/page5 301 35.205.81.8 1076 2025-06-10 03:23:35 VelenPublicWebCrawler/1.0
220990 GET sphaerula.com /blog/page5/ https://sphaerula.com/blog/page5 200 35.205.81.8 1076 2025-06-10 03:23:37 VelenPublicWebCrawler/1.0
220991 GET sphaerula.com /blog/posts/python-virtual-environments-in-a-dreamhost-shared-hosting-account 301 35.205.81.8 1076 2025-06-10 03:23:39 VelenPublicWebCrawler/1.0
220992 GET sphaerula.com /blog/posts/python-virtual-environments-in-a-dreamhost-shared-hosting-account/ https://sphaerula.com/blog/posts/python-virtual-environments-in-a-dreamhost-shared-hosting-account 200 35.205.81.8 1076 2025-06-10 03:23:41 VelenPublicWebCrawler/1.0
220993 GET sphaerula.com /blog/posts/wsgi-and-cgi-apps-in-a-dreamhost-shared-hosting-account 301 35.205.81.8 1076 2025-06-10 03:23:44 VelenPublicWebCrawler/1.0
220994 GET sphaerula.com /blog/posts/wsgi-and-cgi-apps-in-a-dreamhost-shared-hosting-account/ https://sphaerula.com/blog/posts/wsgi-and-cgi-apps-in-a-dreamhost-shared-hosting-account 200 35.205.81.8 1076 2025-06-10 03:23:46 VelenPublicWebCrawler/1.0
220995 GET sphaerula.com /blog/posts/web-bots-and-crawlers 301 35.205.81.8 1076 2025-06-10 03:23:58 VelenPublicWebCrawler/1.0
220997 GET sphaerula.com /blog/posts/web-bots-and-crawlers/ https://sphaerula.com/blog/posts/web-bots-and-crawlers 200 35.205.81.8 1076 2025-06-10 03:24:00 VelenPublicWebCrawler/1.0
220998 GET sphaerula.com /blog/posts/strip-metadata-from-your-photos 301 35.205.81.8 1076 2025-06-10 03:24:03 VelenPublicWebCrawler/1.0
220999 GET sphaerula.com /blog/posts/strip-metadata-from-your-photos/ https://sphaerula.com/blog/posts/strip-metadata-from-your-photos 200 35.205.81.8 1076 2025-06-10 03:24:05 VelenPublicWebCrawler/1.0
221000 GET sphaerula.com /blog/posts/using-sqlite3-with-python 301 35.205.81.8 1076 2025-06-10 03:24:15 VelenPublicWebCrawler/1.0
221001 GET sphaerula.com /blog/posts/using-sqlite3-with-python/ https://sphaerula.com/blog/posts/using-sqlite3-with-python 200 35.205.81.8 1076 2025-06-10 03:24:18 VelenPublicWebCrawler/1.0
221002 GET sphaerula.com /blog/categories 301 35.205.81.8 1076 2025-06-10 03:24:20 VelenPublicWebCrawler/1.0
221003 GET sphaerula.com /blog/categories/ https://sphaerula.com/blog/categories 200 35.205.81.8 1076 2025-06-10 03:24:22 VelenPublicWebCrawler/1.0
221004 GET sphaerula.com /cgi/crawlers.cgi 404 35.205.81.8 1076 2025-06-10 03:24:24 VelenPublicWebCrawler/1.0
221005 GET sphaerula.com /blog/posts/generating-and-installing-ssh-key-pair 301 35.205.81.8 1076 2025-06-10 03:24:27 VelenPublicWebCrawler/1.0
221006 GET sphaerula.com /blog/posts/generating-and-installing-ssh-key-pair/ https://sphaerula.com/blog/posts/generating-and-installing-ssh-key-pair 200 35.205.81.8 1076 2025-06-10 03:24:30 VelenPublicWebCrawler/1.0
221007 GET sphaerula.com /blog/posts/using-apache-httpd-mod_rewrite 301 35.205.81.8 1076 2025-06-10 03:24:46 VelenPublicWebCrawler/1.0
221008 GET sphaerula.com /blog/posts/using-apache-httpd-mod_rewrite/ https://sphaerula.com/blog/posts/using-apache-httpd-mod_rewrite 200 35.205.81.8 1076 2025-06-10 03:24:48 VelenPublicWebCrawler/1.0
221009 GET sphaerula.com /blog/posts/experimenting-with-fonts 301 35.205.81.8 1076 2025-06-10 03:24:50 VelenPublicWebCrawler/1.0
221010 GET sphaerula.com /blog/posts/experimenting-with-fonts/ https://sphaerula.com/blog/posts/experimenting-with-fonts 200 35.205.81.8 1076 2025-06-10 03:24:53 VelenPublicWebCrawler/1.0
221011 GET sphaerula.com /blog/posts/jekyll-chirpy-theme-text-and-typography 301 35.205.81.8 1076 2025-06-10 03:25:06 VelenPublicWebCrawler/1.0
221012 GET sphaerula.com /blog/posts/jekyll-chirpy-theme-text-and-typography/ https://sphaerula.com/blog/posts/jekyll-chirpy-theme-text-and-typography 200 35.205.81.8 1076 2025-06-10 03:25:08 VelenPublicWebCrawler/1.0
221013 GET sphaerula.com /blog/posts/my-computers 301 35.205.81.8 1076 2025-06-10 03:25:18 VelenPublicWebCrawler/1.0
221014 GET sphaerula.com /blog/posts/my-computers/ https://sphaerula.com/blog/posts/my-computers 200 35.205.81.8 1076 2025-06-10 03:25:20 VelenPublicWebCrawler/1.0
221015 GET sphaerula.com /blog/posts/modifying-the-jekyll-chirpy-theme 301 35.205.81.8 1076 2025-06-10 03:25:23 VelenPublicWebCrawler/1.0
221016 GET sphaerula.com /blog/posts/modifying-the-jekyll-chirpy-theme/ https://sphaerula.com/blog/posts/modifying-the-jekyll-chirpy-theme 200 35.205.81.8 1076 2025-06-10 03:25:25 VelenPublicWebCrawler/1.0
221017 GET sphaerula.com /blog/posts/a-series-of-fortunate-events 301 35.205.81.8 1076 2025-06-10 03:25:29 VelenPublicWebCrawler/1.0
221018 GET sphaerula.com /blog/posts/a-series-of-fortunate-events/ https://sphaerula.com/blog/posts/a-series-of-fortunate-events 200 35.205.81.8 1076 2025-06-10 03:25:31 VelenPublicWebCrawler/1.0
221019 GET sphaerula.com /blog/posts/job-hunting 301 35.205.81.8 1076 2025-06-10 03:25:46 VelenPublicWebCrawler/1.0
221020 GET sphaerula.com /blog/posts/job-hunting/ https://sphaerula.com/blog/posts/job-hunting 200 35.205.81.8 1076 2025-06-10 03:25:50 VelenPublicWebCrawler/1.0
221021 GET sphaerula.com /blog/posts/playing-with-ai 301 35.205.81.8 1076 2025-06-10 03:26:04 VelenPublicWebCrawler/1.0
221022 GET sphaerula.com /blog/posts/playing-with-ai/ https://sphaerula.com/blog/posts/playing-with-ai 200 35.205.81.8 1076 2025-06-10 03:26:06 VelenPublicWebCrawler/1.0
221023 GET sphaerula.com /blog/posts/python-bytes-podcast 301 35.205.81.8 1076 2025-06-10 03:26:09 VelenPublicWebCrawler/1.0
221024 GET sphaerula.com /blog/posts/python-bytes-podcast/ https://sphaerula.com/blog/posts/python-bytes-podcast 200 35.205.81.8 1076 2025-06-10 03:26:11 VelenPublicWebCrawler/1.0
221025 GET sphaerula.com /blog/posts/new-science-books 301 35.205.81.8 1076 2025-06-10 03:26:19 VelenPublicWebCrawler/1.0
221026 GET sphaerula.com /blog/posts/new-science-books/ https://sphaerula.com/blog/posts/new-science-books 200 35.205.81.8 1076 2025-06-10 03:26:22 VelenPublicWebCrawler/1.0
221027 GET sphaerula.com /blog/posts/henrietta-leavitt-overlooked-no-more 301 35.205.81.8 1076 2025-06-10 03:26:32 VelenPublicWebCrawler/1.0
221028 GET sphaerula.com /blog/posts/henrietta-leavitt-overlooked-no-more/ https://sphaerula.com/blog/posts/henrietta-leavitt-overlooked-no-more 200 35.205.81.8 1076 2025-06-10 03:26:34 VelenPublicWebCrawler/1.0
221029 GET sphaerula.com /blog/posts/introduction-to-astrochemistry 301 35.205.81.8 1076 2025-06-10 03:26:45 VelenPublicWebCrawler/1.0
221030 GET sphaerula.com /blog/posts/introduction-to-astrochemistry/ https://sphaerula.com/blog/posts/introduction-to-astrochemistry 200 35.205.81.8 1076 2025-06-10 03:26:47 VelenPublicWebCrawler/1.0
221031 GET sphaerula.com /blog/posts/sean-m-carrolls-the-biggest-ideas-in-the-universe 301 35.205.81.8 1076 2025-06-10 03:26:53 VelenPublicWebCrawler/1.0
221032 GET sphaerula.com /blog/posts/sean-m-carrolls-the-biggest-ideas-in-the-universe/ https://sphaerula.com/blog/posts/sean-m-carrolls-the-biggest-ideas-in-the-universe 200 35.205.81.8 1076 2025-06-10 03:26:55 VelenPublicWebCrawler/1.0
221033 GET sphaerula.com /blog/posts/monitoring-wordpress-failed-login-attempts 301 35.205.81.8 1076 2025-06-10 03:26:58 VelenPublicWebCrawler/1.0
221034 GET sphaerula.com /blog/posts/monitoring-wordpress-failed-login-attempts/ https://sphaerula.com/blog/posts/monitoring-wordpress-failed-login-attempts 200 35.205.81.8 1076 2025-06-10 03:27:00 VelenPublicWebCrawler/1.0
221035 GET sphaerula.com /blog/posts/i-want-to-write 301 35.205.81.8 1076 2025-06-10 03:27:02 VelenPublicWebCrawler/1.0
221036 GET sphaerula.com /blog/posts/i-want-to-write/ https://sphaerula.com/blog/posts/i-want-to-write 200 35.205.81.8 1076 2025-06-10 03:27:05 VelenPublicWebCrawler/1.0
221037 GET sphaerula.com /blog/posts/iphone-cameras 301 35.205.81.8 1076 2025-06-10 03:27:07 VelenPublicWebCrawler/1.0
221038 GET sphaerula.com /blog/posts/iphone-cameras/ https://sphaerula.com/blog/posts/iphone-cameras 200 35.205.81.8 1076 2025-06-10 03:27:10 VelenPublicWebCrawler/1.0
221039 GET sphaerula.com /blog/posts/jekyll-chirpy-theme-blog-customization 301 35.205.81.8 1076 2025-06-10 03:27:19 VelenPublicWebCrawler/1.0
221040 GET sphaerula.com /blog/posts/jekyll-chirpy-theme-blog-customization/ https://sphaerula.com/blog/posts/jekyll-chirpy-theme-blog-customization 200 35.205.81.8 1076 2025-06-10 03:27:22 VelenPublicWebCrawler/1.0
221041 GET sphaerula.com /blog/posts/the-horse-the-wheel-and-language 301 35.205.81.8 1076 2025-06-10 03:27:25 VelenPublicWebCrawler/1.0
221042 GET sphaerula.com /blog/posts/the-horse-the-wheel-and-language/ https://sphaerula.com/blog/posts/the-horse-the-wheel-and-language 200 35.205.81.8 1076 2025-06-10 03:27:28 VelenPublicWebCrawler/1.0
221043 GET sphaerula.com /blog/posts/orbital-mechanics 301 35.205.81.8 1076 2025-06-10 03:27:38 VelenPublicWebCrawler/1.0
221044 GET sphaerula.com /blog/posts/orbital-mechanics/ https://sphaerula.com/blog/posts/orbital-mechanics 200 35.205.81.8 1076 2025-06-10 03:27:41 VelenPublicWebCrawler/1.0
221045 GET sphaerula.com /blog/page4 301 35.205.81.8 1076 2025-06-10 03:27:52 VelenPublicWebCrawler/1.0
221046 GET sphaerula.com /blog/page4/ https://sphaerula.com/blog/page4 200 35.205.81.8 1076 2025-06-10 03:27:54 VelenPublicWebCrawler/1.0
221047 GET sphaerula.com /blog/categories/computing 301 35.205.81.8 1076 2025-06-10 03:28:04 VelenPublicWebCrawler/1.0
221048 GET sphaerula.com /blog/categories/computing/ https://sphaerula.com/blog/categories/computing 200 35.205.81.8 1076 2025-06-10 03:28:06 VelenPublicWebCrawler/1.0
221049 GET sphaerula.com /blog/categories/blogging 301 35.205.81.8 1076 2025-06-10 03:28:08 VelenPublicWebCrawler/1.0
221050 GET sphaerula.com /blog/categories/blogging/ https://sphaerula.com/blog/categories/blogging 200 35.205.81.8 1076 2025-06-10 03:28:11 VelenPublicWebCrawler/1.0
221051 GET sphaerula.com /blog/categories/science 301 35.205.81.8 1076 2025-06-10 03:28:13 VelenPublicWebCrawler/1.0
221052 GET sphaerula.com /blog/categories/science/ https://sphaerula.com/blog/categories/science 200 35.205.81.8 1076 2025-06-10 03:28:16 VelenPublicWebCrawler/1.0
221053 GET sphaerula.com /blog/categories/technology 301 35.205.81.8 1076 2025-06-10 03:28:18 VelenPublicWebCrawler/1.0
221054 GET sphaerula.com /blog/categories/technology/ https://sphaerula.com/blog/categories/technology 200 35.205.81.8 1076 2025-06-10 03:28:20 VelenPublicWebCrawler/1.0
152027 GET sphaerula.com /robots.txt 301 34.34.187.232 1076 2025-06-30 18:05:33 VelenPublicWebCrawler/1.0
190582 GET sphaerula.com /robots.txt http://sphaerula.com/robots.txt 200 34.34.187.232 1076 2025-06-30 18:05:36 VelenPublicWebCrawler/1.0
190583 GET sphaerula.com / 302 34.34.187.232 1076 2025-06-30 18:05:36 VelenPublicWebCrawler/1.0
190584 GET sphaerula.com /blog/ https://sphaerula.com 200 34.34.187.232 1076 2025-06-30 18:05:38 VelenPublicWebCrawler/1.0