CRAWLER BEHAVIOR REPORT #008
============================================================
Generated: 2026-02-07
Crawler: Amazonbot

SUMMARY
----------------------------------------
Total requests observed: 51,139
Unique pages crawled: 11,759
Average response time: 0.822s
Bandwidth consumed: 16.23 GB

DETAILED LOG ENTRIES
----------------------------------------
  [2026-02-10T04:02:20Z] GET /.env -> 304 (28,381 bytes)
  [2026-02-10T10:45:12Z] GET /data.json -> 200 (4,972 bytes)
  [2026-02-05T11:46:43Z] GET /sitemap.xml -> 404 (100,270 bytes)
  [2026-02-19T14:50:01Z] GET /data.json -> 200 (125,486 bytes)
  [2026-02-16T06:10:30Z] GET /nonexistent-page -> 304 (44,851 bytes)
  [2026-02-15T00:53:51Z] GET /wp-login.php -> 200 (55,234 bytes)
  [2026-02-11T15:46:57Z] GET /photo.webp -> 404 (96,030 bytes)
  [2026-02-14T17:14:54Z] GET /app.js -> 200 (63,994 bytes)
  [2026-02-11T12:18:18Z] GET /banner.jpg -> 200 (79,761 bytes)
  [2026-02-10T00:12:03Z] GET /api/test -> 304 (106,827 bytes)
  [2026-02-01T05:23:51Z] GET /wp-admin/ -> 200 (145,063 bytes)
  [2026-02-13T09:41:30Z] GET /index.html -> 200 (21,744 bytes)
  [2026-02-08T12:12:16Z] GET /app.js -> 200 (81,270 bytes)
  [2026-02-10T06:12:26Z] GET /icon.gif -> 200 (133,762 bytes)
  [2026-02-09T10:39:16Z] GET /api/test -> 304 (45,397 bytes)
  [2026-02-01T21:12:21Z] GET /robots.txt -> 200 (9,553 bytes)
  [2026-02-04T22:51:46Z] GET /logo.png -> 404 (14,397 bytes)
  [2026-02-04T15:31:37Z] GET /photo.webp -> 200 (163,147 bytes)
  [2026-02-07T17:33:52Z] GET /humans.txt -> 200 (60,338 bytes)
  [2026-02-19T03:11:58Z] GET /about.html -> 304 (29,400 bytes)
  [2026-02-08T03:00:36Z] GET /robots.txt -> 200 (161,508 bytes)
  [2026-02-07T12:41:20Z] GET /wp-admin/ -> 200 (3,962 bytes)
  [2026-02-04T17:56:54Z] GET / -> 304 (70,659 bytes)
  [2026-02-16T09:35:04Z] GET /sitemap.xml -> 200 (146,625 bytes)
  [2026-02-03T22:57:38Z] GET /index.html -> 200 (143,078 bytes)
  [2026-02-10T19:02:30Z] GET /diagram.svg -> 200 (154,529 bytes)
  [2026-02-02T06:21:19Z] GET /readme.txt -> 200 (14,856 bytes)
  [2026-02-02T12:04:33Z] GET /data.json -> 200 (100,622 bytes)
  [2026-02-06T21:52:29Z] GET /manifest.json -> 200 (89,316 bytes)
  [2026-02-08T14:42:11Z] GET /feed.xml -> 200 (50,386 bytes)
  [2026-02-12T09:49:36Z] GET /api/test -> 200 (116,088 bytes)
  [2026-02-11T10:24:32Z] GET /data.json -> 200 (64,159 bytes)
  [2026-02-10T12:22:22Z] GET /config -> 200 (31,604 bytes)
  [2026-02-04T09:26:02Z] GET /index.html -> 200 (115,369 bytes)
  [2026-02-09T01:23:17Z] GET /config -> 200 (70,179 bytes)
  [2026-02-19T05:12:23Z] GET /humans.txt -> 200 (147,018 bytes)
  [2026-02-01T09:55:12Z] GET /icon.gif -> 200 (33,598 bytes)
  [2026-02-16T21:29:43Z] GET /app.js -> 200 (80,521 bytes)
  [2026-02-09T03:22:47Z] GET /diagram.svg -> 404 (120,249 bytes)
  [2026-02-01T01:07:19Z] GET / -> 200 (106,664 bytes)
  [2026-02-16T03:10:51Z] GET /config -> 200 (163,878 bytes)
  [2026-02-08T15:50:24Z] GET /sitemap.xml -> 304 (141,047 bytes)
  [2026-02-18T20:52:15Z] GET / -> 404 (153,288 bytes)
  [2026-02-02T18:56:19Z] GET /icon.gif -> 200 (46,268 bytes)
  [2026-02-11T05:39:19Z] GET /nonexistent-page -> 200 (137,382 bytes)
  [2026-02-17T02:12:19Z] GET /diagram.svg -> 304 (52,657 bytes)
  [2026-02-18T06:12:50Z] GET /wp-admin/ -> 404 (22,730 bytes)
  [2026-02-07T21:46:29Z] GET / -> 200 (111,644 bytes)
  [2026-02-14T06:52:14Z] GET /.git/config -> 200 (189,881 bytes)
  [2026-02-08T06:34:50Z] GET /api/test -> 404 (50,312 bytes)
  [2026-02-03T12:51:25Z] GET /about.html -> 200 (22,394 bytes)
  [2026-02-15T00:45:58Z] GET /humans.txt -> 200 (31,830 bytes)
  [2026-02-09T08:48:30Z] GET /photo.webp -> 200 (170,964 bytes)
  [2026-02-15T22:25:27Z] GET /about.html -> 200 (142,284 bytes)
  [2026-02-19T06:27:13Z] GET /readme.txt -> 200 (165,877 bytes)
  [2026-02-16T04:51:11Z] GET /index.html -> 200 (29,804 bytes)
  [2026-02-09T12:10:58Z] GET /diagram.svg -> 200 (97,265 bytes)
  [2026-02-02T18:34:22Z] GET /logo.png -> 200 (36,807 bytes)
  [2026-02-03T20:42:28Z] GET /config -> 200 (156,092 bytes)
  [2026-02-18T23:42:42Z] GET /config -> 304 (183,026 bytes)
  [2026-02-11T11:27:30Z] GET /logo.png -> 404 (55,802 bytes)
  [2026-02-08T21:34:11Z] GET / -> 200 (85,226 bytes)
  [2026-02-03T21:58:26Z] GET /sitemap.xml -> 200 (101,078 bytes)
  [2026-02-17T13:03:28Z] GET /diagram.svg -> 404 (5,083 bytes)
  [2026-02-05T06:20:08Z] GET /photo.webp -> 200 (153,627 bytes)
  [2026-02-17T05:18:04Z] GET /manifest.json -> 200 (3,664 bytes)
  [2026-02-05T00:10:53Z] GET /diagram.svg -> 200 (52,595 bytes)
  [2026-02-07T04:57:25Z] GET / -> 200 (44,260 bytes)
  [2026-02-15T09:52:13Z] GET /robots.txt -> 200 (186,994 bytes)
  [2026-02-15T22:45:29Z] GET /.env -> 304 (78,378 bytes)
  [2026-02-15T19:13:23Z] GET /app.js -> 404 (78,317 bytes)
  [2026-02-06T01:39:22Z] GET /logo.png -> 200 (135,124 bytes)
  [2026-02-04T23:43:55Z] GET /banner.jpg -> 304 (94,218 bytes)
  [2026-02-06T08:20:03Z] GET /api/test -> 200 (145,503 bytes)
  [2026-02-12T04:45:07Z] GET /readme.txt -> 200 (58,752 bytes)
  [2026-02-03T23:30:34Z] GET /index.html -> 200 (21,410 bytes)
  [2026-02-01T15:02:48Z] GET /robots.txt -> 200 (66,972 bytes)
  [2026-02-12T06:45:27Z] GET /.env -> 304 (41,575 bytes)
  [2026-02-19T04:45:14Z] GET /photo.webp -> 200 (128,944 bytes)
  [2026-02-19T08:11:17Z] GET /config -> 200 (149,722 bytes)
  [2026-02-02T11:23:49Z] GET /app.js -> 304 (125,300 bytes)
  [2026-02-03T08:50:23Z] GET /humans.txt -> 200 (115,277 bytes)
  [2026-02-05T06:32:45Z] GET /sitemap.xml -> 200 (105,652 bytes)
  [2026-02-19T18:58:11Z] GET /nonexistent-page -> 404 (153,737 bytes)
  [2026-02-19T00:14:17Z] GET /readme.txt -> 404 (125,800 bytes)
  [2026-02-13T05:24:31Z] GET /readme.txt -> 404 (62,383 bytes)
  [2026-02-07T04:40:16Z] GET /index.html -> 200 (65,722 bytes)
  [2026-02-07T05:36:26Z] GET /app.js -> 200 (58,591 bytes)
  [2026-02-16T09:09:02Z] GET /wp-admin/ -> 200 (94,876 bytes)
  [2026-02-17T10:26:50Z] GET /feed.xml -> 304 (91,759 bytes)
  [2026-02-08T11:58:06Z] GET /nonexistent-page -> 304 (44,722 bytes)
  [2026-02-12T09:13:22Z] GET /manifest.json -> 200 (148,268 bytes)
  [2026-02-15T14:38:42Z] GET /config -> 200 (85,033 bytes)
  [2026-02-16T20:32:59Z] GET /about.html -> 404 (55,006 bytes)
  [2026-02-08T07:22:28Z] GET /.git/config -> 200 (154,242 bytes)
  [2026-02-19T08:07:56Z] GET /robots.txt -> 200 (81,402 bytes)
  [2026-02-12T11:33:48Z] GET /.env -> 404 (85,699 bytes)
  [2026-02-18T17:21:43Z] GET /photo.webp -> 200 (161,944 bytes)
  [2026-02-15T19:45:37Z] GET /style.css -> 200 (115,902 bytes)
  [2026-02-18T19:22:27Z] GET /wp-login.php -> 200 (172,559 bytes)
  [2026-02-08T20:00:53Z] GET /.env -> 200 (106,640 bytes)
  [2026-02-12T06:59:12Z] GET / -> 200 (90,306 bytes)
  [2026-02-11T21:23:40Z] GET /banner.jpg -> 200 (183,677 bytes)
  [2026-02-16T06:11:59Z] GET /diagram.svg -> 200 (30,451 bytes)
  [2026-02-01T06:35:59Z] GET /photo.webp -> 200 (19,669 bytes)
  [2026-02-02T14:45:31Z] GET /wp-login.php -> 200 (9,313 bytes)
  [2026-02-03T16:33:50Z] GET /icon.gif -> 304 (180,132 bytes)
  [2026-02-02T20:38:47Z] GET /style.css -> 200 (184,562 bytes)
  [2026-02-08T00:56:19Z] GET /wp-login.php -> 404 (48,850 bytes)
  [2026-02-08T08:39:09Z] GET /style.css -> 404 (15,864 bytes)
  [2026-02-06T00:31:56Z] GET /app.js -> 404 (50,695 bytes)
  [2026-02-10T11:57:50Z] GET /icon.gif -> 404 (169,871 bytes)
  [2026-02-12T19:25:51Z] GET /feed.xml -> 200 (169,367 bytes)
  [2026-02-19T07:08:20Z] GET /banner.jpg -> 304 (61,435 bytes)
  [2026-02-02T23:08:20Z] GET /wp-admin/ -> 304 (136,997 bytes)
  [2026-02-01T12:54:20Z] GET /.git/config -> 304 (318 bytes)
  [2026-02-09T08:03:49Z] GET /about.html -> 200 (85,583 bytes)
  [2026-02-04T05:36:10Z] GET / -> 200 (166,377 bytes)
  [2026-02-01T11:32:08Z] GET /banner.jpg -> 304 (57,099 bytes)
  [2026-02-10T17:51:27Z] GET /manifest.json -> 200 (113,075 bytes)
  [2026-02-17T07:19:09Z] GET /sitemap.xml -> 200 (84,303 bytes)
  [2026-02-14T20:32:42Z] GET /readme.txt -> 404 (19,619 bytes)
  [2026-02-02T19:39:13Z] GET /photo.webp -> 200 (20,105 bytes)
  [2026-02-17T11:13:16Z] GET / -> 404 (163,212 bytes)
  [2026-02-14T14:48:32Z] GET /robots.txt -> 200 (187,489 bytes)
  [2026-02-12T22:33:45Z] GET /about.html -> 200 (190,016 bytes)
  [2026-02-09T09:07:15Z] GET /wp-admin/ -> 200 (192,203 bytes)
  [2026-02-13T04:10:44Z] GET /wp-login.php -> 304 (132,018 bytes)
  [2026-02-08T11:38:38Z] GET /wp-admin/ -> 404 (183,830 bytes)
  [2026-02-02T19:50:04Z] GET /wp-admin/ -> 404 (180,965 bytes)
  [2026-02-03T18:46:15Z] GET /humans.txt -> 200 (135,268 bytes)
  [2026-02-08T18:12:50Z] GET / -> 200 (181,440 bytes)
  [2026-02-13T04:40:26Z] GET /about.html -> 200 (33,008 bytes)
  [2026-02-05T10:06:08Z] GET /photo.webp -> 200 (104,918 bytes)
  [2026-02-17T18:06:53Z] GET /nonexistent-page -> 200 (43,467 bytes)
  [2026-02-12T21:24:19Z] GET /banner.jpg -> 304 (173,284 bytes)
  [2026-02-03T05:12:17Z] GET /readme.txt -> 200 (120,260 bytes)
  [2026-02-17T19:34:00Z] GET /style.css -> 304 (75,994 bytes)
  [2026-02-06T22:29:21Z] GET /config -> 304 (156,749 bytes)
  [2026-02-14T15:20:16Z] GET /nonexistent-page -> 200 (64,085 bytes)
  [2026-02-13T21:08:40Z] GET /banner.jpg -> 304 (16,964 bytes)
  [2026-02-01T07:08:57Z] GET /nonexistent-page -> 200 (191,876 bytes)
  [2026-02-15T08:10:42Z] GET /nonexistent-page -> 200 (190,063 bytes)
  [2026-02-13T17:51:36Z] GET /.git/config -> 404 (84,663 bytes)
  [2026-02-11T21:24:48Z] GET /.git/config -> 304 (187,918 bytes)
  [2026-02-13T21:37:32Z] GET /robots.txt -> 304 (83,501 bytes)
  [2026-02-15T02:00:27Z] GET /wp-login.php -> 200 (43,945 bytes)
  [2026-02-02T02:24:40Z] GET /index.html -> 404 (144,159 bytes)
  [2026-02-07T05:49:25Z] GET /sitemap.xml -> 200 (22,434 bytes)
  [2026-02-17T06:05:24Z] GET /icon.gif -> 200 (70,625 bytes)
  [2026-02-10T19:11:17Z] GET /about.html -> 200 (121,077 bytes)
  [2026-02-17T12:12:23Z] GET /index.html -> 200 (109,417 bytes)
  [2026-02-17T09:27:26Z] GET /wp-login.php -> 304 (187,079 bytes)
  [2026-02-01T18:47:42Z] GET /feed.xml -> 304 (26,265 bytes)
  [2026-02-17T07:31:55Z] GET /sitemap.xml -> 200 (36,884 bytes)
  [2026-02-02T22:39:34Z] GET / -> 304 (22,341 bytes)
  [2026-02-18T13:28:06Z] GET /app.js -> 404 (172,917 bytes)
  [2026-02-18T03:15:01Z] GET /humans.txt -> 304 (44,574 bytes)
  [2026-02-16T01:47:04Z] GET /about.html -> 404 (122,735 bytes)
  [2026-02-11T03:10:25Z] GET /photo.webp -> 200 (38,902 bytes)
  [2026-02-06T17:22:03Z] GET /style.css -> 200 (154,055 bytes)
  [2026-02-15T03:43:31Z] GET /nonexistent-page -> 304 (43,639 bytes)
  [2026-02-12T21:19:09Z] GET /logo.png -> 200 (91,593 bytes)
  [2026-02-08T06:57:23Z] GET /icon.gif -> 200 (94,435 bytes)
  [2026-02-14T07:37:28Z] GET /wp-login.php -> 304 (191,888 bytes)
  [2026-02-07T02:42:25Z] GET /nonexistent-page -> 404 (121,587 bytes)
  [2026-02-14T02:21:24Z] GET /manifest.json -> 200 (5,938 bytes)
  [2026-02-09T08:32:34Z] GET /config -> 200 (47,520 bytes)
  [2026-02-10T05:50:53Z] GET /data.json -> 404 (86,220 bytes)
  [2026-02-05T11:43:04Z] GET /config -> 304 (180,008 bytes)
  [2026-02-11T00:18:20Z] GET /.env -> 200 (78,827 bytes)
  [2026-02-13T06:26:47Z] GET /app.js -> 200 (7,197 bytes)
  [2026-02-11T09:35:22Z] GET /banner.jpg -> 200 (194,206 bytes)
  [2026-02-19T02:11:25Z] GET /about.html -> 200 (96,611 bytes)
  [2026-02-15T13:11:10Z] GET /diagram.svg -> 200 (191,894 bytes)
  [2026-02-02T03:09:57Z] GET /banner.jpg -> 200 (38,429 bytes)
  [2026-02-06T11:27:23Z] GET /photo.webp -> 200 (174,282 bytes)
  [2026-02-17T20:00:26Z] GET /feed.xml -> 200 (53,121 bytes)
  [2026-02-03T03:12:20Z] GET /config -> 200 (126,081 bytes)
  [2026-02-07T19:19:08Z] GET /photo.webp -> 200 (20,946 bytes)
  [2026-02-16T14:57:38Z] GET /diagram.svg -> 200 (105,341 bytes)
  [2026-02-05T22:13:53Z] GET /logo.png -> 304 (172,697 bytes)
  [2026-02-18T06:36:14Z] GET /data.json -> 404 (27,573 bytes)
  [2026-02-17T05:01:35Z] GET /photo.webp -> 200 (16,399 bytes)
  [2026-02-11T01:16:01Z] GET /wp-admin/ -> 200 (192,423 bytes)
  [2026-02-17T05:40:35Z] GET /config -> 200 (39,495 bytes)
  [2026-02-18T05:55:38Z] GET /.git/config -> 200 (26,879 bytes)
  [2026-02-13T02:18:02Z] GET /photo.webp -> 304 (161,538 bytes)
  [2026-02-16T09:30:57Z] GET /logo.png -> 200 (183,297 bytes)
  [2026-02-05T01:56:14Z] GET /nonexistent-page -> 404 (15,648 bytes)
  [2026-02-19T10:38:14Z] GET /app.js -> 404 (176,642 bytes)
  [2026-02-02T22:46:16Z] GET /nonexistent-page -> 200 (191,964 bytes)
  [2026-02-01T14:12:09Z] GET /index.html -> 200 (129,888 bytes)
  [2026-02-10T07:46:32Z] GET /wp-admin/ -> 404 (13,598 bytes)
  [2026-02-19T19:07:19Z] GET /manifest.json -> 404 (46,053 bytes)
  [2026-02-08T21:46:18Z] GET /about.html -> 304 (158,919 bytes)
  [2026-02-03T21:58:24Z] GET /feed.xml -> 200 (179,564 bytes)
  [2026-02-03T19:27:03Z] GET /manifest.json -> 200 (90,459 bytes)
  [2026-02-16T23:24:31Z] GET /icon.gif -> 200 (71,054 bytes)
  [2026-02-02T00:10:45Z] GET /logo.png -> 200 (186,552 bytes)
  [2026-02-13T22:34:55Z] GET /api/test -> 404 (32,273 bytes)
  [2026-02-12T12:18:48Z] GET /wp-admin/ -> 304 (36,513 bytes)
  [2026-02-09T13:59:16Z] GET /icon.gif -> 200 (87,679 bytes)
  [2026-02-10T12:57:22Z] GET /data.json -> 304 (57,053 bytes)
  [2026-02-09T00:07:54Z] GET / -> 404 (128,173 bytes)
  [2026-02-15T19:53:19Z] GET / -> 404 (184,582 bytes)
  [2026-02-02T16:51:00Z] GET /config -> 200 (155,497 bytes)
  [2026-02-01T11:55:08Z] GET / -> 200 (126,052 bytes)
  [2026-02-08T07:13:29Z] GET /logo.png -> 404 (46,455 bytes)
  [2026-02-13T15:51:04Z] GET /wp-login.php -> 200 (197,314 bytes)
  [2026-02-19T18:06:15Z] GET /api/test -> 404 (35,788 bytes)
  [2026-02-02T15:35:52Z] GET /banner.jpg -> 404 (64,823 bytes)
  [2026-02-12T06:21:06Z] GET /photo.webp -> 404 (77,049 bytes)
  [2026-02-08T09:21:58Z] GET /wp-login.php -> 200 (128,395 bytes)
  [2026-02-16T16:46:04Z] GET /nonexistent-page -> 200 (151,728 bytes)
  [2026-02-07T15:14:05Z] GET /icon.gif -> 200 (66,084 bytes)
  [2026-02-09T17:23:12Z] GET /config -> 304 (58,081 bytes)
  [2026-02-19T01:34:43Z] GET /robots.txt -> 304 (75,962 bytes)
  [2026-02-05T10:21:25Z] GET /robots.txt -> 304 (32,339 bytes)
  [2026-02-18T17:52:48Z] GET /robots.txt -> 200 (85,859 bytes)
  [2026-02-04T21:38:08Z] GET /robots.txt -> 200 (21,639 bytes)
  [2026-02-07T19:11:01Z] GET /style.css -> 200 (94,443 bytes)
  [2026-02-18T17:09:55Z] GET /.git/config -> 304 (15,569 bytes)
  [2026-02-12T15:33:50Z] GET /banner.jpg -> 200 (84,675 bytes)
  [2026-02-08T20:00:12Z] GET /api/test -> 200 (194,364 bytes)
  [2026-02-07T13:41:16Z] GET / -> 200 (161,529 bytes)
  [2026-02-19T19:08:57Z] GET /readme.txt -> 200 (20,301 bytes)
  [2026-02-07T08:29:07Z] GET /robots.txt -> 200 (54,151 bytes)
  [2026-02-09T16:35:34Z] GET /banner.jpg -> 200 (175,256 bytes)
  [2026-02-02T16:40:34Z] GET /config -> 304 (79,339 bytes)
  [2026-02-09T00:30:47Z] GET / -> 304 (60,179 bytes)
  [2026-02-05T23:02:24Z] GET /photo.webp -> 404 (100,869 bytes)
  [2026-02-01T17:14:55Z] GET /config -> 304 (31,568 bytes)
  [2026-02-01T23:47:41Z] GET /wp-admin/ -> 200 (169,404 bytes)
  [2026-02-15T22:31:03Z] GET /api/test -> 200 (86,487 bytes)
  [2026-02-09T05:41:41Z] GET / -> 304 (172,727 bytes)
  [2026-02-02T07:25:27Z] GET /banner.jpg -> 200 (11,639 bytes)
  [2026-02-13T21:42:09Z] GET /api/test -> 404 (98,115 bytes)
  [2026-02-01T05:53:41Z] GET /wp-admin/ -> 200 (190,140 bytes)
  [2026-02-05T15:02:57Z] GET /photo.webp -> 200 (96,223 bytes)
  [2026-02-07T01:07:02Z] GET /nonexistent-page -> 404 (16,060 bytes)
  [2026-02-07T20:21:19Z] GET /nonexistent-page -> 200 (57,003 bytes)
  [2026-02-02T01:16:50Z] GET /about.html -> 200 (13,899 bytes)
  [2026-02-13T07:35:18Z] GET /api/test -> 304 (96,760 bytes)
  [2026-02-15T06:54:07Z] GET / -> 304 (118,745 bytes)
  [2026-02-08T18:56:51Z] GET /config -> 200 (165,255 bytes)
  [2026-02-04T15:39:17Z] GET /icon.gif -> 304 (100,739 bytes)
  [2026-02-16T21:30:10Z] GET / -> 200 (20,541 bytes)
  [2026-02-01T06:44:09Z] GET /readme.txt -> 404 (101,385 bytes)
  [2026-02-17T08:10:04Z] GET /wp-login.php -> 200 (166,764 bytes)
  [2026-02-12T01:52:00Z] GET /wp-login.php -> 404 (118,933 bytes)
  [2026-02-16T17:58:20Z] GET /.git/config -> 304 (193,862 bytes)
  [2026-02-18T02:27:48Z] GET /.git/config -> 200 (124,865 bytes)
  [2026-02-16T12:12:57Z] GET /wp-login.php -> 200 (190,610 bytes)
  [2026-02-19T09:46:26Z] GET /robots.txt -> 200 (185,874 bytes)
  [2026-02-18T14:46:02Z] GET /sitemap.xml -> 304 (64,176 bytes)
  [2026-02-19T23:52:29Z] GET /feed.xml -> 304 (124,057 bytes)
  [2026-02-18T18:10:41Z] GET /about.html -> 304 (91,000 bytes)
  [2026-02-16T02:12:11Z] GET /index.html -> 404 (179,877 bytes)
  [2026-02-05T19:36:14Z] GET / -> 200 (67,426 bytes)
  [2026-02-08T08:03:35Z] GET /robots.txt -> 200 (10,252 bytes)
  [2026-02-16T23:44:07Z] GET /readme.txt -> 404 (165,111 bytes)
  [2026-02-01T02:25:24Z] GET /icon.gif -> 200 (74,228 bytes)
  [2026-02-18T01:11:59Z] GET /nonexistent-page -> 304 (85,123 bytes)
  [2026-02-02T15:43:09Z] GET /wp-login.php -> 200 (117,310 bytes)
  [2026-02-19T01:26:40Z] GET /.env -> 200 (138,909 bytes)
  [2026-02-16T23:10:17Z] GET /readme.txt -> 200 (32,967 bytes)
  [2026-02-02T19:42:17Z] GET /icon.gif -> 200 (139,212 bytes)
  [2026-02-19T17:09:03Z] GET /wp-admin/ -> 200 (38,512 bytes)
  [2026-02-17T00:58:17Z] GET /robots.txt -> 200 (198,553 bytes)
  [2026-02-19T02:58:39Z] GET /style.css -> 304 (20,272 bytes)
  [2026-02-18T11:37:30Z] GET /readme.txt -> 200 (73,644 bytes)
  [2026-02-14T21:58:15Z] GET /banner.jpg -> 200 (72,613 bytes)
  [2026-02-09T22:47:19Z] GET / -> 304 (38,730 bytes)
  [2026-02-15T19:53:30Z] GET /logo.png -> 304 (160,263 bytes)
  [2026-02-14T21:01:10Z] GET /banner.jpg -> 200 (170,618 bytes)
  [2026-02-01T06:13:34Z] GET /wp-login.php -> 200 (78,604 bytes)
  [2026-02-08T08:41:56Z] GET /feed.xml -> 404 (101,731 bytes)
  [2026-02-09T10:33:24Z] GET /readme.txt -> 200 (102,471 bytes)
  [2026-02-11T01:24:31Z] GET /config -> 404 (172,471 bytes)
  [2026-02-02T23:13:50Z] GET /nonexistent-page -> 304 (51,372 bytes)
  [2026-02-03T23:51:50Z] GET /icon.gif -> 200 (29,964 bytes)
  [2026-02-11T16:52:50Z] GET /index.html -> 404 (95,124 bytes)
  [2026-02-17T23:17:47Z] GET /nonexistent-page -> 200 (37,036 bytes)
  [2026-02-06T12:58:16Z] GET /readme.txt -> 304 (25,491 bytes)
  [2026-02-09T21:58:57Z] GET /config -> 200 (85,868 bytes)
  [2026-02-06T22:19:16Z] GET /wp-login.php -> 200 (88,453 bytes)
  [2026-02-06T22:03:09Z] GET /photo.webp -> 404 (179,129 bytes)
  [2026-02-19T04:10:29Z] GET /api/test -> 200 (170,946 bytes)
  [2026-02-14T18:12:12Z] GET /nonexistent-page -> 200 (126,024 bytes)
  [2026-02-18T20:24:14Z] GET /index.html -> 404 (12,921 bytes)
  [2026-02-17T10:51:37Z] GET /manifest.json -> 404 (44,205 bytes)
  [2026-02-12T07:01:19Z] GET /.git/config -> 304 (46,626 bytes)
  [2026-02-16T14:01:48Z] GET /readme.txt -> 200 (111,483 bytes)
  [2026-02-18T15:14:07Z] GET /readme.txt -> 200 (84,261 bytes)
  [2026-02-19T15:03:38Z] GET /.git/config -> 404 (61,112 bytes)
  [2026-02-16T00:55:16Z] GET /nonexistent-page -> 200 (68,163 bytes)
  [2026-02-14T09:19:55Z] GET /robots.txt -> 200 (197,215 bytes)
  [2026-02-13T23:45:37Z] GET /.env -> 304 (77,341 bytes)
  [2026-02-09T05:34:06Z] GET /api/test -> 404 (25,571 bytes)
  [2026-02-15T10:31:06Z] GET /photo.webp -> 200 (191,892 bytes)
  [2026-02-06T10:39:25Z] GET /logo.png -> 404 (187,163 bytes)
  [2026-02-19T12:59:15Z] GET /sitemap.xml -> 200 (35,450 bytes)
  [2026-02-14T09:32:37Z] GET /config -> 304 (137,578 bytes)
  [2026-02-19T14:55:23Z] GET /manifest.json -> 200 (46,752 bytes)
  [2026-02-15T16:08:31Z] GET /robots.txt -> 200 (155,065 bytes)
  [2026-02-12T19:01:55Z] GET /.env -> 200 (48,868 bytes)
  [2026-02-04T09:08:39Z] GET /diagram.svg -> 200 (15,411 bytes)
  [2026-02-07T17:28:33Z] GET /readme.txt -> 200 (31,326 bytes)
  [2026-02-10T00:10:39Z] GET /humans.txt -> 200 (118,527 bytes)
  [2026-02-07T05:36:03Z] GET /api/test -> 304 (177,583 bytes)
  [2026-02-01T12:19:05Z] GET /style.css -> 304 (28,312 bytes)
  [2026-02-07T05:22:54Z] GET /nonexistent-page -> 404 (11,795 bytes)
  [2026-02-19T05:36:32Z] GET /logo.png -> 404 (5,093 bytes)
  [2026-02-03T18:51:23Z] GET /icon.gif -> 200 (2,804 bytes)
  [2026-02-10T06:45:00Z] GET /sitemap.xml -> 200 (136,584 bytes)
  [2026-02-08T02:04:22Z] GET /robots.txt -> 404 (79,930 bytes)
  [2026-02-19T04:24:44Z] GET /photo.webp -> 304 (110,337 bytes)
  [2026-02-16T11:33:46Z] GET /robots.txt -> 304 (149,947 bytes)
  [2026-02-09T19:52:11Z] GET /diagram.svg -> 200 (190,667 bytes)
  [2026-02-14T23:15:43Z] GET /robots.txt -> 200 (96,000 bytes)
  [2026-02-08T23:57:44Z] GET /humans.txt -> 200 (179,975 bytes)
  [2026-02-19T09:48:15Z] GET /app.js -> 304 (8,119 bytes)
  [2026-02-06T07:17:08Z] GET /app.js -> 404 (184,591 bytes)
  [2026-02-05T16:10:27Z] GET /config -> 200 (61,295 bytes)
  [2026-02-14T22:58:53Z] GET /sitemap.xml -> 200 (25,590 bytes)
  [2026-02-03T18:13:44Z] GET /diagram.svg -> 200 (47,069 bytes)
  [2026-02-10T15:38:44Z] GET /sitemap.xml -> 404 (62,101 bytes)
  [2026-02-13T21:53:32Z] GET /config -> 200 (113,516 bytes)
  [2026-02-04T14:23:15Z] GET /icon.gif -> 304 (30,432 bytes)
  [2026-02-14T20:54:49Z] GET /robots.txt -> 304 (8,855 bytes)
  [2026-02-11T08:10:52Z] GET /app.js -> 304 (68,753 bytes)
  [2026-02-17T07:33:57Z] GET /readme.txt -> 200 (107,089 bytes)
  [2026-02-05T12:26:58Z] GET /nonexistent-page -> 200 (93,491 bytes)
  [2026-02-11T20:08:01Z] GET /logo.png -> 304 (156,356 bytes)
  [2026-02-08T14:32:12Z] GET /style.css -> 404 (123,707 bytes)
  [2026-02-14T02:55:32Z] GET /icon.gif -> 200 (50,236 bytes)
  [2026-02-12T04:00:35Z] GET /about.html -> 200 (137,924 bytes)
  [2026-02-18T14:41:11Z] GET / -> 200 (146,581 bytes)
  [2026-02-04T08:49:14Z] GET /icon.gif -> 200 (178,787 bytes)
  [2026-02-18T08:06:24Z] GET /icon.gif -> 200 (59,747 bytes)
  [2026-02-10T23:43:52Z] GET /.env -> 200 (136,784 bytes)
  [2026-02-11T06:45:46Z] GET /readme.txt -> 404 (140,899 bytes)
  [2026-02-07T11:35:18Z] GET /wp-login.php -> 200 (162,224 bytes)
  [2026-02-16T05:27:52Z] GET /.git/config -> 304 (167,381 bytes)
  [2026-02-04T17:34:48Z] GET /wp-login.php -> 200 (2,354 bytes)
  [2026-02-14T14:27:00Z] GET /index.html -> 404 (180,304 bytes)
  [2026-02-14T17:41:20Z] GET /data.json -> 200 (163,228 bytes)
  [2026-02-19T12:16:55Z] GET /nonexistent-page -> 200 (69,551 bytes)
  [2026-02-06T07:14:30Z] GET /readme.txt -> 200 (131,437 bytes)
  [2026-02-12T20:04:19Z] GET /robots.txt -> 304 (117,411 bytes)
  [2026-02-04T17:42:27Z] GET /feed.xml -> 200 (54,609 bytes)
  [2026-02-15T23:16:56Z] GET /style.css -> 200 (186,985 bytes)
  [2026-02-16T13:29:46Z] GET /app.js -> 200 (64,939 bytes)
  [2026-02-08T20:11:37Z] GET /.git/config -> 304 (193,682 bytes)
  [2026-02-08T06:04:16Z] GET /.git/config -> 200 (36,951 bytes)
  [2026-02-10T15:41:06Z] GET /.git/config -> 200 (78,147 bytes)
  [2026-02-05T02:28:30Z] GET /readme.txt -> 200 (117,017 bytes)
  [2026-02-13T13:29:31Z] GET /.env -> 304 (61,861 bytes)
  [2026-02-10T04:26:03Z] GET /logo.png -> 404 (190,823 bytes)
  [2026-02-08T20:40:41Z] GET /robots.txt -> 304 (31,590 bytes)
  [2026-02-09T16:00:17Z] GET /sitemap.xml -> 200 (159,151 bytes)
  [2026-02-06T06:13:29Z] GET / -> 404 (122,602 bytes)
  [2026-02-11T02:49:04Z] GET /banner.jpg -> 404 (74,106 bytes)
  [2026-02-08T02:58:12Z] GET /photo.webp -> 404 (114,298 bytes)
  [2026-02-07T16:41:47Z] GET /.env -> 200 (104,510 bytes)
  [2026-02-02T01:13:28Z] GET /logo.png -> 200 (169,322 bytes)
  [2026-02-18T06:06:30Z] GET / -> 200 (78,733 bytes)
  [2026-02-01T10:44:36Z] GET /.git/config -> 200 (33,310 bytes)
  [2026-02-12T04:37:01Z] GET /wp-login.php -> 200 (189,428 bytes)
  [2026-02-13T23:33:35Z] GET /logo.png -> 404 (85,741 bytes)
  [2026-02-17T15:48:38Z] GET /feed.xml -> 200 (137,274 bytes)
  [2026-02-13T15:11:58Z] GET /logo.png -> 200 (91,081 bytes)
  [2026-02-19T14:54:02Z] GET /readme.txt -> 200 (136,312 bytes)
  [2026-02-13T09:40:04Z] GET /index.html -> 404 (186,657 bytes)
  [2026-02-08T21:52:18Z] GET /banner.jpg -> 200 (56,562 bytes)
  [2026-02-15T05:49:48Z] GET /style.css -> 200 (175,093 bytes)
  [2026-02-14T14:48:22Z] GET /nonexistent-page -> 200 (90,973 bytes)
  [2026-02-02T07:42:02Z] GET /feed.xml -> 200 (45,847 bytes)
  [2026-02-03T08:13:02Z] GET /logo.png -> 304 (68,728 bytes)
  [2026-02-15T17:04:08Z] GET /photo.webp -> 200 (88,756 bytes)
  [2026-02-19T10:44:54Z] GET / -> 200 (80,399 bytes)
  [2026-02-18T14:02:50Z] GET /style.css -> 200 (72,610 bytes)
  [2026-02-09T21:49:07Z] GET /feed.xml -> 200 (147,222 bytes)
  [2026-02-19T20:49:41Z] GET /icon.gif -> 200 (108,581 bytes)
  [2026-02-06T23:00:12Z] GET /photo.webp -> 200 (101,857 bytes)
  [2026-02-18T21:01:10Z] GET /feed.xml -> 200 (145,551 bytes)
  [2026-02-13T20:16:12Z] GET /api/test -> 404 (134,475 bytes)
  [2026-02-03T09:35:03Z] GET /icon.gif -> 200 (193,170 bytes)
  [2026-02-17T09:33:39Z] GET /app.js -> 200 (96,556 bytes)
  [2026-02-13T07:37:02Z] GET /wp-admin/ -> 304 (43,609 bytes)
  [2026-02-15T10:01:25Z] GET /banner.jpg -> 304 (99,189 bytes)
  [2026-02-04T00:57:27Z] GET /style.css -> 200 (127,774 bytes)
  [2026-02-16T23:17:36Z] GET /icon.gif -> 404 (102,798 bytes)
  [2026-02-11T02:08:27Z] GET /wp-login.php -> 200 (86,080 bytes)
  [2026-02-02T12:49:06Z] GET /wp-admin/ -> 200 (86,959 bytes)
  [2026-02-08T00:58:30Z] GET /feed.xml -> 200 (141,865 bytes)
  [2026-02-14T16:52:24Z] GET /config -> 200 (165,557 bytes)
  [2026-02-12T15:46:26Z] GET /logo.png -> 404 (102,574 bytes)
  [2026-02-11T12:12:53Z] GET /photo.webp -> 304 (58,741 bytes)
  [2026-02-10T09:51:56Z] GET /index.html -> 200 (141,842 bytes)
  [2026-02-19T17:05:21Z] GET /manifest.json -> 200 (177,582 bytes)
  [2026-02-05T19:21:52Z] GET /config -> 200 (63,981 bytes)
  [2026-02-10T06:52:05Z] GET /wp-login.php -> 304 (42,546 bytes)
  [2026-02-03T16:38:10Z] GET /banner.jpg -> 200 (135,106 bytes)
  [2026-02-16T05:38:05Z] GET /logo.png -> 200 (7,920 bytes)
  [2026-02-16T21:32:54Z] GET /logo.png -> 200 (154,291 bytes)
  [2026-02-17T15:59:04Z] GET /.env -> 304 (114,379 bytes)
  [2026-02-10T03:19:46Z] GET /config -> 304 (129,416 bytes)
  [2026-02-19T04:27:50Z] GET /style.css -> 200 (133,669 bytes)
  [2026-02-10T11:21:09Z] GET /feed.xml -> 200 (121,681 bytes)
  [2026-02-12T10:06:40Z] GET /index.html -> 200 (91,978 bytes)
  [2026-02-13T14:58:10Z] GET / -> 404 (130,564 bytes)
  [2026-02-15T08:00:27Z] GET /diagram.svg -> 200 (148,055 bytes)
  [2026-02-14T08:26:16Z] GET /wp-login.php -> 304 (50,040 bytes)
  [2026-02-03T09:39:22Z] GET /index.html -> 200 (57,228 bytes)
  [2026-02-14T23:12:27Z] GET /robots.txt -> 200 (196,371 bytes)
  [2026-02-13T16:11:25Z] GET / -> 404 (41,818 bytes)
  [2026-02-08T19:47:34Z] GET /nonexistent-page -> 304 (15,908 bytes)
  [2026-02-15T04:18:33Z] GET /photo.webp -> 200 (190,538 bytes)
  [2026-02-08T12:44:45Z] GET /diagram.svg -> 200 (194,231 bytes)
  [2026-02-01T12:49:37Z] GET /feed.xml -> 404 (116,044 bytes)
  [2026-02-03T20:38:14Z] GET /.env -> 200 (159,537 bytes)
  [2026-02-11T21:40:21Z] GET / -> 404 (27,934 bytes)
  [2026-02-16T07:34:17Z] GET /diagram.svg -> 200 (146,107 bytes)
  [2026-02-19T14:35:22Z] GET /style.css -> 200 (107,316 bytes)
  [2026-02-02T20:27:01Z] GET /readme.txt -> 200 (155,953 bytes)
  [2026-02-04T01:07:35Z] GET /data.json -> 200 (63,511 bytes)
  [2026-02-07T19:10:26Z] GET /humans.txt -> 200 (149,387 bytes)
  [2026-02-12T18:39:30Z] GET /humans.txt -> 200 (91,573 bytes)
  [2026-02-06T22:43:16Z] GET /nonexistent-page -> 200 (65,047 bytes)
  [2026-02-19T22:48:27Z] GET /sitemap.xml -> 304 (141,929 bytes)
  [2026-02-16T16:34:36Z] GET /.git/config -> 200 (161,334 bytes)
  [2026-02-02T19:10:05Z] GET /diagram.svg -> 304 (143,205 bytes)
  [2026-02-11T06:32:08Z] GET /icon.gif -> 200 (23,049 bytes)
  [2026-02-01T07:06:24Z] GET / -> 200 (163,565 bytes)
  [2026-02-16T19:45:00Z] GET /.env -> 200 (56,395 bytes)
  [2026-02-15T13:25:31Z] GET /nonexistent-page -> 200 (148,407 bytes)
  [2026-02-06T01:58:45Z] GET /banner.jpg -> 304 (18,404 bytes)
  [2026-02-15T18:16:31Z] GET /.git/config -> 200 (153,583 bytes)
  [2026-02-17T20:38:34Z] GET /style.css -> 200 (81,681 bytes)
  [2026-02-08T20:12:23Z] GET /nonexistent-page -> 404 (56,868 bytes)
  [2026-02-02T18:06:26Z] GET /banner.jpg -> 404 (54,138 bytes)
  [2026-02-13T20:46:30Z] GET /style.css -> 304 (128,998 bytes)
  [2026-02-11T14:27:30Z] GET /.env -> 200 (161,421 bytes)
  [2026-02-16T22:18:36Z] GET /style.css -> 200 (34,172 bytes)
  [2026-02-19T12:09:26Z] GET /.env -> 200 (186,124 bytes)
  [2026-02-05T05:23:00Z] GET /config -> 200 (94,112 bytes)
  [2026-02-07T17:54:23Z] GET /app.js -> 304 (111,733 bytes)
  [2026-02-08T13:41:22Z] GET /wp-admin/ -> 200 (129,051 bytes)
  [2026-02-15T13:24:18Z] GET /diagram.svg -> 304 (163,921 bytes)
  [2026-02-03T10:00:36Z] GET /.env -> 200 (19,987 bytes)
  [2026-02-03T18:15:30Z] GET /.env -> 304 (130,995 bytes)
  [2026-02-07T23:56:07Z] GET /humans.txt -> 200 (26,409 bytes)
  [2026-02-16T17:12:50Z] GET /about.html -> 200 (129,544 bytes)
  [2026-02-17T08:23:20Z] GET /wp-login.php -> 200 (80,773 bytes)
  [2026-02-09T06:34:05Z] GET /banner.jpg -> 200 (195,651 bytes)
  [2026-02-14T07:29:00Z] GET / -> 200 (11,468 bytes)
  [2026-02-18T03:35:05Z] GET /wp-admin/ -> 200 (81,805 bytes)
  [2026-02-07T04:29:25Z] GET /.git/config -> 404 (45,364 bytes)
  [2026-02-06T16:08:07Z] GET /photo.webp -> 200 (86,528 bytes)
  [2026-02-06T22:07:53Z] GET /readme.txt -> 200 (40,826 bytes)
  [2026-02-12T07:33:05Z] GET /logo.png -> 200 (146,861 bytes)
  [2026-02-01T02:29:44Z] GET /wp-admin/ -> 304 (184,532 bytes)
  [2026-02-11T02:18:20Z] GET /manifest.json -> 200 (3,077 bytes)
  [2026-02-04T22:04:29Z] GET /.git/config -> 200 (72,609 bytes)
  [2026-02-19T15:03:18Z] GET /logo.png -> 404 (103,006 bytes)
  [2026-02-13T22:18:09Z] GET /api/test -> 200 (143,234 bytes)
  [2026-02-03T18:43:16Z] GET /wp-login.php -> 404 (76,621 bytes)
  [2026-02-14T13:58:33Z] GET /diagram.svg -> 200 (62,787 bytes)
  [2026-02-04T05:13:00Z] GET /logo.png -> 200 (163,676 bytes)
  [2026-02-11T22:50:36Z] GET /logo.png -> 200 (38,257 bytes)
  [2026-02-08T20:55:14Z] GET /readme.txt -> 200 (64,994 bytes)
  [2026-02-19T11:22:47Z] GET /api/test -> 200 (14,102 bytes)
  [2026-02-16T00:16:39Z] GET /icon.gif -> 404 (187,505 bytes)
  [2026-02-08T10:31:22Z] GET /readme.txt -> 304 (146,531 bytes)
  [2026-02-07T17:24:46Z] GET /humans.txt -> 304 (88,998 bytes)
  [2026-02-08T20:29:23Z] GET /feed.xml -> 200 (19,813 bytes)
  [2026-02-03T21:10:50Z] GET /photo.webp -> 200 (88,322 bytes)
  [2026-02-13T08:48:51Z] GET /wp-login.php -> 200 (114,939 bytes)
  [2026-02-13T16:10:51Z] GET /about.html -> 304 (134,743 bytes)
  [2026-02-15T05:32:58Z] GET /banner.jpg -> 200 (182,304 bytes)
  [2026-02-07T12:18:15Z] GET /icon.gif -> 200 (105,950 bytes)
  [2026-02-05T14:45:41Z] GET /data.json -> 200 (50,555 bytes)
  [2026-02-06T00:20:39Z] GET /diagram.svg -> 304 (30,514 bytes)
  [2026-02-15T17:52:04Z] GET /data.json -> 404 (117,047 bytes)
  [2026-02-17T19:12:59Z] GET /api/test -> 200 (114,880 bytes)
  [2026-02-10T21:46:33Z] GET /app.js -> 200 (35,202 bytes)
  [2026-02-11T05:29:45Z] GET /data.json -> 200 (189,746 bytes)
  [2026-02-11T09:23:35Z] GET /.env -> 404 (20,803 bytes)
  [2026-02-11T05:42:23Z] GET /robots.txt -> 200 (169,785 bytes)
  [2026-02-06T14:36:02Z] GET /about.html -> 404 (149,178 bytes)
  [2026-02-11T22:45:28Z] GET /logo.png -> 200 (137,025 bytes)
  [2026-02-19T00:38:50Z] GET /sitemap.xml -> 200 (89,459 bytes)
  [2026-02-12T04:24:57Z] GET /style.css -> 200 (95,911 bytes)
  [2026-02-06T21:07:57Z] GET /icon.gif -> 404 (13,933 bytes)
  [2026-02-04T13:05:35Z] GET /wp-admin/ -> 304 (159,318 bytes)
  [2026-02-15T19:34:53Z] GET /feed.xml -> 200 (152,609 bytes)
  [2026-02-09T03:02:52Z] GET /nonexistent-page -> 200 (136,634 bytes)
  [2026-02-14T14:22:22Z] GET /about.html -> 200 (104,669 bytes)

OBSERVATIONS
----------------------------------------
  - Referrer header is set when following links from crawled pages.
  - Image files are downloaded regardless of format.
  - Large file downloads are truncated at approximately 10MB.
  - Redirect chains are followed up to 10 hops before stopping.
  - Sitemap entries are crawled within 24 hours of publication.
