Commit Graph

553 Commits

Author SHA1 Message Date
Seednode c87453d2f8 Update readme with info for --index-interval 2024-01-30 04:35:49 -06:00
Seednode 187a6569ff Add --index-interval for automatic index rebuilds 2024-01-30 04:27:18 -06:00
Seednode 6fc21236a7 Updated transitive dependencies 2024-01-26 18:09:02 -06:00
Seednode 9c590c9bc6 Specify 'charset=UTF-8' for all text/plain content type headers 2024-01-25 09:30:28 -06:00
Seednode 172fc38f18 Replace copied-in tzinfo database with -tags timetzdata 2024-01-19 14:56:40 -06:00
Seednode e394824ae5 Changed --case-sensitive to --case-insensitive 2024-01-19 14:43:08 -06:00
Seednode 993be0bb7a Changed --case-sensitive to --case-insensitive 2024-01-19 14:39:53 -06:00
Seednode 54225d4074 Fix USER comment in debug Dockerfile 2024-01-15 12:29:26 -06:00
Seednode 7cfc1f7a47 Run as root user in debug image 2024-01-15 11:11:19 -06:00
Seednode e08335168c Add debug Docker image 2024-01-15 11:10:15 -06:00
Seednode 98c730e824 Set default concurrency to 1024, simplify setting Content-Length header 2024-01-15 09:41:11 -06:00
Seednode 76456f586d Remove --handlers, remove all logging unless --verbose is passed 2024-01-15 09:28:59 -06:00
Seednode 61060f7895 Remove --page-length and HTML index dump, fix media type identification 2024-01-15 08:51:41 -06:00
Seednode 06c6b70b2c Update release year 2024-01-14 12:39:14 -06:00
Seednode 7546c6257f Add garbage collection after every index rebuild, to test something 2024-01-14 10:12:24 -06:00
Seednode ee09812376 Remove unused CompressionFormats variable 2024-01-14 10:00:34 -06:00
Seednode 6bd97f30c2 Re-use zstd encoder 2024-01-14 09:43:22 -06:00
Seednode 2f06ae3605 Remove non-zstd compression options 2024-01-14 09:29:22 -06:00
Seednode 7868f0d7ad Register all pprof endpoints 2024-01-14 09:06:22 -06:00
Seednode 4e85621335 Round all durations to microseconds 2024-01-11 03:36:16 -06:00
Seednode e3e6aca2fa Set default concurrency back to 10240, as values above inode limits(?) cause panics currently 2024-01-11 03:21:10 -06:00
Seednode ebb5e48d9a Move regex compilation to global variable 2024-01-10 13:07:50 -06:00
Seednode 9e458aa0bb Move regex compilation to global variable 2024-01-10 13:07:24 -06:00
Seednode d568d10e78 Move walkPath() defers out to calling function, for more intuitive readability 2024-01-10 11:58:55 -06:00
Seednode 9b6d9464e6 Replace microsecond delay with another sync.WaitGroup 2024-01-09 17:36:25 -06:00
Seednode 6074b7e546 Re-add microsecond delay to walkPath() invocations 2024-01-09 17:17:26 -06:00
Seednode 431de92bbb Remove snappy, lz4, lzw, deflate, and gzip compression options 2024-01-09 13:39:08 -06:00
Seednode 656c74b883 Change lzw from LSB-first to MSB-first. This should probably be a major version bump, but who's using lzw, really 2024-01-08 17:42:13 -06:00
Seednode 37436377cf Updated transitive dependencies 2024-01-08 16:04:31 -06:00
Seednode e13c141c5c Move compression format slice variable from root.go => index.go 2024-01-08 16:00:37 -06:00
Seednode 56c6565cb1 Add error handling to all functions that can possibly return non-nil errors 2024-01-07 22:43:51 -06:00
Seednode 09bff1ed18 Skip calling IOReadCloser() method on zstd decoder for getReader() 2024-01-07 22:28:03 -06:00
Seednode de94c5eb49 Redact admin prefix when registering profiling handlers, too 2024-01-07 22:25:00 -06:00
Seednode adaa7378ff Updated transitive dependencies 2024-01-07 15:14:37 -06:00
Seednode 787d3880ec Fix typo (lz5 => lz4) in compression format list, change http server error output for consistency with other errors 2024-01-06 09:52:38 -06:00
Seednode 1f6a06bc2c Change default concurrency from max int64 to math.MaxInt32 2024-01-06 09:48:01 -06:00
Seednode f0378f09e0 Change default concurrency from max int64 to math.MaxInt32 2024-01-06 09:47:07 -06:00
Seednode 6f29f89acf Continue scanning instead of aborting on fs.ErrPermission or fs.ErrNotExist; add --debug flag to view output from those errors; initialize error logging earlier in setup 2024-01-06 09:41:30 -06:00
Seednode e9d75ac6f3 Add note that compression can be disabled 2024-01-05 22:17:57 -06:00
Seednode 4403785899 Add missing compression formats to README 2024-01-05 21:55:22 -06:00
Seednode 560868ab75 Remove import alias for pierrec/lz4 2024-01-05 21:48:40 -06:00
Seednode 59cbd25e7c Add --compression-fast to use fastest compression method instead of best 2024-01-05 21:42:22 -06:00
Seednode 965d3deb8d Add support for snappy and lz4 compression 2024-01-05 21:30:08 -06:00
Seednode 2b6aa85302 Add info about compression algorithms and admin prefix redaction to README 2024-01-05 20:42:12 -06:00
Seednode fac4412c5c Add --compression, to allow specifying compression format for index file 2024-01-05 20:39:05 -06:00
Seednode 646c962e5d Add 1 microsecond delay to each call to walkPath() to fix incorrect filesMatched stat 2024-01-05 20:03:49 -06:00
Seednode 60ec29612b Add --redact option to hide admin prefix in log output 2024-01-05 19:00:15 -06:00
Seednode 5167ff457e Allow empty paths, notifying if no valid files are found 2024-01-05 18:50:45 -06:00
Seednode ccff56d28d Rename scanStatsChannel => scanStats, add workaround for occasionally missing single file when indexing 2024-01-05 07:29:16 -06:00
Seednode 89637c12b2 Close zstd encoder before reading file info, to ensure accurate file size reporting for index file 2024-01-04 12:43:26 -06:00