1.5.0
#20 made me aware of an issue with very large queries to the cdx server. The snapshots received can easily cause the system to run out of memory, resulting in a crash.
So beside some other changes there is a work in progress to reduce memory-usage (but in exchange for some I/O)
- Results from the cdx server are now streamed into a .cdx file instead of system memory
- Added a warning (abortable) if the amount of snapshots is on the larger scale
- Added a progress indication for the download status of the cdx-query
- Sometimes the json results of the cdx server were not transferred completely and an exception was thrown. This faulty json data should now be handled appropriately (also #20 )
- Added command
--limit
to specify the maximum amount of snapshots to query - Removed command
--debug
; error-log will be always written - #19 fixed an error with timestamp extraction from urls
Feel free to submit bug reports at any time!