A framework for quick web archiving
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
JustAnotherArchivist 4d9e4d8fe8 Fix ClientResponse._read returning more than nbytes if the entire response fits into the first block fed into the parser преди 4 години
..
__init__.py Handle STOP file and high memory usage before full disk to allow stopping while the disk is above the limit преди 4 години
aiohttp.py Fix ClientResponse._read returning more than nbytes if the entire response fits into the first block fed into the parser преди 4 години
cli.py Support deep/multiple inheritance from Item преди 4 години
const.py Catch exceptions in Item.process and mark the items as errors instead of crashing преди 4 години
utils.py Write only successful retrievals (i.e. ones that don't cause an exception) to WARC преди 4 години
version.py Use setuptools_scm for versioning преди 4 години
warc.py Stop deduping small responses преди 4 години