qwarc

484 KiB

Aborescence: 5579129b11

Auteur	SHA1	Message	Date
JustAnotherArchivist	8f46225477	Replace warcio with own WARC writing implementation	il y a 3 ans
JustAnotherArchivist	cb0d11284e	Write only successful retrievals (i.e. ones that don't cause an exception) to WARC	il y a 4 ans
JustAnotherArchivist	1214409a0b	Flush big responses to a temporary file instead of trying to keep everything in-memory	il y a 4 ans
JustAnotherArchivist	37dbcfad21	Don't write responses to WARC that triggered an exception For example, if the connection breaks while retrieving a response but after the headers have been parsed, the response body would be incomplete.	il y a 4 ans
JustAnotherArchivist	f038cf91db	Fix unfound distribution handling	il y a 4 ans
JustAnotherArchivist	a5dfd5c805	Write spec file + its dependencies and command line to meta WARC	il y a 4 ans
JustAnotherArchivist	e99e2304c9	Write meta WARC with log file	il y a 4 ans
JustAnotherArchivist	85d78cee13	Add warcinfo record with version information on Python, system, and dependencies	il y a 4 ans
JustAnotherArchivist	6fafd32685	Error when the retries are exceeded	il y a 5 ans
JustAnotherArchivist	8647d6b396	Use f-strings instead of str.format	il y a 5 ans
JustAnotherArchivist	85f6f7bd82	Make qwarc.utils.handle_response_limit_error_retries more useful by passing the deferring handler as an argument	il y a 5 ans
JustAnotherArchivist	2d52e78d85	Fix reference to aiohttp.CientError	il y a 5 ans
JustAnotherArchivist	e892a6b6a7	Initial commit	il y a 5 ans