27 Révisions (e99e2304c91212056d7c352f666dab89e1428441)

 

Toutes les branches   

Chercher

Auteur	SHA1	Message	Date
JustAnotherArchivist	e99e2304c9	Write meta WARC with log file	il y a 4 ans
JustAnotherArchivist	d751844626	Fix starting another item before stopping on STOP file or memory limit exceedance	il y a 4 ans
JustAnotherArchivist	2b0778f9b5	Remove leftovers from initial code rewrite	il y a 4 ans
JustAnotherArchivist	85d78cee13	Add warcinfo record with version information on Python, system, and dependencies	il y a 4 ans
JustAnotherArchivist	9eaa7be4c8	Python 3.7 compatibility	il y a 4 ans
JustAnotherArchivist	9cff6bd5c1	Only open a WARC file when necessary to avoid producing empty WARCs at the end	il y a 4 ans
JustAnotherArchivist	21cf784102	Use setuptools_scm for versioning	il y a 4 ans
JustAnotherArchivist	ab22966fef	Add to log which item a message is coming from	il y a 5 ans
JustAnotherArchivist	6fafd32685	Error when the retries are exceeded	il y a 5 ans
JustAnotherArchivist	8647d6b396	Use f-strings instead of str.format	il y a 5 ans
JustAnotherArchivist	5008e6e8cd	Deduplicate items	il y a 5 ans
JustAnotherArchivist	46c95e2157	Disable decoding the response content chardet can be very slow (https://github.com/chardet/chardet/issues/29 https://github.com/psf/requests/issues/2359) and the decoding may be unnecessary if it's binary content.	il y a 5 ans
JustAnotherArchivist	91cd20f567	Version 0.1.3	il y a 5 ans
JustAnotherArchivist	85f6f7bd82	Make qwarc.utils.handle_response_limit_error_retries more useful by passing the deferring handler as an argument	il y a 5 ans
JustAnotherArchivist	ad22a2327a	Support adding headers to individual requests	il y a 5 ans
JustAnotherArchivist	67076f964c	Add support for POST requests	il y a 5 ans
JustAnotherArchivist	57764eb2b0	Version 0.1.2	il y a 5 ans
JustAnotherArchivist	2d52e78d85	Fix reference to aiohttp.CientError	il y a 5 ans
JustAnotherArchivist	0f107e988d	Version 0.1.1	il y a 5 ans
JustAnotherArchivist	c1574a06c9	Fix sleep task type	il y a 5 ans
JustAnotherArchivist	e0ca88c807	Fix reference to get_rss	il y a 5 ans
JustAnotherArchivist	984d28ede0	Fix type of --memorylimit, --disklimit, and --warcsplit values	il y a 5 ans
JustAnotherArchivist	8a8935810d	Fix references to memory and disk space check methods	il y a 5 ans
JustAnotherArchivist	1c8983fc1e	Version 0.1.0	il y a 5 ans
JustAnotherArchivist	be5673cfbf	Add record deduplication within a process	il y a 5 ans
JustAnotherArchivist	43f1b5e06e	Add LICENSE and README	il y a 5 ans
JustAnotherArchivist	e892a6b6a7	Initial commit	il y a 5 ans