26 コミット (d75184462638abe9c686d925e16c5aedc1360699)

 

すべてのブランチ   

検索

作成者	SHA1	メッセージ	日付
JustAnotherArchivist	d751844626	Fix starting another item before stopping on STOP file or memory limit exceedance	4年前
JustAnotherArchivist	2b0778f9b5	Remove leftovers from initial code rewrite	4年前
JustAnotherArchivist	85d78cee13	Add warcinfo record with version information on Python, system, and dependencies	4年前
JustAnotherArchivist	9eaa7be4c8	Python 3.7 compatibility	4年前
JustAnotherArchivist	9cff6bd5c1	Only open a WARC file when necessary to avoid producing empty WARCs at the end	4年前
JustAnotherArchivist	21cf784102	Use setuptools_scm for versioning	4年前
JustAnotherArchivist	ab22966fef	Add to log which item a message is coming from	5年前
JustAnotherArchivist	6fafd32685	Error when the retries are exceeded	5年前
JustAnotherArchivist	8647d6b396	Use f-strings instead of str.format	5年前
JustAnotherArchivist	5008e6e8cd	Deduplicate items	5年前
JustAnotherArchivist	46c95e2157	Disable decoding the response content chardet can be very slow (https://github.com/chardet/chardet/issues/29 https://github.com/psf/requests/issues/2359) and the decoding may be unnecessary if it's binary content.	5年前
JustAnotherArchivist	91cd20f567	Version 0.1.3	5年前
JustAnotherArchivist	85f6f7bd82	Make qwarc.utils.handle_response_limit_error_retries more useful by passing the deferring handler as an argument	5年前
JustAnotherArchivist	ad22a2327a	Support adding headers to individual requests	5年前
JustAnotherArchivist	67076f964c	Add support for POST requests	5年前
JustAnotherArchivist	57764eb2b0	Version 0.1.2	5年前
JustAnotherArchivist	2d52e78d85	Fix reference to aiohttp.CientError	5年前
JustAnotherArchivist	0f107e988d	Version 0.1.1	5年前
JustAnotherArchivist	c1574a06c9	Fix sleep task type	5年前
JustAnotherArchivist	e0ca88c807	Fix reference to get_rss	5年前
JustAnotherArchivist	984d28ede0	Fix type of --memorylimit, --disklimit, and --warcsplit values	5年前
JustAnotherArchivist	8a8935810d	Fix references to memory and disk space check methods	5年前
JustAnotherArchivist	1c8983fc1e	Version 0.1.0	5年前
JustAnotherArchivist	be5673cfbf	Add record deduplication within a process	5年前
JustAnotherArchivist	43f1b5e06e	Add LICENSE and README	5年前
JustAnotherArchivist	e892a6b6a7	Initial commit	5年前