13 Commits (5579129b11f4acc9d0dc019cb4cb8b6533371cbb)

Author SHA1 Message Date
  JustAnotherArchivist 8f46225477 Replace warcio with own WARC writing implementation 3 years ago
  JustAnotherArchivist cb0d11284e Write only successful retrievals (i.e. ones that don't cause an exception) to WARC 4 years ago
  JustAnotherArchivist 1214409a0b Flush big responses to a temporary file instead of trying to keep everything in-memory 4 years ago
  JustAnotherArchivist 37dbcfad21 Don't write responses to WARC that triggered an exception 4 years ago
  JustAnotherArchivist f038cf91db Fix unfound distribution handling 4 years ago
  JustAnotherArchivist a5dfd5c805 Write spec file + its dependencies and command line to meta WARC 4 years ago
  JustAnotherArchivist e99e2304c9 Write meta WARC with log file 4 years ago
  JustAnotherArchivist 85d78cee13 Add warcinfo record with version information on Python, system, and dependencies 4 years ago
  JustAnotherArchivist 6fafd32685 Error when the retries are exceeded 4 years ago
  JustAnotherArchivist 8647d6b396 Use f-strings instead of str.format 4 years ago
  JustAnotherArchivist 85f6f7bd82 Make qwarc.utils.handle_response_limit_error_retries more useful by passing the deferring handler as an argument 5 years ago
  JustAnotherArchivist 2d52e78d85 Fix reference to aiohttp.CientError 5 years ago
  JustAnotherArchivist e892a6b6a7 Initial commit 5 years ago