JustAnotherArchivist
/
qwarc
1
0
Разклонения 0
Код Задачи 0 Заявки за сливане 0 Версии 13 Уики Activity
105 Ревизии
3 Клонове
484 KiB
Клон: master
Клонове Маркери
${ item.name }
Create branch ${ searchTerm }
от 'master'
${ noResults }
Commit Graph

32 Ревизии (master)

Автор SHA1 Съобщение Дата
  JustAnotherArchivist f025c4e9f3 Add extensive debug logging преди 3 години
  JustAnotherArchivist dbe1ed71ab "Freeze" log file object before writing to WARC to ensure that further log messages aren't picked up преди 3 години
  JustAnotherArchivist 8ca2a6bde5 Fix exceptions on journal errors преди 3 години
  JustAnotherArchivist 733506aed7 Remove obsolete TODO преди 3 години
  JustAnotherArchivist c7fac0ec3f Add WARC journalling with rollback on errors преди 3 години
  JustAnotherArchivist a91cc23d47 Simplify get_software_info's signature to just the extra dependency packages преди 3 години
  JustAnotherArchivist 820384fe1e Stop deduping small responses преди 4 години
  JustAnotherArchivist 461cedbbde Avoid temporary files created by warcio due to not knowing the record payload length преди 4 години
  JustAnotherArchivist 1214409a0b Flush big responses to a temporary file instead of trying to keep everything in-memory преди 4 години
  JustAnotherArchivist 93df9cd18d Get rid of the temporary extra log file and read the plain file instead преди 4 години
  JustAnotherArchivist 08c3d55376 Add comment on block digest workaround (cf. f14a664b) преди 4 години
  JustAnotherArchivist 413435b7fb Work around warcio not writing the correct WARC-Profile header for revisit records on WARC/1.1 преди 4 години
  JustAnotherArchivist 8ee9b20718 Remove WARC-Target-URI header from warcinfo record преди 4 години
  JustAnotherArchivist f14a664b1c Work around warcio not writing a block digest for warcinfo records (https://github.com/webrecorder/warcio/issues/87) преди 4 години
  JustAnotherArchivist bd14ab3901 Fix crash due to closing the log handler on reaching the max WARC size преди 4 години
  JustAnotherArchivist 08117630b0 Remove warcinfo record in each data WARC and refer to the process's warcinfo record in the meta WARC instead преди 4 години
  JustAnotherArchivist 26aab15605 urn:X-qwarc instead of urn:qwarc преди 4 години
  JustAnotherArchivist 50d46ad51c Use log filename in the target URI of the log resource record преди 4 години
  JustAnotherArchivist e093211496 Set content type for resource records преди 4 години
  JustAnotherArchivist ae46b53401 Always write a WARC-Warcinfo-ID header преди 4 години
  JustAnotherArchivist 23fcdd4026 Write microsecond dates for request and response records преди 4 години
  JustAnotherArchivist 3030ad10ab Mark private API accordingly преди 4 години
  JustAnotherArchivist e0b4104d21 Remove log handler before writing log record since that requires closing the stream преди 4 години
  JustAnotherArchivist 6cfd352f68 Write WARC/1.1 files преди 4 години
  JustAnotherArchivist e1ad5c232e Write warcinfo and resource records in meta WARC on firing up qwarc rather than at the end преди 4 години
  JustAnotherArchivist a5dfd5c805 Write spec file + its dependencies and command line to meta WARC преди 4 години
  JustAnotherArchivist e99e2304c9 Write meta WARC with log file преди 4 години
  JustAnotherArchivist 85d78cee13 Add warcinfo record with version information on Python, system, and dependencies преди 4 години
  JustAnotherArchivist 9cff6bd5c1 Only open a WARC file when necessary to avoid producing empty WARCs at the end преди 4 години
  JustAnotherArchivist 8647d6b396 Use f-strings instead of str.format преди 4 години
  JustAnotherArchivist be5673cfbf Add record deduplication within a process преди 5 години
  JustAnotherArchivist e892a6b6a7 Initial commit преди 5 години