JustAnotherArchivist
/
qwarc
1
0
Креирај огранак 0
Код Дискусије 0 Захтеви за спајање 0 Издања 13 Вики Activity
105 Комити
3 Гране
484 KiB
Грана: master
Гране Ознаке
${ item.name }
Create branch ${ searchTerm }
from 'master'
${ noResults }
Commit Graph

32 Комити (master)

Аутор SHA1 Порука Датум
  JustAnotherArchivist f025c4e9f3 Add extensive debug logging пре 3 година
  JustAnotherArchivist dbe1ed71ab "Freeze" log file object before writing to WARC to ensure that further log messages aren't picked up пре 3 година
  JustAnotherArchivist 8ca2a6bde5 Fix exceptions on journal errors пре 3 година
  JustAnotherArchivist 733506aed7 Remove obsolete TODO пре 3 година
  JustAnotherArchivist c7fac0ec3f Add WARC journalling with rollback on errors пре 3 година
  JustAnotherArchivist a91cc23d47 Simplify get_software_info's signature to just the extra dependency packages пре 3 година
  JustAnotherArchivist 820384fe1e Stop deduping small responses пре 4 година
  JustAnotherArchivist 461cedbbde Avoid temporary files created by warcio due to not knowing the record payload length пре 4 година
  JustAnotherArchivist 1214409a0b Flush big responses to a temporary file instead of trying to keep everything in-memory пре 4 година
  JustAnotherArchivist 93df9cd18d Get rid of the temporary extra log file and read the plain file instead пре 4 година
  JustAnotherArchivist 08c3d55376 Add comment on block digest workaround (cf. f14a664b) пре 4 година
  JustAnotherArchivist 413435b7fb Work around warcio not writing the correct WARC-Profile header for revisit records on WARC/1.1 пре 4 година
  JustAnotherArchivist 8ee9b20718 Remove WARC-Target-URI header from warcinfo record пре 4 година
  JustAnotherArchivist f14a664b1c Work around warcio not writing a block digest for warcinfo records (https://github.com/webrecorder/warcio/issues/87) пре 4 година
  JustAnotherArchivist bd14ab3901 Fix crash due to closing the log handler on reaching the max WARC size пре 4 година
  JustAnotherArchivist 08117630b0 Remove warcinfo record in each data WARC and refer to the process's warcinfo record in the meta WARC instead пре 4 година
  JustAnotherArchivist 26aab15605 urn:X-qwarc instead of urn:qwarc пре 4 година
  JustAnotherArchivist 50d46ad51c Use log filename in the target URI of the log resource record пре 4 година
  JustAnotherArchivist e093211496 Set content type for resource records пре 4 година
  JustAnotherArchivist ae46b53401 Always write a WARC-Warcinfo-ID header пре 4 година
  JustAnotherArchivist 23fcdd4026 Write microsecond dates for request and response records пре 4 година
  JustAnotherArchivist 3030ad10ab Mark private API accordingly пре 4 година
  JustAnotherArchivist e0b4104d21 Remove log handler before writing log record since that requires closing the stream пре 4 година
  JustAnotherArchivist 6cfd352f68 Write WARC/1.1 files пре 4 година
  JustAnotherArchivist e1ad5c232e Write warcinfo and resource records in meta WARC on firing up qwarc rather than at the end пре 4 година
  JustAnotherArchivist a5dfd5c805 Write spec file + its dependencies and command line to meta WARC пре 4 година
  JustAnotherArchivist e99e2304c9 Write meta WARC with log file пре 4 година
  JustAnotherArchivist 85d78cee13 Add warcinfo record with version information on Python, system, and dependencies пре 4 година
  JustAnotherArchivist 9cff6bd5c1 Only open a WARC file when necessary to avoid producing empty WARCs at the end пре 4 година
  JustAnotherArchivist 8647d6b396 Use f-strings instead of str.format пре 4 година
  JustAnotherArchivist be5673cfbf Add record deduplication within a process пре 5 година
  JustAnotherArchivist e892a6b6a7 Initial commit пре 5 година