JustAnotherArchivist
09cf078e34
Add metadata indexing
10 月之前
JustAnotherArchivist
c4e3fd29e0
Add debug messages for artefacts listing
1 年之前
JustAnotherArchivist
9474c44171
Ensure that FD 3 gets closed
It appears that Python doesn't reliably (or maybe just doesn't at all) flush and close non-standard FDs on exit. This randomly caused the artefacts list to get lost to /dev/null.
1 年之前
JustAnotherArchivist
d3c701daa9
Support parallel runs against the same storage
Closes #15
1 年之前
JustAnotherArchivist
9fa36654f5
Add undocumented --write-artefacts-fd-3 for codearchiver-bot
1 年之前
JustAnotherArchivist
d42ee45bb2
Module puts to storage directly
1 年之前
JustAnotherArchivist
8e83c9b7b4
Support incremental Git bundles
Also fix a small discrepancy between the commit list and bundle due to --reflog vs --all
1 年之前
JustAnotherArchivist
ed69ba16c9
logger → _logger
1 年之前
JustAnotherArchivist
f2d2df9428
Simplify storage design; there is no need for the queue
1 年之前
JustAnotherArchivist
550afa8644
Add storage abstraction
1 年之前
JustAnotherArchivist
715420e298
Fix imports in CLI: core and modules aren't needed in the argument parser
3 年之前
JustAnotherArchivist
07dc1927cf
Initial commit
A significant part of this code (e.g. the module loading, HTTP retrieval, CLI) was mostly or entirely copied from snscrape.
3 年之前