JustAnotherArchivist
|
a361fe54e5
|
Add a metadata version field
|
il y a 1 an |
JustAnotherArchivist
|
fb8af13c15
|
Return all metadata validation errors at the same time
|
il y a 1 an |
JustAnotherArchivist
|
811e119835
|
Add retrieval start/end time metadata fields
|
il y a 1 an |
JustAnotherArchivist
|
b0505f94fe
|
Fix typo in package name
|
il y a 1 an |
JustAnotherArchivist
|
eab6db9f27
|
Better storage metadata search now that the module name is recorded there anyway
|
il y a 1 an |
JustAnotherArchivist
|
fa4b60225c
|
Index → Metadata
'Index' was a misnomer from the start since it contains critical information for the operation that can't be reconstructed (e.g. existing refs).
|
il y a 1 an |
JustAnotherArchivist
|
4259d34ec8
|
Set default ID
|
il y a 1 an |
JustAnotherArchivist
|
d5891c795c
|
More metadata
|
il y a 1 an |
JustAnotherArchivist
|
25792d9006
|
Fix missing inheritance from abc.ABCMeta
|
il y a 1 an |
JustAnotherArchivist
|
a910d4851c
|
Add support for inheritance of index fields; change type of field list to a tuple to lessen the risk of modification
|
il y a 1 an |
JustAnotherArchivist
|
2779148a1b
|
Add .gitignore
|
il y a 1 an |
JustAnotherArchivist
|
d5a7d39f74
|
setup.py → pyproject.toml
|
il y a 1 an |
JustAnotherArchivist
|
80995bccde
|
Add comment about FETCH_HEAD
|
il y a 1 an |
JustAnotherArchivist
|
2a9ff2ee15
|
Support empty incremental bundles
|
il y a 1 an |
JustAnotherArchivist
|
0e7b17d3fd
|
Capture and return stderr
|
il y a 1 an |
JustAnotherArchivist
|
a6e256c58f
|
Fix invalid usage of codearchiver.subprocess
Introduced by 240dcceb
|
il y a 1 an |
JustAnotherArchivist
|
8e83c9b7b4
|
Support incremental Git bundles
Also fix a small discrepancy between the commit list and bundle due to --reflog vs --all
|
il y a 1 an |
JustAnotherArchivist
|
021b26973b
|
Fix handling empty input
|
il y a 1 an |
JustAnotherArchivist
|
ed69ba16c9
|
logger → _logger
|
il y a 1 an |
JustAnotherArchivist
|
6f7a95d289
|
Add --progress option to cloning for more details
|
il y a 1 an |
JustAnotherArchivist
|
42e420ad0d
|
Disable prompts on password-protected repos
|
il y a 1 an |
JustAnotherArchivist
|
a9e838adde
|
Raise exception if file already exists in DirectoryStorage target
|
il y a 1 an |
JustAnotherArchivist
|
6af07cb51c
|
Raise exceptions on fatal errors
|
il y a 1 an |
JustAnotherArchivist
|
2257305872
|
Disallow underscores in module names
Using the preferred file naming scheme of {moduleName}_{someInputURLDerivative}_{date}*, this allows mapping files to modules without ambiguity.
|
il y a 1 an |
JustAnotherArchivist
|
4dcac08585
|
Fix import order
|
il y a 1 an |
JustAnotherArchivist
|
0f1f5abc64
|
Add indices for files
|
il y a 1 an |
JustAnotherArchivist
|
e3da8c7736
|
Use generic alias types
This requires at least Python 3.9.
|
il y a 1 an |
JustAnotherArchivist
|
f2d2df9428
|
Simplify storage design; there is no need for the queue
|
il y a 1 an |
JustAnotherArchivist
|
550afa8644
|
Add storage abstraction
|
il y a 1 an |
JustAnotherArchivist
|
06daea162f
|
Remove GitHub module as it is not ready for use yet
|
il y a 1 an |
JustAnotherArchivist
|
240dcceb10
|
Add subprocess wrapper for logging stderr
|
il y a 1 an |
JustAnotherArchivist
|
6fb0ac4e5e
|
Initial GitHub module only retrieving the actual repository
|
il y a 4 ans |
JustAnotherArchivist
|
2a2c9373d0
|
Documentation of the core
|
il y a 4 ans |
JustAnotherArchivist
|
715420e298
|
Fix imports in CLI: core and modules aren't needed in the argument parser
|
il y a 4 ans |
JustAnotherArchivist
|
1b73693b37
|
Keep track of and handle errors in modules via metaclass
|
il y a 4 ans |
JustAnotherArchivist
|
922900ac4e
|
Add support for selecting a module explicitly using `name+` URL prefix
E.g. `git+https://example.org/`
|
il y a 4 ans |
JustAnotherArchivist
|
22c707c04f
|
Add Module.name attribute
|
il y a 4 ans |
JustAnotherArchivist
|
90e0af88b9
|
Fix return type of get_module_{class,instance}
No need to quote the class name since the methods are not inside the class (anymore)
|
il y a 4 ans |
JustAnotherArchivist
|
5f9547d600
|
Get rid of inheritance-level-based module selection and instead raise an exception if there are no or multiple matching modules
|
il y a 4 ans |
JustAnotherArchivist
|
7e8958b063
|
Allow overriding the archive ID
|
il y a 4 ans |
JustAnotherArchivist
|
90f80e41a9
|
Add __repr__ methods
|
il y a 4 ans |
JustAnotherArchivist
|
9f6e5a9f48
|
Move InputURL handling to base Module.__init__ and extract URL string for convenience
|
il y a 4 ans |
JustAnotherArchivist
|
ca68893a59
|
Run submodules directly within the modules and return results from there instead of processing that externally
|
il y a 4 ans |
JustAnotherArchivist
|
74a6fc7641
|
Use dataclass instead of namedtuple for module results
|
il y a 4 ans |
JustAnotherArchivist
|
07dc1927cf
|
Initial commit
A significant part of this code (e.g. the module loading, HTTP retrieval, CLI) was mostly or entirely copied from snscrape.
|
il y a 4 ans |