arkiver
|
e183dd0578
|
Update megawarc.
|
3 years ago |
Arkiver2
|
b3b55e58f1
|
Merge pull request #16 from ArchiveTeam/variable-quoting
properly quote all variables
|
3 years ago |
Arkiver2
|
ba1a541982
|
Replace space in ZST_DICTIONARY_API.
|
3 years ago |
Katie Holly
|
7ee94bb579
|
properly quote all variables
|
3 years ago |
km09
|
fc8fb7e90c
|
Add requests module
|
3 years ago |
km09
|
a624f9dec2
|
Make dockerfile valid
|
3 years ago |
arkiver
|
a53947ae4d
|
Use archiveteam megawarc repo. Install zstd packages.
|
3 years ago |
km09
|
a487eb74f1
|
docker support for zst dictionary
|
3 years ago |
arkiver
|
0bab30f0db
|
Update megawarc submodule.
|
3 years ago |
arkiver
|
e6f8a5d1be
|
Support packing ZST megaWARCs.
|
3 years ago |
km09
|
a78330284e
|
Change formatting
|
3 years ago |
km09
|
aa636af8a1
|
Add details about offloader
|
3 years ago |
km09
|
b2b2645dd5
|
Fix newlines, and data location.
|
3 years ago |
Matt Iggo
|
960d8c99b1
|
Create docker-boot.sh
Initial checkin
|
3 years ago |
Matt Iggo
|
d498c8539b
|
Create Dockerfile
Initial checkin
|
3 years ago |
km09
|
d65f4deaa2
|
Correct notorrent -> noarchivetorrent
01:57:03 <@SketchCow> I have been informed the field name is "noarchivetorrent", not "notorrent". My apologies.
|
3 years ago |
arkiver
|
bb12e95de7
|
Do not create a .torrent file.
|
3 years ago |
km09
|
726ce05e67
|
Mention offload-multiple
|
4 years ago |
km09
|
ae78e479e3
|
Merge pull request #15 from Fusl/rsync-opts
Additional rsync options for better connection timeout handling + increase performance
|
4 years ago |
Katie Holly
|
716181cde8
|
Additional rsync options for better connection timeout handling + increase performance
|
4 years ago |
km09
|
e5f60948ba
|
Merge pull request #14 from Fusl/offload-target-list
Offload target list
|
4 years ago |
Katie Holly
|
4d588ae2cd
|
add config note for offload_targets file
|
4 years ago |
Katie Holly
|
99f3db9540
|
Attempting to make rsync transaction more atomic
|
4 years ago |
Katie Holly
|
6773df8eae
|
suppress grep output
|
4 years ago |
km09
|
9908cf1f7a
|
Merge pull request #13 from Fusl/offload-target-list
Allow specifying dynamic offload target list file instead of env var
|
4 years ago |
Katie Holly
|
c7461a8503
|
Allow specifying dynamic offload target list file instead of env var
|
4 years ago |
Christopher Foo
|
12fdba4837
|
Merge pull request #12 from Fusl/fix-offloader
rsync empty files in offloader & skip non-existing tar files in uploader
|
4 years ago |
Katie Holly
|
e5055f79e7
|
rsync empty files in offloader & skip non-existing tar files in uploader
Fixes #11
|
4 years ago |
Arkiver2
|
0c4ed4bbdd
|
Merge pull request #9 from Fusl/offloader
Add offload script
|
4 years ago |
Katie Holly
|
3ad2e27bd9
|
Remove debug exit
|
4 years ago |
Katie Holly
|
455f576308
|
Add offload script
|
4 years ago |
Arkiver2
|
c39208e1fe
|
Never overwrite file
|
4 years ago |
Arkiver2
|
73e8a75783
|
Merge pull request #8 from Fusl/master
Append first 8 characters of UUIDv4 hex to avoid collision
|
4 years ago |
Katie Holly
|
f88d14b2a2
|
Use timestamp and first 8 characters of UUIDv4 hex
|
4 years ago |
Katie Holly
|
8c4d44189d
|
use uuids instead of %Y%m%d%H%M%S stamps
|
4 years ago |
km09
|
923661847f
|
Add sleep between generating chunks.
Resolves #5, at the cost of slightly slower chunking.
|
4 years ago |
Christopher Foo
|
3c0f50a00d
|
Merge pull request #4 from falconkirtaran/master
Modify IA S3 URL to use https due to cleartext secret in Authorization: header
|
6 years ago |
Falcon Darkstar Momot
|
aef1991483
|
Modify IA S3 URL to use https due to cleartext secret in Authorization: header
|
7 years ago |
Terry Wrist
|
f45bab55ef
|
Add megawarc as submodule
|
9 years ago |
Terry Wrist
|
553e85e70d
|
Revert "Revert "alard/megawarc -> ArchiveTeam/megawarc""
This reverts commit 5849adf3f2 .
|
9 years ago |
Terry Wrist
|
a7c0436cb1
|
Revert "Update config.example.sh"
This reverts commit f3c57116c5 .
|
9 years ago |
Terry Wrist
|
a8cfebae66
|
Fix upload-one
|
9 years ago |
Terry Wrist
|
5849adf3f2
|
Revert "alard/megawarc -> ArchiveTeam/megawarc"
This reverts commit ca976f595b .
|
9 years ago |
Terry Wrist
|
f3c57116c5
|
Update config.example.sh
|
9 years ago |
Terry Wrist
|
fd95debed5
|
Update upload-one
|
9 years ago |
Ivan Kozik
|
ca976f595b
|
alard/megawarc -> ArchiveTeam/megawarc
|
9 years ago |
Ivan Kozik
|
71a36ba157
|
Merge pull request #1 from ludios/master
Make chunker faster by avoiding repeated du
|
9 years ago |
Ivan Kozik
|
28ba3a7685
|
Make chunker much faster on big current/ directories by not du'ing it for every file
|
10 years ago |
Alard
|
8dc09b1e79
|
New script: du-all
|
10 years ago |
Alard
|
6aff44239a
|
Grammar.
|
10 years ago |