little-things

1 Dal

1.7 MiB

Yazar	SHA1	Mesaj	Tarih
JustAnotherArchivist	256a94443e	Fix deduplication within each section processing	4 yıl önce
JustAnotherArchivist	98d77ecc96	Deduplicate output This uses mawk's extensions `-W interactive` and `delete array`; it will probably work with certain other AWK implementations as well, but for now it depends on mawk explicitly.	4 yıl önce
JustAnotherArchivist	6ce64baf87	Remove redundant url-normalise after the extraction Since all input is run through url-normalise before processing and all output of website and social media extraction is also normalised, it's not necessary to re-normalise again at the end.	4 yıl önce
JustAnotherArchivist	869ade27eb	Separate names in stderr annotations for the various url-normalise processes	4 yıl önce
JustAnotherArchivist	79f0bd4332	Normalise URLs everywhere to reduce duplicates	4 yıl önce
JustAnotherArchivist	0f13a1fadd	Add verbosity options, and annotate stderr on wiki-recursive-extract	4 yıl önce
JustAnotherArchivist	5285c406d9	Add script for recursive website and social media discovery	4 yıl önce