To continue my travails:
Httrack didn’t do a great job: It was slow, even copying from the same machine, and it flattened the directory structure of the website it was writing, making it almost un-navigable.
Here’s where Cyotek WebCopy shines: It’s copying the website from SurfOffline’s database webserver quickly, so I should have the entire website re-extracted very soon!
Then ye need plenty of wenches! And he-wenches and nonbinary wenches, if ye be that way!
And grog! Plenty of grog!
The problem with older media is that you have to actively create torrents, the tracker might fold, etc.
With eD2K, it’s very old school P2P filesharing, just give it a directory and the files on it are shared on the network.
Of course, the “push” part to torrent tracker sites isn’t as active.
I use both torrents and eD2K, depending on what I’m looking for.
I installed and played around with ArchiveBox after your suggestion.
The login/cookie copying function seems to be oriented to how Chromium is installed on Linux, which I don’t have up and running in any meaningful way, and there doesn’t seem to be any support place where I can ask questions.
Okay, I found SurfOffline that does the trick without too much hassle, but…
It’s verrrrrrrry slooooooooow.
It uses Internet Explorer as a module, and calls each individual resource separately, instead of file copying from IE’s cache, which is weird and slow, especially when hundreds of images are involved.
And SurfOffline doesn’t appear to be supported anymore, i.e. the support email’s inbox is full.
edit: Aaaaand SurfOffline doesn’t save to .html files with a directory structure!!! It stores everything in some kind of sql database, and it only saves to .mht and .chm files, which are deprecated Microsoft help file formats!!!
What it does have is a built in web server that only works while the program is running.
So what I plan to do is have the program up but doing nothing, while I sick Httrack on the 127.0.0.1 web address for my ripped website.
Httrrack will hopefully “extract” the website to .html format.
Whew, what a hassle!
It takes a lot of things to happen before a post gets federated to another instances.
This thread is supposed to explain it: https://lemmy.ml/post/1408175
Cross-instance content transmission is so poor, that de-federation is a moot point.
You effectively have to sign up for your own lemmynsfw account if you actually want to access most of the content that is posted there.
Irony because here I am posting cross-instance.
Webcopy looks promising if I can get the crawler part of it to work with this site’s authentication…
edit: I couldn’t get Webcopy’s spider to authenticate correctly.
Webcopy uses the deprecated version of Internet Explorer in Windows 10 as a module, and I can log into the website using the Capture Forms browser dialog, but the cookies or whatever else don’t translate over to the spider.
Interesting idea. Unfortunately the cookies weren’t in cleartext in the page headers. I found the cookies values in the networking values, pasted them into htttrack, but that didn’t work.
My html cookie-fu is weak.
I have an account, so that’s not a problem. The problem is how to automate going into every little content page and downloading the content, including the hi-res files.
Httrack doesn’t allow me to log into the website. The only security feature it has is http authorization, and this particular website has a plain web login.
For a lot of people: Porn, and easy access to otherwise obscure interests.
Mobygames is the place for abandonware games.
I also remember people made a more-or-less complete archive of US Playstaion 1 games and distributed it via Usenet IIRC
Get thee to eD2K.
They have a smattering of magazines back to the 70s. It’s far from a complete archive, and the scan quality varies tremendously but it’s there.
Otherwise, try to get an empornium account. Nearly everything porn ever is there.