Thread
Swapping kidney for mirror of mac.the-underdog.info!
Does someone have a mirror of mac.the-underdog.info? I have quite a lot of mirrors on my disk, but this one is missing 
.
.
yeah, sadly you came to late with the script 
what other mac related mirros do you have?
what other mac related mirros do you have?
Here is a list, the first number is the size of the compressed archive in megabytes:
http://onetbsd.de/mirror/mirrors_done.txt
http://onetbsd.de/mirror/mirrors_done.txt
Just a word of caution for members: I have been mirroring some of the sites on this list, and I think tecneeq's mirrors must be relatively old, because some of the sizes are drastically inaccurate.
I don't mirror everything, usually only parts of certain sites. If there is an archive www.university.org.tgz it might be that inside you only find http://www.university.org/~user/private/mac/.
Also i skip forums, blogs and other such content.
You remember what we talked about, the script that would everyone allow to make their own set of mirrors? I did some initial work and it seems to work fine so far. However, it's not finished yet
.
Also i skip forums, blogs and other such content.
You remember what we talked about, the script that would everyone allow to make their own set of mirrors? I did some initial work and it seems to work fine so far. However, it's not finished yet
.Good point. I've found that downloading forums/blogs with wget takes up a lot of time, as there are literally thousands of files, and there's really not a lot of point in archiving those.I don't mirror everything, usually only parts of certain sites. If there is an archive www.university.org.tgz it might be that inside you only find http://www.university.org/~user/private/mac/.
Also i skip forums, blogs and other such content.
You remember what we talked about, the script that would everyone allow to make their own set of mirrors? I did some initial work and it seems to work fine so far. However, it's not finished yet
Indeed. Since most websites use more or less all the same backends (phpbb2 or 3, wordpress, mediawiki to name just a few), my script could be clever enough to recognize such parts and only download the lean ,,meat''.
Oh, and i switched from tar.gz to info-zip to rar. A website archive compressed with tar.gz needs to be uncompressed when i try to access any files. Wich sucks if the archive has hundreds of megs.
Info-zip seems to have a problem with zip-files bigger than 2 gigs on Debian Lenny, wich is a joke, considering that we are in 2009 and operating systems are internally 64 bit safe for a decade .
Then i tried afio, cpio and finally rar, wich seems to work perfectly on top of posix and win32.
If time permits i can present something to test on osx in the mid of the week. [
] ]'>
Oh, and i switched from tar.gz to info-zip to rar. A website archive compressed with tar.gz needs to be uncompressed when i try to access any files. Wich sucks if the archive has hundreds of megs.
Info-zip seems to have a problem with zip-files bigger than 2 gigs on Debian Lenny, wich is a joke, considering that we are in 2009 and operating systems are internally 64 bit safe for a decade
.Then i tried afio, cpio and finally rar, wich seems to work perfectly on top of posix and win32.
If time permits i can present something to test on osx in the mid of the week. [
] ]'>
Nice one. In the mean time, I've archived about 19GB of stuff, mostly Mac software. 