Page 1 of 1

Archiving ftp.sgi.com

Posted: Tue Nov 07, 2017 12:30 pm
by Dodoid
Hi all!

As we all know, HPE has acquired SGI and is slowly in the process of merging their products into HPEs. For this reason, I am concerned that ftp.sgi.com, which hosts files for systems as far back as the IRIS 3000, may be at risk. I believe that an effort similar to jan-jaap's Techpubs archive may be necessary to permanently protect these files. I don't know much about FTP mirroring, but I presume it is possible. It has a lot of newsgroup archives for SGI-related things, so that could be useful to keep around too.

You can check it out for yourself here, though I suspect most members here have already seen it: ftp://ftp.sgi.com

Just a thought, and probably something we should look into doing soon.

Re: Archiving ftp.sgi.com

Posted: Tue Nov 07, 2017 2:28 pm
by Trippynet
I downloaded a full dump of it a couple of years ago. 28GBs worth...

Re: Archiving ftp.sgi.com

Posted: Tue Nov 07, 2017 2:35 pm
by Raion-Fox
I could mirror it if nobody else wants to.

Re: Archiving ftp.sgi.com

Posted: Tue Nov 07, 2017 2:57 pm
by Dodoid
Currently running an LFTP scan to see how big it is now. Will get back to you.

--

Apparently it's 71GB. Not bad. Will look into mirroring that myself.

Re: Archiving ftp.sgi.com

Posted: Tue Nov 07, 2017 8:27 pm
by marshallh
I tried a bit ago and only got 6gb to download. Many files throw errors.
There are symlinks and so they may be confusing your ftp client.

Re: Archiving ftp.sgi.com

Posted: Tue Nov 07, 2017 8:30 pm
by Raion-Fox
Cloning it myself too

Re: Archiving ftp.sgi.com

Posted: Wed Nov 08, 2017 1:01 am
by jan-jaap
I last ran a mirror in early 2016. I suspect noting MIPS/IRIX related changed ;)

If you exclude a couple of obviously "rackable" directories there's ~ 14GB of material.

Re: Archiving ftp.sgi.com

Posted: Wed Nov 08, 2017 8:57 am
by Raion-Fox
I'm mirroring the ftp site and then manually rifling through and getting rid of the new shit that isn't necessary.

Re: Archiving ftp.sgi.com

Posted: Wed Nov 08, 2017 9:07 am
by Dodoid
I might keep around the rackable bits if I mirror it. Rackable is cool too.

Re: Archiving ftp.sgi.com

Posted: Thu Nov 09, 2017 4:39 am
by uunix
I've just downloaded the lot.
26957 Successful Files
Failed 10 Files
Size 65 GB

A directory called private failed. No surprise there.
3 root files failed, opengl, patches and README & a few other files.

Re: Archiving ftp.sgi.com

Posted: Thu Nov 09, 2017 5:14 am
by jan-jaap
I hope you used something UNIX based capable of mirroring symlinks rather than duplicating the symlink target?

I excluded (from the toplevel):
"private" (unreadable)
"public" (Rackable stuff)
"copan" (COPAN stuff, also seems to contain customer-uploaded logs, bah!)

The remainder takes up 14GB. In my copy I have 3511 symlinks and 17181 files.