Page 1 of 1

creating a mirror

Posted: Tue Dec 19, 2017 4:54 pm
by joshiggins
I am stuck behind a http proxy (plus no ftp proxying) and getting tired of downloading tardists from the index page :cry:

I want to create a mirror, but figured this is the best place to ask as a courtesy if that is okay, since I guess it will use some bandwidth.

Mostly for my own gain, but I will open it up to the wider world too so other people can benefit. It should be quite speedy in the UK (especially if you are on JANET :lol:). We used to do several GBs of gridftp transfers back in the day, so I don't think usage from the nekochan community will be problematic.

Re: creating a mirror

Posted: Tue Dec 19, 2017 6:34 pm
by foetz
i guess you mean the nekochan ftp. but either way this is a question for neko directly

Re: creating a mirror

Posted: Wed Dec 27, 2017 5:36 pm
by Dodoid
I mirrored it using rsync, which worked OK for me.

Re: creating a mirror

Posted: Sat Jan 20, 2018 7:41 pm
by dclough
This is a small script I wrote to manage my mirror at https://nekoware.bufferoverflow.xyz:

Code: Select all

#!/usr/bin/env bash
########## BEGIN CONFIGURATION ##########
RSYNC_OPTS="-av --delete"
SOURCE=rsync.nekochan.net
SOURCE_REPO=nekoware
DEST_DIR=/opt/mirrors/nekoware
LOG_DIR=/var/log/nekoware
RUN_TIMESTAMP=`date +%Y-%m-%d_%H:%M:%S`
SYNC_LOG=$LOG_DIR/sync_$RUN_TIMESTAMP.log
########### END CONFIGURATION ###########

/usr/bin/rsync $RSYNC_OPTS $SOURCE::$SOURCE_REPO $DEST_DIR > $SYNC_LOG 2>&1

find $LOG_DIR -mtime +7 -exec rm {} \;


I can't speak for Nekonoko's mirror but you are more than welcome to pull a full copy from mine via rsync. It's a 1Gbps connection located in the midwest US. You can use the script above and set SOURCE to "nekoware.bufferoverflow.xyz". I also have several other SGI-related archives available on the same server.

Re: creating a mirror

Posted: Thu Feb 01, 2018 5:39 am
by joshiggins
dclough wrote:I can't speak for Nekonoko's mirror but you are more than welcome to pull a full copy from mine via rsync.


Cheers dclough, this was the answer I was looking for ;)