creating a mirror

Opinions, ideas and thoughts about Nekochan Net.
joshiggins
Posts: 13
Joined: Sat Nov 19, 2016 3:05 pm

creating a mirror

Unread postby joshiggins » Tue Dec 19, 2017 4:54 pm

I am stuck behind a http proxy (plus no ftp proxying) and getting tired of downloading tardists from the index page :cry:

I want to create a mirror, but figured this is the best place to ask as a courtesy if that is okay, since I guess it will use some bandwidth.

Mostly for my own gain, but I will open it up to the wider world too so other people can benefit. It should be quite speedy in the UK (especially if you are on JANET :lol:). We used to do several GBs of gridftp transfers back in the day, so I don't think usage from the nekochan community will be problematic.
:Octane2: :Octane: :Octane:

User avatar
foetz
Moderator
Moderator
Posts: 6704
Joined: Mon Apr 14, 2003 4:34 am
Contact:

Re: creating a mirror

Unread postby foetz » Tue Dec 19, 2017 6:34 pm

i guess you mean the nekochan ftp. but either way this is a question for neko directly

User avatar
Dodoid
Posts: 736
Joined: Mon Jul 04, 2016 1:36 pm
Location: Ottawa, Canada
Contact:

Re: creating a mirror

Unread postby Dodoid » Wed Dec 27, 2017 5:36 pm

I mirrored it using rsync, which worked OK for me.
:Onyx: :O2000: :Fuel: :Octane: :Octane: :Octane: :O2: :O2: :Indigo2: :Indigo2: :Indy: :Indy:
and a small army of Image

User avatar
dclough
Posts: 195
Joined: Mon Jan 18, 2010 7:59 pm
Contact:

Re: creating a mirror

Unread postby dclough » Sat Jan 20, 2018 7:41 pm

This is a small script I wrote to manage my mirror at https://nekoware.bufferoverflow.xyz:

Code: Select all

#!/usr/bin/env bash
########## BEGIN CONFIGURATION ##########
RSYNC_OPTS="-av --delete"
SOURCE=rsync.nekochan.net
SOURCE_REPO=nekoware
DEST_DIR=/opt/mirrors/nekoware
LOG_DIR=/var/log/nekoware
RUN_TIMESTAMP=`date +%Y-%m-%d_%H:%M:%S`
SYNC_LOG=$LOG_DIR/sync_$RUN_TIMESTAMP.log
########### END CONFIGURATION ###########

/usr/bin/rsync $RSYNC_OPTS $SOURCE::$SOURCE_REPO $DEST_DIR > $SYNC_LOG 2>&1

find $LOG_DIR -mtime +7 -exec rm {} \;


I can't speak for Nekonoko's mirror but you are more than welcome to pull a full copy from mine via rsync. It's a 1Gbps connection located in the midwest US. You can use the script above and set SOURCE to "nekoware.bufferoverflow.xyz". I also have several other SGI-related archives available on the same server.

joshiggins
Posts: 13
Joined: Sat Nov 19, 2016 3:05 pm

Re: creating a mirror

Unread postby joshiggins » Thu Feb 01, 2018 5:39 am

dclough wrote:I can't speak for Nekonoko's mirror but you are more than welcome to pull a full copy from mine via rsync.


Cheers dclough, this was the answer I was looking for ;)
:Octane2: :Octane: :Octane:


Return to “Nekochan Net”

Who is online

Users browsing this forum: No registered users and 2 guests