Diff for "Debmirror"


Differences between revisions 1 and 3 (spanning 2 versions)
Revision 1 as of 2006-08-07 13:38:18
Size: 6436
Editor: ppp231-45
Comment: moved from my home at KarlGoetz on w.u.c
Revision 3 as of 2007-02-13 07:15:39
Size: 6843
Editor: 63-227-97-120
Comment: Added plug for the Rsyncmirror page
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
## page was renamed from DebmirrorHowto
Line 12: Line 13:

Another method is to use rsync. The [http://help.ubuntu.com/community/Rsyncmirror Rsyncmirror] page goes into greater detail on this method. Rsync can create a full mirror of a site and selects files indiscriminately. Debmirror, however, does allow for better control over which packages are mirrored and can be easier on the amount of hard drive space required.

To build a mirror with debmirror follow these steps

This is not covering all use cases but it will allow you experiment. To do this safely 8.2 gigs of space are need main source and binaries. This number grows a lot as time progresses.

Alternative Consideration

If you want to download all the apt binaries for all boxes onto one box on a network then maybe apt-cache or a transparent proxy is all you need.

Another method is to use rsync. The [http://help.ubuntu.com/community/Rsyncmirror Rsyncmirror] page goes into greater detail on this method. Rsync can create a full mirror of a site and selects files indiscriminately. Debmirror, however, does allow for better control over which packages are mirrored and can be easier on the amount of hard drive space required.

Start The Mirror Build Process

Open gnome-terminal by clicking Applications -> Accessories -> Terminal. BRIf your sources list has universe enabled, skip the next step. BROpen your sources list (sudo editor /etc/apt/sources.list), and add the following line BRdeb http://*.archive.ubuntu.com/ubuntu/ dapper universe BRThen save and return to a prompt.

Update the package lists (sudo apt-get update) and then install debmirror (sudo apt-get install debmirror). BR Now we have to create a directory to save the files too. The aproximate size of the components of the mirror (i386 only) are: # Cant have these at teh end of lines - they break the formatting. # dapper is approx including sources. (not including restricted) # Changes over time. # Changes over time.

dapper

8.2G

main

dapper-security

?G

main, restricted, universe, multiverse

dapper-updates

?G

main, restricted, universe, multiverse

breezy

11G

main

breezy-security

493M

main, restricted, universe, multiverse

breezy-updates

182M

main, restricted, universe, multiverse

hoary

~9G

main

hoary-security

1.2G

main, restricted, universe, multiverse

hoary-updates

144M

main, restricted, universe, multiverse

Please ensure where ever you make the mirror has room for the packages you want to download! BR(If you are more advanced you can make different parts of the mirror on different volumes, but thats not something for this howto). BRWe will make our mirror on /home/ with

sudo mkdir /home/UbuntuMirror

Create the file `mirrorBuild.sh`

Now to create mirrorBuild.sh BROpen your prefered editor thus

sudo editor /home/UbuntuMirror/mirrorBuild.sh

Copy the text from the box below into the editor. BRYou may omit the lines starting with # (NB EXCEPTION the line that starts #!/bin/bash must be left in.)

Contents of the mirror script, please adapt it to your needs

#### Start script to automate building of Ubuntu mirror #####
## THE NEXT LINE IS NEEDED THE REST OF THE LINES STARTING WITH A # CAN BE DELETED

#!/bin/bash

## Setting variables with explanations.

# Arch=         -a      # Architecture. For Ubuntu can be i386, powerpc or amd64.
# sparc, only starts in dapper, it is only the later models of sparc
#
arch=i386

# Minimum Ubuntu system requires main, restricted
# Section=      -s      # Section (One of the following - main/restricted/universe/multiverse).
#
section=main,restricted,universe,multiverse

# Release=      -d      # Release of the system (Hoary, Breezy, Dapper, Edgy), and the -updates and -security ( -backports can be added if desired)
#
release=dapper,dapper-security,dapper-updates

# Server=       -h      # Server name, minus the protocol and the path at the end
# CHANGE "*" to equal the mirror you want to create your mirror from. au. in Australia  ca. in Canada.
# This can be found in your own /etc/apt/sources.list file, assuming you have Ubuntu installed.
#
server=*.archive.ubuntu.com

# Dir=          -r      # Path from the main server, so http://my.web.server/$dir, Server dependant
#
inPath=/ubuntu

# Proto=        -e      # Protocol to use for transfer (http, ftp, hftp, rsync)
# Choose one - http is most usual the service, and the service must be avaialbe on the server you point at.
#
proto=http

# Outpath=              # Directory to store the mirror in
# Make this a full path to where you want to mirror the material.
#
outPath=/home/UbuntuMirror

# The --nosource option only downloads debs and not deb-src's
# The --progress option shows files as they are downloaded
# --source \ in the place of --nosource \ if you want sources also.
# Start script
#
debmirror       -a $arch \
                --nosource \
                -s $section \
                -h $server \
                -d $release \
                -r $inPath \
                --progress \
                -e $proto \
                --ignore-release-gpg \
                $outPath


#### End script to automate building of Ubuntu mirror ####

How to use the file

  • Save the file and exit.
  • Now change the permissions and ownership on the mirror and the script. The group name is your username:

sudo chown -R root.username /home/UbuntuMirror
sudo chmod -R 571 /home/UbuntuMirror
  • And the final part of setting up the mirror is to download the files

cd /home/UbuntuMirror
./mirrorBuild.sh

Now walk away. Your machine has a lot of downloading to do!

Set up the mirror

We need to install Apache2, you could choose apache version 1.3 but that is beyond the scope of this document. BR We can do this with sudo apt-get install apache2 BR BR Then (for simplicity sake) lets make a link from /home/UbuntuMirror to /var/www/ubuntu.

ln -s /home/UbuntuMirror /var/www/ubuntu

This means when you go to download from your mirror, you will visit http://mirrorbox/ubuntu/. BR BR Right! So we have all the packages, and a working server. Now we need to set up the clients.

Set up a client system

Open a terminal and enter

cd /etc/apt
sudo mv sources.list sources.list.orig
sudo editor sources.list

Now in your editor, put the following lines:

# Local network mirror sources.
deb http://mirrorbox/ubuntu dapper main restricted universe multiverse
deb http://mirrorbox/ubuntu dapper-updates main restricted universe multiverse
deb http://mirrorbox/ubuntu dapper-security main restricted universe multiverse

Then save and exit BR If you then run

sudo apt-get update
sudo apt-get dist-upgrade

you should be updating from your new server!


CategoryDocumentation

Debmirror (last edited 2021-12-19 22:55:48 by eiden)