Size: 19954
Comment:
|
Size: 12004
Comment:
|
Deletions are marked like this. | Additions are marked like this. |
Line 1: | Line 1: |
## page was copied from UEC | |
Line 3: | Line 4: |
= Getting Started with Ubuntu Enterprise Cloud powered by Eucalyptus = '''Note:''' Please see [[Eucalyptus-Jaunty]] for documentation covering Eucalyptus on Ubuntu 9.04. |
= Getting Started with Ubuntu Enterprise Cloud = |
Line 10: | Line 8: |
The Eucalyptus Cloud Computing system is highly configurable, allowing it to be customized to fit a wide variety of environments. This installation tutorial covers setting up a Eucalyptus private cloud. |
The Ubuntu Enterprise Cloud (UEC), powered by Eucalyptus, is highly configurable and customizable to a variety of environments. This tutorial covers UEC installation from the Ubuntu 9.10 Server Edition CD, and assumes a basic network topology, with a single system serving as the "all-in-one controller", and one or more nodes attached. [[UEC/PackageInstall|Another tutorial exists]] describing how to deploy UEC on already installed Ubuntu servers, or if you want to deploy a more complex network topology, with multiple clusters, or running the required cloud services from separate physical machines. == Terminology == You should be familiar with the [[UEC/GLossary]]. These terms are used throughout the documentation. |
Line 17: | Line 19: |
perform several operations on a basic Eucalyptus setup that results in a cloud with a one controller "front-end" and one node for running Virtual Machine (VM) instances (steps 1, 2, and 3). You will also use examples to help get you started using your own private compute cloud and, optionally, how to register your private cloud with the RightScale Cloud Management Platform (steps 4, 5, and 6). |
perform several operations on a basic UEC setup that results in a cloud with a one controller "front-end" and one or several node(s) for running Virtual Machine (VM) instances. You will also use examples to help get you started using your own private compute cloud. |
Line 25: | Line 25: |
2. Installation and Configuration 3. Registering Eucalyptus components 4. Initial Login and optional Cloud Registration 5. Creating a Virtual Machine (VM) image 6. Running your image |
1. Install the Cloud/Cluster controller 1. Install the Node controller(s) 1. Credentials setup 1. Bundle a UEC Image 1. Running an image |
Line 34: | Line 34: |
A Eucalyptus system includes the following high level packages: 1. eucalyptus-cc - includes the Cluster Controller that provides support for the virtual network overlay 2. eucalyptus-cloud - includes the front-end services (Cloud Controller) as well as the Walrus storage system. 3. eucalyptus-nc - includes the Node Controller that interacts with [[KVM]] to manage individual VMs In a basic Eucalyptus setup, the system is composed of two machines (a front-end and a node). The front end runs both `eucalyptus-cloud` and `eucalyptus-cc` in this configuration. The node runs the node controller, `eucalyptus-nc`. It is possible to separate the clound controller and cluster controller in a more complex multi-host setup. The following diagram depicts a simple setup: {{http://pompone.cs.ucsb.edu/~nurmi/images/euca-topo-nonet.png}} Before you install the packages (or shortly thereafter), there are some prerequisites that should be satisfied to end up with a fully functioning Eucalyptus system. * The Eucalyptus administrator tools will use email to send verification requests to the cloud administrator when users request credentials. The cloud controller will send mail through the host `mailhost`. <<BR>> The simplest way to enable these tools to send mail is to install the 'postfix' package and make sure that the host `mailhost` resolves to `localhost` (e.g. by adding an entry to `/etc/hosts`). On the cloud controller system: {{{ $ sudo apt-get install postfix # Answer questions (suggest 'Internet Site') $ sudo vi /etc/hosts # add 'mailhost' to the localhost line $ grep mailhost /etc/hosts 127.0.0.1 localhost mailhost }}} * On each node, configure the system's primary ethernet interface as a bridge. (See the [[http://doc.ubuntu.com/ubuntu/serverguide/C/network-configuration.html#bridging|Ubuntu Server Guide Bridging]] for details). The node controller will attach virtual network interfaces to this bridge for VM that is started before it to enable network connectivity. <<BR>> ''Note:'' Remember the name of your node's bridge device (we assume the name of your bridge device is "`br0`" for the rest of this document). * The default Eucalyptus configuration assumes that there is a DHCP server in your environment that is handing out dynamic IP addresses. Since VMs will be bridged to your local network, they can run a DHCP client to get an IP address. * From any host that you wish to use as a Eucalyptus client, you should install the `euca2ools` package from universe: {{{ |
To deploy a minimal cloud infrastructure, you’ll need at least two dedicated systems. ==== Front End ==== One system will run: * the cloud controller (clc) * the cluster controller (cc) * walrus (the S3-like storage service) * the storage controller (sc) The following are recommendations are not fixed requirements. However, our experience in developing this documentation indicated the following suggestions: || '''Hardware''' || '''Minimum''' || '''Suggested''' || '''Notes''' || || CPU || 1GHz || 2 x 2GHz || for an all-in-one front end, it helps to have at least a dual core processor || || Memory || 1GB || 2GB || the Java web front end benefits from lots of available memory || || Disk || 5400rpm IDE || 7200rpm SATA || slower disks will work, but will yield much longer instance startup times || || Disk Space || 40GB || 100GB || 40GB is only enough space for only a single image, cache, etc., Eucalyptus does ''not'' like to run out of disk space || || Networking || 100Mbps || 1000Mbps || machine images are hundreds of MB, and need to be copied over the network to nodes || ==== Node(s) ==== The other system(s) are nodes, which will run: * the node controller (nc) These systems will actually run the instances. You will need one or more systems with: || '''Hardware''' || '''Minimum''' || '''Suggested''' || '''Notes''' || || CPU || VT extensions || VT, 64-bit, Multicore || 64-bit can run both i386, and amd64 instances; by default, Eucalyptus will only run 1 VM per CPU core on a Node || || Memory || 1GB || 4GB || additional memory means more, and larger guests || || Disk || 5400rpm IDE || 7200rpm SATA or SCSI || Eucalyptus nodes are disk-intensive; I/O wait will likely be the performance bottleneck || || Disk Space || 40GB || 100GB || images will be cached locally, Eucalyptus does ''not'' like to run out of disk space || || Networking || 100Mbps || 1000Mbps || machine images are hundreds of MB, and need to be copied over the network to nodes || === STEP 2: Install the Cloud/Cluster controller === 1. Download the 9.10 Server ISO. 1. When you boot, select “Install Ubuntu Enterprise Cloud”. <<BR>> {{attachment:private1-cr.png}} 1. When asked whether you want a “Cluster” or a “Node” install, select “Cluster”. <<BR>> {{attachment:cluster-node-cr.png}} 1. It will ask two other cloud-specific questions during the course of the install: 1. Name of your cluster: pick any name you want :) 1. Public IP addresses on the LAN that the cloud can allocate to instances: enter a range of unused IP addresses on your LAN. === STEP 3: Install the Node controller(s) === The node controller install is even simpler. Just make sure that you are connected to the network on which the cloud/cluster controller is already running. 1. Boot from the same ISO 1. Select “Install Ubuntu Enterprise Cloud”. 1. It should detect the Cluster and preselect “Node” install for you. 1. After all nodes are installed, you need to return to the cloud/controller and run the following command to make it “discover” your newly-installed nodes. {{{ $ sudo euca_conf --no-rsync --discover-nodes }}} 1. Confirm all the nodes it finds, and you are done. === STEP 4: Credentials setup === The first time the cloud controller boots, you are required to go through some configuration steps that set up the administrative environment for the cloud. 1. From your web browser (either remotely or on your Ubuntu server) access the following URL: {{{ https://<cloud-controller-ip-address>:8443/ }}} ||<style="background-color: #91f49f;"> '''Important!''' You must use a secure connection, so make sure you use "https" not "http" in your URL. You will get a security certificate warning. You will have to add an exception to view the page. If you do not accept it you will not be able to view the Eucalyptus configuration page.|| 1. Use username 'admin' and password 'admin' for the first time login (you will be prompted to change your password). 1. Then follow the on-screen instructions to update the admin password and email address. 1. Once the first time configuration process is completed, click the 'credentials' tab located in the top-left portion of the screen. <<BR>>{{attachment:UECcredentials-2.png}} 1. Click the 'Download Credentials' button to get your certificates. Now you will need to setup EC2 API and AMI tools on your server using X.509 certificates. 1. Unzip the downloaded zipfile into a safe location (~/.euca), 1. Source the included "eucarc" file to set up your Eucalyptus environment. {{{ $ . ~/.euca/eucarc }}} You may additionally wish to add this command to your ~/.bashrc file so that your Eucalyptus environment is set up automatically when you log in. Eucalyptus treats this set of credentials as 'administrator' credentials that allow the holder global privileges across the cloud. As such, they should be protected in the same way that other elevated-priority access is protected (e.g. should not be made visible to the general user population). 1. Install the required cloud user tools: {{{ |
Line 61: | Line 111: |
}}} Also, other tools that can interact with the EC2 and S3 APIs should work with Eucalyptus. * If you wish to access Eucalyptus from behind a firewall (i.e. the `euca2ools` tools and the cloud controller will be on different sides of a firewall) then port `8773` ''must'' be open on the cloud controller. Additionally, if you plan to register your Eucalyptus installation with a cloud management platform, `8773` and `8443` must be open. === STEP 2: System Installation and Configuration === Install the eucalyptus-cloud and eucalyptus-cc packages on the front-end machine: {{{ $ sudo apt-get install eucalyptus-cloud eucalyptus-cc }}} Next, install the eucalyptus-nc package on each node: {{{ $ sudo apt-get install eucalyptus-nc }}} Finally, on the node, bring down the eucalyptus-nc service and modify `/etc/eucalyptus/eucalyptus.conf` with the name of the bridge that you set up as the node's primary interface. Note that there are several ways to configure a node to have a bridge as its primary interface, depending on the configuration of your machine. We show an example set of steps [[Eucalyptus+bridge|here]] but you will need to take care to ensure that this example configuration does not conflict with your local configuration if you wish to use it. However you have arranged for the bridge to be configured, you need to specify that bridge name ("`br0`" in our examples) in the node controller's configuration. To do so, type {{{ $ sudo /etc/init.d/eucalyptus-nc stop $ sudo vi /etc/eucalyptus/eucalyptus.conf # set VNET_BRIDGE="br0" $ sudo /etc/init.d/eucalyptus-nc start }}} The following diagram depicts what your setup should now resemble: {{http://pompone.cs.ucsb.edu/~nurmi/images/euca-topo.png}} You will also need to change your networking configuration to make it so that IPv4 traffic is passed to IPv6 ports since the Eucalyptus web frontend runs by default only on IPv6. To do so, type {{{ $ sudo vi /etc/sysctl.conf # uncomment net.ipv4.ip_forward=1 # (it may not be commented out) $ sudo sysctl -p }}} Also, you may have noticed a message such as: {{{ apache2: Could not reliably determine the server's fully qualified domain name, using 127.0.0.1 for ServerName }}} Eucalyptus has it's own Apache config, you can add your ServerName statement there to make that go away, just edit ''/etc/eucalpytus/httpd.conf'' to begin somewhat like this: {{{ # # This is the apache config for eucalyptus: we use it only to load the # axis2c module which will take care of the WebServices # ServerTokens OS ServerName WHATEVER_YOUR_HOSTNAME_IS_HERE ServerRoot "/tmp" Listen 8774 KeepAliveTimeout 30 }}} You can verify that this resolved the issue by running {{{ sudo dpkg-reconfigure eucalyptus-nc }}} === STEP 3: Registering Eucalyptus Components === Eucalyptus assumes that each node in the system belongs to a cluster and that each cluster belongs to a cloud. Each node (there is only one node in this example) runs a copy of eucalyptus-nc. Similarly, each cluster (again, there is only one cluster in this example) must run a copy of eucalytpus-cc. For simplicity, the eucalyptus-cc in this example runs on the same machine as the cloud controller (eucalyptus-clc). These components must be registered with each other before the system starts. To register a cluster, execute the following on the cloud controller: {{{ $ sudo euca_conf -addcluster <clustername> localhost }}} where <clustername> is the name that you would like this cluster to appear as to your users. Note that this name is logical and local only to Eucalyptus. It will correspond to an availability zone in the output of the client tools. Next, register your node with the cluster by running the following command on the clound controller: {{{ $ sudo euca_conf -addnode <node_hostname> }}} Later, you can add more nodes by repeating the above command for each node running a copy of eucalyptus-nc. At this point, your Eucalyptus system should be up and running, ready for first time use. === STEP 4: Initial Login === The first time the cloud controller boots, you are required to go through some configuration steps that set up the administrative environment for the cloud. From your web browser (either remotely or on your Ubuntu server) access the following URL: {{{ https://<cloud-controller-ip-address>:8443/ }}} Use username 'admin' and password 'admin' for the first time login (you will be prompted to change your password). You can use "localhost" instead of your front-end's IP address if you are on that server. Now follow the on-screen instructions. When you finish the first time configuration process, click the 'credentials' tab located in the top-left portion of the screen. Click the 'Download Certificate' button to get your credentials. {{http://pompone.cs.ucsb.edu/~nurmi/images/euca-admin-cred.png}} ''Important!'' You must use a secure connection, so make sure you use "https" not "http" in your URL. You will get a security certificate warning. You will have to add an exception to view the page. If you do not accept it you will not be able to view the Eucalyptus configuration page. Now you will need to setup EC2 API and AMI tools on your server using X.509 certificates. Unzip the downloaded zipfile into a safe location (~/.euca), and source the included "eucarc" file to set up your Eucalyptus environment. You may additionally wish to add this command to your ~/.bashrc file so that your Eucalyptus environment is set up automatically when you log in. Eucalyptus treats this set of credentials as 'administrator' credentials that allow the holder global privileges across the cloud. As such, they should be protected in the same way that other elevated-priority access is protected (e.g. should not be made visible to the general user population). Alternatively, you can script the installation using [[Eucalyptus+environment | these instructions]]. ==== Optional Registration With RightScale ==== !RightScale offers a Cloud Management Platform for use with Eucalyptus, both as a ''free'' services and through paid subscriptions. This cloud management software runs as a service within Amazon's AWS so it must be able to communicate with the Eucalyptus cloud controller (eucalyptus-clc) through any firewalls that separate the public Internet from where eucalyptus-clc is running. Thus ports 8443 and 8773 must be open to the public Internet for !RightScale to be able to communicate with your Eucalyptus cloud. To register your Eucalyptus cloud with !RightScale's service, see [[http://wiki.rightscale.com/2._References/02-Cloud_Infrastructures/Eucalyptus/03-Administration_Guide/Register_with_RightScale?ls=Referral&sd=%3EPartner_Ubuntu_Partnerpage&campaign=70170000000KyOn | Register my cloud with RightScale ]] === STEP 5: Obtain a Virtual Machine (VM) Image === There is more than one way to obtain a virtual image. The easiest way is to simply download one of the [[http://uec-images.ubuntu.com/releases/karmic/|Official Ubuntu UEC Images]]. Alternatively, if you would want to author your own image, you can use the [[https://help.ubuntu.com/community/Eucalyptus#Using%20vmbuilder | vmbuilder procedure below]] to create an image. {{{ $ wget http://uec-images.ubuntu.com/releases/karmic/<release>/ubuntu-uec-karmic-i386.img.gz }}} Next, you will need to bundle, upload and register a kernel, ramdisk and finally your image. Using the EC2 API tools, perform the following steps: {{{ # bundle and upload the systems kernel $ mkdir kernel $ euca-bundle-image --image /boot/vmlinuz-$(uname -r) \ --destination ./kernel --kernel true $ euca-upload-bundle --bucket kernel \ --manifest ./kernel/vmlinuz-$(uname -r).manifest.xml $ EKI=`euca-register kernel/vmlinuz-$(uname -r).manifest.xml | awk '{print $2}'` $ echo $EKI # create a ramdisk with acpiphp, bundle and upload $ mkdir ramdisk $ sudo sh -c 'grep -q acpiphp /etc/initramfs-tools/modules || printf "#acpiphp needed for ebs\nacpiphp\n" > /etc/initramfs-tools/modules' $ sudo mkinitramfs -o ./ramdisk/initrd.img-$(uname -r) $ euca-bundle-image --image ./ramdisk/initrd.img-$(uname -r) \ --destination ./ramdisk --ramdisk true $ euca-upload-bundle --bucket ramdisk \ --manifest ramdisk/initrd.img-$(uname -r).manifest.xml $ ERI=`euca-register ramdisk/initrd.img-$(uname -r).manifest.xml | awk '{print $2}'` $ echo $ERI # uncompress, bundle the image $ mkdir image $ zcat ubuntu-uec-karmic-i386.img.gz | cp --sparse=always /dev/stdin ubuntu-uec-karmic-i386.img $ euca-bundle-image --image ubuntu-uec-karmic-i386.img \ --destination ./image --kernel $EKI --ramdisk $ERI $ euca-upload-bundle --bucket image --manifest ./image/root.img.manifest.xml $ EMI=`euca-register image/root.img.manifest.xml | awk '{print $2}'` $ echo $EMI }}} ''Note'' the shell variables that have been set in the above code snippets. They will be used to test the installation in the steps below. Now, your kernel, ramdisk and image will have been uploaded into Eucalyptus and should be ready to run. To confirm, run the following command: {{{ |
}}} 1. To validate that everything is working correctly, get the local cluster availability details: {{{ $ . ~/.euca/eucarc $ euca-describe-availability-zones verbose AVAILABILITYZONE myowncloud 192.168.1.1 AVAILABILITYZONE |- vm types free / max cpu ram disk AVAILABILITYZONE |- m1.small 0004 / 0004 1 128 2 AVAILABILITYZONE |- c1.medium 0004 / 0004 1 256 5 AVAILABILITYZONE |- m1.large 0002 / 0002 2 512 10 AVAILABILITYZONE |- m1.xlarge 0002 / 0002 2 1024 20 AVAILABILITYZONE |- c1.xlarge 0001 / 0001 4 2048 20 }}} === STEP 5: Bundle a UEC Image === There is more than one way to obtain a virtual image: * Download an image from the network, bundle and upload it * Create a custom image using VMBuilder * Use the Image store to download and install and image Here we will describe the process of downloading one of the [[http://uec-images.ubuntu.com/releases/karmic/|Official Ubuntu UEC Images]] that we publish and maintain on a regular basis. ||<style="background-color: #91f49f;"> '''Note:''' the shell variables that are set in the below code snippets are very useful for scripts or to reuse them when typing commands. || 1. Download the UEC image for the architecture you want. You can do it from your browser or from the command line: {{{ $ ARCH=amd64 # possible values are amd64 or i386 $ wget http://uec-images.ubuntu.com/releases/karmic/<release>/ubuntu-uec-karmic-$ARCH.tar.gz }}} 1. Next, you will need to bundle, upload and register a kernel, ramdisk and finally your image: 1. Unpack the UEC image tarball {{{ $ tar -S -xzf ubuntu-uec-karmic-$ARCH.tar.gz }}} 1. Bundle the kernel {{{ $ [ $ARCH = "amd64" ] && IARCH=x86_64 || IARCH=i386 $ KERNEL=karmic-uec-$ARCH-vmlinuz-virtual $ euca-bundle-image -i $KERNEL -r $IARCH --kernel true $ euca-upload-bundle -b kernel -m /tmp/$KERNEL.manifest.xml $ EKI=$(euca-register kernel/$KERNEL.manifest.xml | grep "^IMA" | awk '{print $2}') && echo $EKI }}} 1. Bundle the initrd {{{ $ INITRD=karmic-uec-$ARCH-initrd-virtual $ euca-bundle-image -i $INITRD -r $IARCH --ramdisk true $ euca-upload-bundle -b initrd -m /tmp/$INITRD.manifest.xml $ ERI=$(euca-register initrd/$INITRD.manifest.xml | grep "^IMA" | awk '{print $2}') && echo $ERI }}} 1. Bundle the image itself (this can take some time) {{{ $ UECIMG=karmic-uec-$ARCH.img $ euca-bundle-image -i $UECIMG -r $IARCH --kernel $EKI --ramdisk $ERI $ euca-upload-bundle -b image -m /tmp/$UECIMG.manifest.xml $ EMI=$(euca-register image/$UECIMG.manifest.xml | grep "^IMA" | awk '{print $2}') && echo $EMI }}} 1. Now, your kernel, ramdisk and image will have been uploaded into Eucalyptus and should be ready to run. To confirm, run the following command: {{{ |
Line 213: | Line 171: |
You should see a registered kernel, ramdisk and image and they should be marked as 'available'. ||<style="background-color: #FAAFBA;">Please note: if you are preparing the bundle on a machine that uses encrypted filesystems be aware that you cannot bundle the machine ramdisk for your AMI. This is because your local ramdisk includes routines to decrypt your local encrypted filesystem and these will make the instance crash at boot (as the encrypted filesystem does not exist).|| |
You should see a registered kernel, ramdisk and image and they should be marked as 'available'. |
Line 220: | Line 175: |
Before running an instance of your image, you should first create a keypair (ssh key) that you can use to log into your instance as root, once it boots. The key is stored, so you will only have to do this once. Run the following command: {{{ |
There are multiple way to instantiate (start) an image: * Use the command line * Use one of the UEC compatible management tools such as Landscape * Use the [[UEC/ElasticFox|ElasticFox]] extension to Firefox Here we will describe the process from the command line: 1. Before running an instance of your image, you should first create a keypair (ssh key) that you can use to log into your instance as root, once it boots. The key is stored, so you will only have to do this once. Run the following command: {{{ |
Line 229: | Line 187: |
''Note:'' that you can call your key whatever you like (in this example, the key is called 'mykey'), but remember what it is called. If you forget, you can always run 'euca-describe-keypairs' to get a list of created keys stored in the system. Next, you can create instances of your registered image: {{{ $ euca-run-instances $EMI -k mykey }}} The first time you run an instance, the system will be setting up caches for the image from which it will be created. This can often take some time the first time an instance is run given that VM images are usually quite large. To monitor the state of your instance, run: {{{ |
||<style="background-color: #91f49f;">'''Note:''' You can call your key whatever you like (in this example, the key is called 'mykey'), but remember what it is called. If you forget, you can always run {{{euca-describe-keypairs}}} to get a list of created keys stored in the system. || 1. You must also allow access to port 22 in your instances: {{{ $ euca-authorize default -P tcp -p 22 -s 0.0.0.0/0 }}} 1. Next, you can create instances of your registered image: {{{ $ euca-run-instances $EMI -k mykey -t c1.medium }}} 1. The first time you run an instance, the system will be setting up caches for the image from which it will be created. This can often take some time the first time an instance is run given that VM images are usually quite large. To monitor the state of your instance, run: {{{ |
Line 247: | Line 200: |
In the output, you should see information about the instance, including its state. While first-time caching is being performed, the instance's state will be 'pending'. As soon as the instance is started, the state will become 'running'. As soon as the instance acquires an IP address from DHCP, you will see the public and private address fields change from '0.0.0.0' to a usable IP. When this happens, you can log into your new instance using the previously generated ssh key: {{{ |
In the output, you should see information about the instance, including its state. While first-time caching is being performed, the instance's state will be 'pending'. 1. When the instance is fully started, the above state will become 'running'. Look at the IP address assigned to your instance in the output, then connect to it: {{{ |
Line 260: | Line 206: |
Your Eucalyptus cloud should now look similar to the following logical diagram: {{http://pompone.cs.ucsb.edu/~nurmi/images/euca-topo-withinst.png}} |
|
Line 268: | Line 211: |
* '''Init Scripts:''' /etc/init.d/eucalyptus-cc, /etc/init.d/eucalytpus-cloud and /etc/init.d/eucalytpus-nc | |
Line 270: | Line 212: |
* Reboot note: If you reboot your machine Eucalyptus may not start up and function automatically. You may need to restart the services manually. | |
Line 272: | Line 213: |
== Next Steps and Links == * [[http://eucalyptus.cs.ucsb.edu | Eucalyptus Project Site (forums, documentation, downloads)]] * [[http://www.launchpad.net/eucalyptus/ | Eucalyptus on Launchpad (bugs, code)]] * [[http://eucalyptus.cs.ucsb.edu/wiki/EucalyptusTroubleshooting_v1.5 | Eucalyptus Troubleshooting]] * [[ http://wiki.rightscale.com/2._References/02-Cloud_Infrastructures/Eucalyptus/03-Administration_Guide/Register_with_RightScale?ls=Referral&sd=%3EPartner_Ubuntu_Partnerpage&campaign=70170000000KyOn | Register your cloud with RightScale ]] == Optional procedure to create images == === Eucalyptus procedure === The Eucalyptus project is proposing an [[http://open.eucalyptus.com/wiki/EucalyptusUserImageCreatorGuide_v1.5|alternate guide to create images]] === Using vmbuilder === If you would want to author your own image, you can use the [[https://help.ubuntu.com/8.04/serverguide/C/ubuntu-vm-builder.html | vmbuilder utility]] utility to create an image that will run in Eucalyptus. First, create a partition description file called 'part'. The contents describe the size, types, and mount points of your VM disk partitions: {{{ $ cat > part <<EOF root 400 /mnt/ephemeral 0 /dev/sda2 swap 1 /dev/sda3 EOF }}} Next, create a simple script called 'firstboot' that will be executed the first time your image boots inside Eucalyptus to install an ssh daemon. In a file called 'firstboot' create the shell script: {{{ $ cat >firstboot <<EOF #!/bin/sh apt-get -y install openssh-server EOF }}} Then, create the image with vmbuilder passing the name of the script file as an argument so that it can be installed. Note that even though we are asking vmbuilder to create a 'xen' image (this simply just means that the output format of the image is a disk partition), the resulting image will boot in Eucalyptus using KVM. {{{ $ sudo vmbuilder xen ubuntu --part ./part --firstboot ./firstboot }}} Next, you will need to bundle, upload and register a kernel, ramdisk and finally your image. Using the EC2 API tools, perform the following steps: {{{ $ mkdir kernel $ euca-bundle-image --image /boot/vmlinuz-$(uname -r) \ --destination ./kernel --kernel true $ euca-upload-bundle --bucket kernel \ --manifest ./kernel/vmlinuz-$(uname -r).manifest.xml $ EKI=`euca-register kernel/vmlinuz-$(uname -r).manifest.xml | awk '{print $2}'` $ echo $EKI $ mkdir ramdisk $ sudo sh -c 'grep -q acpiphp || printf "#acpiphp needed for ebs\nacpiphp\n" > /etc/initramfs-tools/modules' $ sudo mkinitramfs -o ./ramdisk/initrd.img-$(uname -r) $ euca-bundle-image --image ./ramdisk/initrd.img-$(uname -r) \ --destination ./ramdisk --ramdisk true $ euca-upload-bundle --bucket ramdisk \ --manifest ramdisk/initrd.img-$(uname -r).manifest.xml $ ERI=`euca-register ramdisk/initrd.img-$(uname -r).manifest.xml | awk '{print $2}'` $ echo $ERI $ mkdir image $ euca-bundle-image --image ubuntu-xen/root.img \ --destination ./image --kernel $EKI --ramdisk $ERI $ euca-upload-bundle --bucket image --manifest ./image/root.img.manifest.xml $ EMI=`euca-register image/root.img.manifest.xml | awk '{print $2}'` $ echo $EMI }}} Note the shell variables that have been set in the above code snippets. They will be used to test the installation in the steps below. Now, your kernel, ramdisk and image will have been uploaded into Eucalyptus and should be ready to run. To confirm, run the following command: {{{ $ euca-describe-images }}} You should see a registered kernel, ramdisk and image and they should be marked as 'available'. ||<style="background-color: #FAAFBA;">Please note: if you are preparing the bundle on a machine that uses encrypted filesystems be aware that you cannot bundle the machine ramdisk for your AMI. This is because your local ramdisk includes routines to decrypt your local encrypted filesystem and these will make the instance crash at boot (as the encrypted filesystem does not exist).|| |
|
Getting Started with Ubuntu Enterprise Cloud
Overview
The Ubuntu Enterprise Cloud (UEC), powered by Eucalyptus, is highly configurable and customizable to a variety of environments. This tutorial covers UEC installation from the Ubuntu 9.10 Server Edition CD, and assumes a basic network topology, with a single system serving as the "all-in-one controller", and one or more nodes attached.
Another tutorial exists describing how to deploy UEC on already installed Ubuntu servers, or if you want to deploy a more complex network topology, with multiple clusters, or running the required cloud services from separate physical machines.
Terminology
You should be familiar with the UEC/GLossary. These terms are used throughout the documentation.
Objective
From this Tutorial you will learn how to install, configure, register and perform several operations on a basic UEC setup that results in a cloud with a one controller "front-end" and one or several node(s) for running Virtual Machine (VM) instances. You will also use examples to help get you started using your own private compute cloud.
- Prerequisites
- Install the Cloud/Cluster controller
- Install the Node controller(s)
- Credentials setup
- Bundle a UEC Image
- Running an image
Tutorial
STEP 1: Prerequisites
To deploy a minimal cloud infrastructure, you’ll need at least two dedicated systems.
Front End
One system will run:
- the cloud controller (clc)
- the cluster controller (cc)
- walrus (the S3-like storage service)
- the storage controller (sc)
The following are recommendations are not fixed requirements. However, our experience in developing this documentation indicated the following suggestions:
Hardware |
Minimum |
Suggested |
Notes |
CPU |
1GHz |
2 x 2GHz |
for an all-in-one front end, it helps to have at least a dual core processor |
Memory |
1GB |
2GB |
the Java web front end benefits from lots of available memory |
Disk |
5400rpm IDE |
7200rpm SATA |
slower disks will work, but will yield much longer instance startup times |
Disk Space |
40GB |
100GB |
40GB is only enough space for only a single image, cache, etc., Eucalyptus does not like to run out of disk space |
Networking |
100Mbps |
1000Mbps |
machine images are hundreds of MB, and need to be copied over the network to nodes |
Node(s)
The other system(s) are nodes, which will run:
- the node controller (nc)
These systems will actually run the instances. You will need one or more systems with:
Hardware |
Minimum |
Suggested |
Notes |
CPU |
VT extensions |
VT, 64-bit, Multicore |
64-bit can run both i386, and amd64 instances; by default, Eucalyptus will only run 1 VM per CPU core on a Node |
Memory |
1GB |
4GB |
additional memory means more, and larger guests |
Disk |
5400rpm IDE |
7200rpm SATA or SCSI |
Eucalyptus nodes are disk-intensive; I/O wait will likely be the performance bottleneck |
Disk Space |
40GB |
100GB |
images will be cached locally, Eucalyptus does not like to run out of disk space |
Networking |
100Mbps |
1000Mbps |
machine images are hundreds of MB, and need to be copied over the network to nodes |
STEP 2: Install the Cloud/Cluster controller
- Download the 9.10 Server ISO.
When you boot, select “Install Ubuntu Enterprise Cloud”.
When asked whether you want a “Cluster” or a “Node” install, select “Cluster”.
- It will ask two other cloud-specific questions during the course of the install:
Name of your cluster: pick any name you want
- Public IP addresses on the LAN that the cloud can allocate to instances: enter a range of unused IP addresses on your LAN.
STEP 3: Install the Node controller(s)
The node controller install is even simpler. Just make sure that you are connected to the network on which the cloud/cluster controller is already running.
- Boot from the same ISO
- Select “Install Ubuntu Enterprise Cloud”.
- It should detect the Cluster and preselect “Node” install for you.
- After all nodes are installed, you need to return to the cloud/controller and run the following command to make it “discover” your newly-installed nodes.
$ sudo euca_conf --no-rsync --discover-nodes
- Confirm all the nodes it finds, and you are done.
STEP 4: Credentials setup
The first time the cloud controller boots, you are required to go through some configuration steps that set up the administrative environment for the cloud.
- From your web browser (either remotely or on your Ubuntu server) access the following URL:
https://<cloud-controller-ip-address>:8443/
Important! You must use a secure connection, so make sure you use "https" not "http" in your URL. You will get a security certificate warning. You will have to add an exception to view the page. If you do not accept it you will not be able to view the Eucalyptus configuration page.
- Use username 'admin' and password 'admin' for the first time login (you will be prompted to change your password).
- Then follow the on-screen instructions to update the admin password and email address.
Once the first time configuration process is completed, click the 'credentials' tab located in the top-left portion of the screen.
- Click the 'Download Credentials' button to get your certificates.
Now you will need to setup EC2 API and AMI tools on your server using X.509 certificates.
- Unzip the downloaded zipfile into a safe location (~/.euca),
- Source the included "eucarc" file to set up your Eucalyptus environment.
$ . ~/.euca/eucarc
You may additionally wish to add this command to your ~/.bashrc file so that your Eucalyptus environment is set up automatically when you log in. Eucalyptus treats this set of credentials as 'administrator' credentials that allow the holder global privileges across the cloud. As such, they should be protected in the same way that other elevated-priority access is protected (e.g. should not be made visible to the general user population). - Install the required cloud user tools:
$ sudo apt-get install euca2ools
- To validate that everything is working correctly, get the local cluster availability details:
$ . ~/.euca/eucarc $ euca-describe-availability-zones verbose AVAILABILITYZONE myowncloud 192.168.1.1 AVAILABILITYZONE |- vm types free / max cpu ram disk AVAILABILITYZONE |- m1.small 0004 / 0004 1 128 2 AVAILABILITYZONE |- c1.medium 0004 / 0004 1 256 5 AVAILABILITYZONE |- m1.large 0002 / 0002 2 512 10 AVAILABILITYZONE |- m1.xlarge 0002 / 0002 2 1024 20 AVAILABILITYZONE |- c1.xlarge 0001 / 0001 4 2048 20
STEP 5: Bundle a UEC Image
There is more than one way to obtain a virtual image:
- Download an image from the network, bundle and upload it
- Create a custom image using VMBuilder
- Use the Image store to download and install and image
Here we will describe the process of downloading one of the Official Ubuntu UEC Images that we publish and maintain on a regular basis.
Note: the shell variables that are set in the below code snippets are very useful for scripts or to reuse them when typing commands. |
- Download the UEC image for the architecture you want. You can do it from your browser or from the command line:
$ ARCH=amd64 # possible values are amd64 or i386 $ wget http://uec-images.ubuntu.com/releases/karmic/<release>/ubuntu-uec-karmic-$ARCH.tar.gz
- Next, you will need to bundle, upload and register a kernel, ramdisk and finally your image:
- Unpack the UEC image tarball
$ tar -S -xzf ubuntu-uec-karmic-$ARCH.tar.gz
- Bundle the kernel
$ [ $ARCH = "amd64" ] && IARCH=x86_64 || IARCH=i386 $ KERNEL=karmic-uec-$ARCH-vmlinuz-virtual $ euca-bundle-image -i $KERNEL -r $IARCH --kernel true $ euca-upload-bundle -b kernel -m /tmp/$KERNEL.manifest.xml $ EKI=$(euca-register kernel/$KERNEL.manifest.xml | grep "^IMA" | awk '{print $2}') && echo $EKI
- Bundle the initrd
$ INITRD=karmic-uec-$ARCH-initrd-virtual $ euca-bundle-image -i $INITRD -r $IARCH --ramdisk true $ euca-upload-bundle -b initrd -m /tmp/$INITRD.manifest.xml $ ERI=$(euca-register initrd/$INITRD.manifest.xml | grep "^IMA" | awk '{print $2}') && echo $ERI
- Bundle the image itself (this can take some time)
$ UECIMG=karmic-uec-$ARCH.img $ euca-bundle-image -i $UECIMG -r $IARCH --kernel $EKI --ramdisk $ERI $ euca-upload-bundle -b image -m /tmp/$UECIMG.manifest.xml $ EMI=$(euca-register image/$UECIMG.manifest.xml | grep "^IMA" | awk '{print $2}') && echo $EMI
- Unpack the UEC image tarball
- Now, your kernel, ramdisk and image will have been uploaded into Eucalyptus and should be ready to run. To confirm, run the following command:
$ euca-describe-images
You should see a registered kernel, ramdisk and image and they should be marked as 'available'.
STEP 6: Running an Image
There are multiple way to instantiate (start) an image:
- Use the command line
- Use one of the UEC compatible management tools such as Landscape
Use the ElasticFox extension to Firefox
Here we will describe the process from the command line:
- Before running an instance of your image, you should first create a keypair (ssh key) that you can use to log into your instance as root, once it boots. The key is stored, so you will only have to do this once. Run the following command:
$ euca-add-keypair mykey > ~/.euca/mykey.priv $ chmod 0600 ~/.euca/mykey.priv
Note: You can call your key whatever you like (in this example, the key is called 'mykey'), but remember what it is called. If you forget, you can always run euca-describe-keypairs to get a list of created keys stored in the system.
- You must also allow access to port 22 in your instances:
$ euca-authorize default -P tcp -p 22 -s 0.0.0.0/0
- Next, you can create instances of your registered image:
$ euca-run-instances $EMI -k mykey -t c1.medium
- The first time you run an instance, the system will be setting up caches for the image from which it will be created. This can often take some time the first time an instance is run given that VM images are usually quite large. To monitor the state of your instance, run:
$ euca-describe-instances
In the output, you should see information about the instance, including its state. While first-time caching is being performed, the instance's state will be 'pending'. - When the instance is fully started, the above state will become 'running'. Look at the IP address assigned to your instance in the output, then connect to it:
$ ssh -i ~/.euca/mykey.priv ubuntu@<ip_of_instance>
More Information
Log files: /var/log/eucalyptus
Configuration files: /etc/eucalyptus
Database: /var/lib/eucalyptus/db
- Environment note: Don't forget to source your ~/.euca/eucarc before running the client tools.