<html dir="ltr">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style type="text/css" id="owaParaStyle"></style>
</head>
<body fpstyle="1" ocsi="0">
<div style="direction: ltr;font-family: Tahoma;color: #000000;font-size: 10pt;">Interestingly, I found that I was able to do some overcommitting after all, somewhat to my surprise,
<div>as my earlier tests of open nebula 4.4 and 4.6 didn't seem to allow that. This is what I think is happening:</div>
<div><br>
</div>
<div>Beginning setup: Image datastore is on NFS, system datastore is on local disk, launching</div>
<div>non-persistent image via CLONE operation in opennebula.</div>
<div> DATASTORE_CAPACITY_CHECK = NO for both.</div>
<div><br>
</div>
<div>Initial size of system data store, 450 GB.</div>
<div>Max size of qcow2 image--262 GB</div>
<div>Actuall size of qcow2 image on disk, unexpanded-2.6 GB</div>
<div><br>
</div>
<div>Launch first VM--SCHED asks--does system datastore have 262 GB available? Yes.</div>
<div>Launch second VM--SCHED asks--does system datastore have 262 GB available? Yes.. because first one</div>
<div>hasn't expanded out. and so forth.</div>
<div><br>
</div>
<div>That amount of overprovisioning is enough for our purposes--we can get 8-9 images (actually a lot more than</div>
<div>that) into the datastore and will only get in trouble if our users all run out the file to full size, which most</div>
<div>of them do not. The system runs out of RAM and CPU before it runs out of disk in this scenario.</div>
<div><br>
</div>
<div>Steve Timm</div>
<div>
<div style="font-family: Times New Roman; color: #000000; font-size: 16px">
<hr tabindex="-1">
<div id="divRpF300846" style="direction: ltr;"><font face="Tahoma" size="2" color="#000000"><b>From:</b> Ruben S. Montero [rubensm@dacya.ucm.es]<br>
<b>Sent:</b> Wednesday, October 08, 2014 3:50 AM<br>
<b>To:</b> Steven C Timm<br>
<b>Cc:</b> Javier Fontan; users@lists.opennebula.org<br>
<b>Subject:</b> Re: [one-users] Thin provisioning and image size<br>
</font><br>
</div>
<div></div>
<div>
<div dir="ltr">Hi
<div><br>
</div>
<div>Yes, the value for the size of the image is computed in libfs.sh (fs_size) for different file types. For qcow2 images:</div>
<div><br>
</div>
<div>SIZE=$($QEMU_IMG info "$1" | sed -n 's/.*(\([0-9]*\) bytes).*/\1/p')<br>
</div>
<div><br>
</div>
<div>I.e. the virtual size in bytes is used. As this is the max. value of the image it is not updated.</div>
<div><br>
</div>
<div>Some thoughts:</div>
<div><br>
</div>
<div>1.- Using the max size, enables a proper enforcement of disk quotas. And so prevents a kind of DoS attack , when a user starts a VM and grows the disk over the size of the Datastore, effectively disabling the hypervisor.</div>
<div><br>
</div>
<div>2.- Initially we thought of updating the image size every time it is copied back to the image datastore, but this may conflict with the quota system, as mentioned above.</div>
<div><br>
</div>
<div>3.- If needed we could implement datastore over-commitment as we do with the hosts, i.e. extend the LIMIT_MB attribute to allow OpenNebula use more datastore storage. (See, </div>
<div><a href="http://docs.opennebula.org/4.8/administration/references/ds_conf.html" target="_blank">http://docs.opennebula.org/4.8/administration/references/ds_conf.html</a>)<br>
</div>
<div><br>
</div>
<div>Cheers</div>
<div><br>
</div>
<div>Ruben</div>
<div><br>
</div>
<div><br>
</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Mon, Oct 6, 2014 at 7:45 PM, Steven Timm <span dir="ltr">
<<a href="mailto:timm@fnal.gov" target="_blank">timm@fnal.gov</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex; border-left:1px #ccc solid; padding-left:1ex">
<br>
I am seeing the opposite problem in One 4.x<br>
and have been ever since we started testing it.<br>
When I do oneimage create using a qcow2 image,<br>
opennebula always reports the size as the absolute<br>
maximum to which the qcow2 file system could expand.<br>
This keeps us from being able to over-provision our<br>
disk on the VM hosts as we've done under Opennebula 3.2 for a long time.<br>
<br>
For instance:<br>
<br>
[oneadmin@fermicloud198 ~]$ oneimage show 5<br>
IMAGE 5 INFORMATION<br>
ID : 5<br>
NAME : SLF6Vanilla<br>
USER : oneadmin<br>
GROUP : oneadmin<br>
DATASTORE : cloud_images<br>
TYPE : OS<br>
REGISTER TIME : 10/03 16:31:31<br>
PERSISTENT : No<br>
SOURCE : /var/lib/one/datastores/102/<u></u>180caf99a13146dbd1b60593378d44<u></u>79<br>
PATH : /tmp/<u></u>55c42a4cc7f87ea3390bc2bef14212<u></u>c5<br>
SIZE : 256G<br>
STATE : used<br>
RUNNING_VMS : 1<span class=""><br>
<br>
PERMISSIONS<br>
OWNER : um-<br>
GROUP : u--<br>
OTHER : u--<br>
<br>
IMAGE TEMPLATE<br>
</span>DESCRIPTION="SLF6 Vanilla"<br>
DEV_PREFIX="vd"<br>
DRIVER="qcow2"<br>
EC2_AMI="YES<br>
<br>
------------------------<br>
<br>
[oneadmin@fermicloud198 ~]$ onedatastore show 102<br>
DATASTORE 102 INFORMATION<br>
ID : 102<br>
NAME : cloud_images<br>
USER : njp<br>
GROUP : oneadmin<br>
CLUSTER : cloudworker<br>
TYPE : IMAGE<br>
DS_MAD : fs<br>
TM_MAD : shared<br>
BASE PATH : /var/lib/one/datastores/102<br>
DISK_TYPE : FILE<br>
<br>
DATASTORE CAPACITY<br>
TOTAL: : 7T<br>
FREE: : 1.6T<br>
USED: : 4.1G<br>
LIMIT: : -<span class=""><br>
<br>
PERMISSIONS<br>
OWNER : um-<br>
GROUP : u--<br>
</span>OTHER : ---<br>
<br>
DATASTORE TEMPLATE<br>
BASE_PATH="/var/lib/one/<u></u>datastores/"<br>
CLONE_TARGET="SYSTEM"<br>
DATASTORE_CAPACITY_CHECK="NO"<br>
DISK_TYPE="FILE"<br>
DS_MAD="fs"<br>
LN_TARGET="NONE"<br>
TM_MAD="shared"<br>
TYPE="IMAGE_DS"<br>
<br>
IMAGES<br>
5<br>
6<br>
<br>
[oneadmin@fermicloud198 ~]$ onedatastore show 100<br>
DATASTORE 100 INFORMATION<br>
ID : 100<br>
NAME : localnode<br>
USER : oneadmin<br>
GROUP : oneadmin<br>
CLUSTER : cloudworker<br>
TYPE : SYSTEM<br>
DS_MAD : -<br>
TM_MAD : ssh<br>
BASE PATH : /var/lib/one/datastores/100/<u></u>100<br>
DISK_TYPE : FILE<br>
<br>
DATASTORE CAPACITY<br>
TOTAL: : -<br>
FREE: : -<br>
USED: : -<br>
LIMIT: : -<span class=""><br>
<br>
PERMISSIONS<br>
OWNER : um-<br>
GROUP : u--<br>
</span>OTHER : ---<br>
<br>
DATASTORE TEMPLATE<br>
BASE_PATH="/var/lib/one/<u></u>datastores/100/"<br>
DATASTORE_CAPACITY_CHECK="no"<br>
SHARED="NO"<br>
TM_MAD="ssh"<br>
TYPE="SYSTEM_DS"<br>
<br>
IMAGES<br>
[oneadmin@fermicloud198 ~]$<br>
<br>
------------------------------<u></u>---<br>
<br>
Any suggestions?<br>
<br>
Steve
<div>
<div class="h5"><br>
<br>
<br>
<br>
On Mon, 8 Sep 2014, Javier Fontan wrote:<br>
<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex; border-left:1px #ccc solid; padding-left:1ex">
Then the value makes sense as the units stored are Megabytes.<br>
<br>
On Fri, Sep 5, 2014 at 3:34 PM, Daniel Dehennin<br>
<<a href="mailto:daniel.dehennin@baby-gnu.org" target="_blank">daniel.dehennin@baby-gnu.org</a>> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex; border-left:1px #ccc solid; padding-left:1ex">
Javier Fontan <<a href="mailto:jfontan@opennebula.org" target="_blank">jfontan@opennebula.org</a>> writes:<br>
<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex; border-left:1px #ccc solid; padding-left:1ex">
Which was the size of the original image? I think that when you do a<br>
save_as (deferred disk snapshot) it just copies the size of the<br>
original image to the new one.<br>
</blockquote>
<br>
I started with empty qcow2 disk of several virtual sizes, but on disk<br>
they are all 196KB.<br>
<br>
Regards.<br>
--<br>
Daniel Dehennin<br>
Récupérer ma clef GPG: gpg --recv-keys 0xCC1E9E5B7A6FE2DF<br>
Fingerprint: 3E69 014E 5C23 50E8 9ED6 2AAD CC1E 9E5B 7A6F E2DF<br>
______________________________<u></u>_________________<br>
Users mailing list<br>
<a href="mailto:Users@lists.opennebula.org" target="_blank">Users@lists.opennebula.org</a><br>
<a href="http://lists.opennebula.org/listinfo.cgi/users-opennebula.org" target="_blank">http://lists.opennebula.org/<u></u>listinfo.cgi/users-opennebula.<u></u>org</a><br>
</blockquote>
<br>
<br>
<br>
-- <br>
Javier Fontán Muiños<br>
Developer<br>
OpenNebula - Flexible Enterprise Cloud Made Simple<br>
<a href="http://www.OpenNebula.org" target="_blank">www.OpenNebula.org</a> | @OpenNebula |
<a href="http://github.com/jfontan" target="_blank">github.com/jfontan</a><br>
______________________________<u></u>_________________<br>
Users mailing list<br>
<a href="mailto:Users@lists.opennebula.org" target="_blank">Users@lists.opennebula.org</a><br>
<a href="http://lists.opennebula.org/listinfo.cgi/users-opennebula.org" target="_blank">http://lists.opennebula.org/<u></u>listinfo.cgi/users-opennebula.<u></u>org</a><br>
</blockquote>
<br>
</div>
</div>
------------------------------<u></u>------------------------------<u></u>------<br>
Steven C. Timm, Ph.D <a href="tel:%28630%29%20840-8525" value="+16308408525" target="_blank">
(630) 840-8525</a><br>
<a href="mailto:timm@fnal.gov" target="_blank">timm@fnal.gov</a> <a href="http://home.fnal.gov/~timm/" target="_blank">
http://home.fnal.gov/~timm/</a><br>
Fermilab Scientific Computing Division, Scientific Computing Services Quad.<br>
Grid and Cloud Services Dept., Associate Dept. Head for Cloud Computing<br>
_______________________________________________<br>
Users mailing list<br>
<a href="mailto:Users@lists.opennebula.org" target="_blank">Users@lists.opennebula.org</a><br>
<a href="http://lists.opennebula.org/listinfo.cgi/users-opennebula.org" target="_blank">http://lists.opennebula.org/listinfo.cgi/users-opennebula.org</a><br>
<br>
</blockquote>
</div>
<br>
<br clear="all">
<div><br>
</div>
-- <br>
Dr. Ruben Santiago Montero<br>
Associate Professor (Profesor Titular), Complutense University of Madrid<br>
<br>
URL: <a href="http://dsa-research.org/doku.php?id=people:ruben" target="_blank">http://dsa-research.org/doku.php?id=people:ruben</a><br>
Weblog: <a href="http://blog.dsa-research.org/?author=7" target="_blank">http://blog.dsa-research.org/?author=7</a>
</div>
</div>
</div>
</div>
</div>
</body>
</html>