[one-users] deploy Non-persistent vm on 4.6.2 base glusterfs no running

Sat Jul 12 03:30:18 PDT 2014

On 2014-07-11 10:17, clm_tuan at hotmail.com wrote:
> Dear All,
> 
> I tried to deploy opennebula 4.6.2 base glusterfs 3.5.1
> 
> all three server:
> 1. one server,ip is 192.168.0.198;
> 2. node0,ip is 192.168.0.199;
> 3. node1,ip is 192.168.0.200;
> 
> Datastores configuration:
> 
> [oneadmin at fc-server ]$ onedatastore show 102
> DATASTORE 102 INFORMATION
> ID : 102
> NAME : sys
> USER : oneadmin
> GROUP : oneadmin
> CLUSTER : c1
> TYPE : SYSTEM
> DS_MAD : -
> TM_MAD : shared
> BASE PATH : /var/lib/one//datastores/102
> DISK_TYPE : FILE
> 
> DATASTORE CAPACITY
> TOTAL: : 131.3G
> FREE: : 123.3G
> USED: : 41M
> LIMIT: : -
> 
> PERMISSIONS
> OWNER : um-
> GROUP : u--
> OTHER : ---
> 
> DATASTORE TEMPLATE
> BASE_PATH="/var/lib/one//datastores/"
> GLUSTER_HOST="192.168.0.199:24007"
> GLUSTER_VOLUME="fc-sys"
> SHARED="YES"
> TM_MAD="shared"
> TYPE="SYSTEM_DS"
> 
> [oneadmin at fc-server ]$ onedatastore show 103
> DATASTORE 103 INFORMATION
> ID : 103
> NAME : img
> USER : oneadmin
> GROUP : oneadmin
> CLUSTER : c1
> TYPE : IMAGE
> DS_MAD : fs
> TM_MAD : shared
> BASE PATH : /var/lib/one//datastores/103
> DISK_TYPE :
> 
> DATASTORE CAPACITY
> TOTAL: : 131.3G
> FREE: : 123.3G
> USED: : 41M
> LIMIT: : -
> 
> PERMISSIONS
> OWNER : um-
> GROUP : u--
> OTHER : ---
> 
> DATASTORE TEMPLATE
> BASE_PATH="/var/lib/one//datastores/"
> CLONE_TARGET="SYSTEM"
> DISK_TYPE="GLUSTER"
> DS_MAD="fs"
> GLUSTER_HOST="192.168.0.199:24007"
> GLUSTER_VOLUME="fc-img"
> LN_TARGET="NONE"
> TM_MAD="shared"
> TYPE="IMAGE_DS"
> 
> 192.168.0.199:/fc-sys on /var/lib/one/datastores/102 type
> fuse.glusterfs (rw,default_permissions,allow_other,max_read=131072)
> 192.168.0.199:/fc-img on /var/lib/one/datastores/103 type
> fuse.glusterfs (rw,default_permissions,allow_other,max_read=131072)
> 
> deploy image to PERSISTENT, it's ok.
> 
> [oneadmin at fc-server ]$ oneimage show 1
> IMAGE 1 INFORMATION
> ID : 1
> NAME : ttylinux
> USER : oneadmin
> GROUP : oneadmin
> DATASTORE : img
> TYPE : OS
> REGISTER TIME : 07/11 21:35:11
> PERSISTENT : Yes
> SOURCE : /var/lib/one//datastores/103/4c40e4068ad2ff41c8767c40f85ae786
> 
> PATH :
> http://marketplace.c12g.com/appliance/4fc76a938fb81d3517000003/download/0
> 
> SIZE : 40M
> STATE : used
> RUNNING_VMS : 1
> 
> PERMISSIONS
> OWNER : um-
> GROUP : ---
> OTHER : ---
> 
> IMAGE TEMPLATE
> DEV_PREFIX="hd"
> FROM_APP="4fc76a938fb81d3517000003"
> FROM_APP_FILE="0"
> FROM_APP_NAME="ttylinux - kvm"
> MD5="04c7d00e88fa66d9aaa34d9cf8ad6aaa"
> 
> VIRTUAL MACHINES
> 
>  ID USER GROUP NAME STAT UCPU UMEM HOST TIME
>  8 oneadmin oneadmin tt runn 0 512M 192.168.0. -1d 16h32
> [oneadmin at fc-server tm]$
> 
> [oneadmin at fc-server 8]$ ll
> total 366
> -rw-rw-r-- 1 oneadmin oneadmin 992 Jul 11 13:44 deployment.0
> lrwxrwxrwx 1 oneadmin oneadmin 60 Jul 11 13:44 disk.0 ->
> /var/lib/one/datastores/103/4c40e4068ad2ff41c8767c40f85ae786
> -rw-r--r-- 1 oneadmin oneadmin 372736 Jul 11 13:44 disk.1
> lrwxrwxrwx 1 oneadmin oneadmin 36 Jul 11 13:44 disk.1.iso ->
> /var/lib/one/datastores/102/8/disk.1
> 
> but deploy image to Non-persistent, it's no running.
> 
> [oneadmin at fc-server 102]$ oneimage show 1
> IMAGE 1 INFORMATION
> ID : 1
> NAME : ttylinux
> USER : oneadmin
> GROUP : oneadmin
> DATASTORE : img
> TYPE : OS
> REGISTER TIME : 07/11 21:35:11
> PERSISTENT : No
> SOURCE : /var/lib/one//datastores/103/4c40e4068ad2ff41c8767c40f85ae786
> 
> PATH :
> http://marketplace.c12g.com/appliance/4fc76a938fb81d3517000003/download/0
> 
> SIZE : 40M
> STATE : used
> RUNNING_VMS : 1
> 
> PERMISSIONS
> OWNER : um-
> GROUP : ---
> OTHER : ---
> 
> IMAGE TEMPLATE
> DEV_PREFIX="hd"
> FROM_APP="4fc76a938fb81d3517000003"
> FROM_APP_FILE="0"
> FROM_APP_NAME="ttylinux - kvm"
> MD5="04c7d00e88fa66d9aaa34d9cf8ad6aaa"
> 
> VIRTUAL MACHINES
> 
>  ID USER GROUP NAME STAT UCPU UMEM HOST TIME
>  10 oneadmin oneadmin tt fail 0 0K 0d 00h00
> 
> [oneadmin at fc-server 102]$ ls
> 10
> [oneadmin at fc-server 102]$ cd 10
> [oneadmin at fc-server 10]$ ll
> total 41325
> -rw-rw-r-- 1 oneadmin oneadmin 971 Jul 11 14:35 deployment.0
> -rw-r--r-- 1 oneadmin oneadmin 41943040 Jul 11 14:35 disk.0
> -rw-r--r-- 1 oneadmin oneadmin 372736 Jul 11 14:35 disk.1
> lrwxrwxrwx 1 oneadmin oneadmin 37 Jul 11 14:35 disk.1.iso ->
> /var/lib/one/datastores/102/10/disk.1
> 
> show log :
> 
> Fri Jul 11 14:35:26 2014 [DiM][D]: Deploying VM 10
> Fri Jul 11 14:35:26 2014 [ReM][D]: Req:8400 UID:0 VirtualMachineDeploy
> result SUCCESS, 10
> Fri Jul 11 14:35:31 2014 [TM][D]: Message received: TRANSFER SUCCESS
> 10 -
> 
> Fri Jul 11 14:35:32 2014 [VMM][D]: Message received: LOG I 10
> ExitCode: 0
> 
> Fri Jul 11 14:35:32 2014 [VMM][D]: Message received: LOG I 10
> Successfully execute network driver operation: pre.
> 
> Fri Jul 11 14:35:33 2014 [VMM][D]: Message received: LOG I 10 Command
> execution fail: cat << EOT | /var/tmp/one/vmm/kvm/deploy
> '/var/lib/one//datastores/102/10/deployment.0' '192.168.0.199' 10
> 192.168.0.199
> 
> Fri Jul 11 14:35:33 2014 [VMM][D]: Message received: LOG I 10 error:
> Failed to create domain from
> /var/lib/one//datastores/102/10/deployment.0
> 
> Fri Jul 11 14:35:33 2014 [VMM][D]: Message received: LOG I 10 error:
> internal error process exited while connecting to monitor: qemu-kvm:
> -drive
> file=gluster+tcp://192.168.0.199:24007/fc-img/10/disk.0,if=none,id=drive-ide0-0-0,format=raw,cache=none:
> could not open disk image gluster+tcp://192.168.0.199:24007/fc-
> img/10/disk.0: No such file or directory
> 
> Fri Jul 11 14:35:33 2014 [VMM][D]: Message received: LOG I 10
> [2014-07-11 06:35:36.105637] E [afr-common.c:4157:afr_notify]
> 0-fc-img-replicate-0: All subvolumes are down.
> Going offline until atleast one of them comes back up.
> 
> Fri Jul 11 14:35:33 2014 [VMM][D]: Message received: LOG I 10
> 
> Fri Jul 11 14:35:33 2014 [VMM][D]: Message received: LOG E 10 Could
> not create domain from /var/lib/one//datastores/102/10/deployment.0
> 
> Fri Jul 11 14:35:33 2014 [VMM][D]: Message received: LOG I 10
> ExitCode: 255
> 
> Fri Jul 11 14:35:33 2014 [VMM][D]: Message received: LOG I 10 Failed
> to execute virtualization driver operation: deploy.
> 
> [oneadmin at fc-server 102]$ more /var/log/one/10.log
> Fri Jul 11 14:35:26 2014 [DiM][I]: New VM state is ACTIVE.
> Fri Jul 11 14:35:27 2014 [LCM][I]: New VM state is PROLOG.
> Fri Jul 11 14:35:32 2014 [LCM][I]: New VM state is BOOT
> Fri Jul 11 14:35:32 2014 [VMM][I]: Generating deployment file:
> /var/lib/one/vms/10/deployment.0
> Fri Jul 11 14:35:32 2014 [VMM][I]: ExitCode: 0
> Fri Jul 11 14:35:32 2014 [VMM][I]: Successfully execute network driver
> operation: pre.
> Fri Jul 11 14:35:33 2014 [VMM][I]: Command execution fail: cat << EOT
> | /var/tmp/one/vmm/kvm/deploy
> '/var/lib/one//datastores/102/10/deployment.0' '192.168.0.199
> ' 10 192.168.0.199
> Fri Jul 11 14:35:33 2014 [VMM][I]: error: Failed to create domain from
> /var/lib/one//datastores/102/10/deployment.0
> Fri Jul 11 14:35:33 2014 [VMM][I]: error: internal error process
> exited while connecting to monitor: qemu-kvm: -drive
> file=gluster+tcp://192.168.0.199:24007/fc-i
> mg/10/disk.0,if=none,id=drive-ide0-0-0,format=raw,cache=none: could
> not open disk image
> gluster+tcp://192.168.0.199:24007/fc-img/10/disk.0: No such file or
> direc
> tory
> Fri Jul 11 14:35:33 2014 [VMM][I]: [2014-07-11 06:35:36.105637] E
> [afr-common.c:4157:afr_notify] 0-fc-img-replicate-0: All subvolumes
> are down. Going offline unt
> il atleast one of them comes back up.
> Fri Jul 11 14:35:33 2014 [VMM][I]:
> Fri Jul 11 14:35:33 2014 [VMM][E]: Could not create domain from
> /var/lib/one//datastores/102/10/deployment.0
> Fri Jul 11 14:35:33 2014 [VMM][I]: ExitCode: 255
> Fri Jul 11 14:35:33 2014 [VMM][I]: Failed to execute virtualization
> driver operation: deploy.
> Fri Jul 11 14:35:33 2014 [VMM][E]: Error deploying virtual machine:
> Could not create domain from
> /var/lib/one//datastores/102/10/deployment.0
> Fri Jul 11 14:35:35 2014 [DiM][I]: New VM state is FAILED
> 
> qemu-kvm: -drive
> file=gluster+tcp://192.168.0.199:24007/fc-img/10/disk.0
> I think it should be
> gluster+tcp://192.168.0.199:24007/fc-sys/10/disk.0
> 
> What advice do you have.Thanks.
> 

Hi,

I've been setting up our Opennebula private cloud over the last few 
weeks and I'm also
using Gluster for the storage backend. Not all info to make it work is 
available in the
Opennebula docs and I was planning on submitting the necessary info.

After reading your post I decided to no longer postpone it.

have a look at this pull request : 
https://github.com/vincentvdk/docs/commit/98e70a83b40b58d84e00d3180023671263e2b787

Adding the 'virt' group should fix your problem.

Regards,
Vincent

> 
> _______________________________________________
> Users mailing list
> Users at lists.opennebula.org
> http://lists.opennebula.org/listinfo.cgi/users-opennebula.org