<html><head><meta http-equiv="content-type" content="text/html; charset=GB2312"><style>body { line-height: 1.5; }body { font-size: 10.5pt; font-family: Arial; color: rgb(0, 0, 0); line-height: 1.5; }</style></head><body>
<div><span></span><span style="background-color: rgba(0, 0, 0, 0);">Dear All, </span></div><div><span style="background-color: rgba(0, 0, 0, 0);"><br>I tried to deploy opennebula 4.6.2 base glusterfs 3.5.1</span></div><div><br></div><div><span style="background-color: rgba(0, 0, 0, 0);">all three server: </span></div><div><span style="background-color: rgba(0, 0, 0, 0);">1. one server,ip is 192.168.0.198;
<br>2. node0,ip is 192.168.0.199;
<br>3. node1,ip is 192.168.0.200;
<br>
<br><br>Datastores configuration: </span></div><div><span style="background-color: rgba(0, 0, 0, 0);"><br>[oneadmin@fc-server ]$ onedatastore show 102 </span></div><div><span style="background-color: rgba(0, 0, 0, 0); font-size: 10.5pt; line-height: 1.5;">DATASTORE 102 INFORMATION </span></div><div><span style="background-color: rgba(0, 0, 0, 0);">ID : 102
<br>NAME : sys
<br>USER : oneadmin
<br>GROUP : oneadmin
<br>CLUSTER : c1
<br>TYPE : SYSTEM
<br>DS_MAD : -
<br>TM_MAD : shared
<br>BASE PATH : /var/lib/one//datastores/102
<br>DISK_TYPE : FILE
<br>
<br>DATASTORE CAPACITY
<br>TOTAL: : 131.3G
<br>FREE: : 123.3G
<br>USED: : 41M
<br>LIMIT: : -
<br>
<br>PERMISSIONS
<br>OWNER : um-
<br>GROUP : u--
<br>OTHER : ---
<br>
<br>DATASTORE TEMPLATE
<br>BASE_PATH="/var/lib/one//datastores/"
<br>GLUSTER_HOST="192.168.0.199:24007"
<br>GLUSTER_VOLUME="fc-sys"
<br>SHARED="YES"
<br>TM_MAD="shared"
<br>TYPE="SYSTEM_DS"
<br>
<br>[oneadmin@fc-server ]$ onedatastore show 103 </span></div><div><span style="background-color: rgba(0, 0, 0, 0);">DATASTORE 103 INFORMATION
<br>ID : 103
<br>NAME : img
<br>USER : oneadmin
<br>GROUP : oneadmin
<br>CLUSTER : c1
<br>TYPE : IMAGE
<br>DS_MAD : fs
<br>TM_MAD : shared
<br>BASE PATH : /var/lib/one//datastores/103
<br>DISK_TYPE :
<br>
<br>DATASTORE CAPACITY
<br>TOTAL: : 131.3G
<br>FREE: : 123.3G
<br>USED: : 41M
<br>LIMIT: : -
<br>
<br>PERMISSIONS
<br>OWNER : um-
<br>GROUP : u--
<br>OTHER : ---
<br>
<br>DATASTORE TEMPLATE
<br>BASE_PATH="/var/lib/one//datastores/"
<br>CLONE_TARGET="SYSTEM"
<br>DISK_TYPE="GLUSTER"
<br>DS_MAD="fs"
<br>GLUSTER_HOST="192.168.0.199:24007"
<br>GLUSTER_VOLUME="fc-img"
<br>LN_TARGET="NONE"
<br>TM_MAD="shared"
<br>TYPE="IMAGE_DS"
<br>
<br>192.168.0.199:/fc-sys on /var/lib/one/datastores/102 type fuse.glusterfs (rw,default_permissions,allow_other,max_read=131072) </span></div><div><span style="background-color: rgba(0, 0, 0, 0);">192.168.0.199:/fc-img on /var/lib/one/datastores/103 type fuse.glusterfs (rw,default_permissions,allow_other,max_read=131072)
<br>
<br>deploy image to PERSISTENT, it's ok. </span></div><div><span style="background-color: rgba(0, 0, 0, 0);"><br>[oneadmin@fc-server ]$ oneimage show 1 </span></div><div><span style="background-color: rgba(0, 0, 0, 0);">IMAGE 1 INFORMATION
<br>ID : 1
<br>NAME : ttylinux
<br>USER : oneadmin
<br>GROUP : oneadmin
<br>DATASTORE : img
<br>TYPE : OS
<br>REGISTER TIME : 07/11 21:35:11
<br>PERSISTENT : Yes
<br>SOURCE : /var/lib/one//datastores/103/4c40e4068ad2ff41c8767c40f85ae786
<br>PATH : http://marketplace.c12g.com/appliance/4fc76a938fb81d3517000003/download/0
<br>SIZE : 40M
<br>STATE : used
<br>RUNNING_VMS : 1
<br>
<br>PERMISSIONS
<br>OWNER : um-
<br>GROUP : ---
<br>OTHER : ---
<br>
<br>IMAGE TEMPLATE
<br>DEV_PREFIX="hd"
<br>FROM_APP="4fc76a938fb81d3517000003"
<br>FROM_APP_FILE="0"
<br>FROM_APP_NAME="ttylinux - kvm"
<br>MD5="04c7d00e88fa66d9aaa34d9cf8ad6aaa"
<br>
<br>VIRTUAL MACHINES
<br>
<br> ID USER GROUP NAME STAT UCPU UMEM HOST TIME
<br> 8 oneadmin oneadmin tt runn 0 512M 192.168.0. -1d 16h32
<br>[oneadmin@fc-server tm]$
<br>
<br>[oneadmin@fc-server 8]$ ll </span></div><div><span style="background-color: rgba(0, 0, 0, 0);">total 366
<br>-rw-rw-r-- 1 oneadmin oneadmin 992 Jul 11 13:44 deployment.0
<br>lrwxrwxrwx 1 oneadmin oneadmin 60 Jul 11 13:44 disk.0 -> /var/lib/one/datastores/103/4c40e4068ad2ff41c8767c40f85ae786
<br>-rw-r--r-- 1 oneadmin oneadmin 372736 Jul 11 13:44 disk.1
<br>lrwxrwxrwx 1 oneadmin oneadmin 36 Jul 11 13:44 disk.1.iso -> /var/lib/one/datastores/102/8/disk.1
<br>
<br>
<br>but deploy image to Non-persistent, it's no running. </span></div><div><span style="background-color: rgba(0, 0, 0, 0);"><br>[oneadmin@fc-server 102]$ oneimage show 1 </span></div><div><span style="background-color: rgba(0, 0, 0, 0);">IMAGE 1 INFORMATION
<br>ID : 1
<br>NAME : ttylinux
<br>USER : oneadmin
<br>GROUP : oneadmin
<br>DATASTORE : img
<br>TYPE : OS
<br>REGISTER TIME : 07/11 21:35:11
<br>PERSISTENT : No
<br>SOURCE : /var/lib/one//datastores/103/4c40e4068ad2ff41c8767c40f85ae786
<br>PATH : http://marketplace.c12g.com/appliance/4fc76a938fb81d3517000003/download/0
<br>SIZE : 40M
<br>STATE : used
<br>RUNNING_VMS : 1
<br>
<br>PERMISSIONS
<br>OWNER : um-
<br>GROUP : ---
<br>OTHER : ---
<br>
<br>IMAGE TEMPLATE
<br>DEV_PREFIX="hd"
<br>FROM_APP="4fc76a938fb81d3517000003"
<br>FROM_APP_FILE="0"
<br>FROM_APP_NAME="ttylinux - kvm"
<br>MD5="04c7d00e88fa66d9aaa34d9cf8ad6aaa"
<br>
<br>VIRTUAL MACHINES
<br>
<br> ID USER GROUP NAME STAT UCPU UMEM HOST TIME
<br> 10 oneadmin oneadmin tt fail 0 0K 0d 00h00
<br>
<br>[oneadmin@fc-server 102]$ ls </span></div><div><span style="background-color: rgba(0, 0, 0, 0);">10
<br>[oneadmin@fc-server 102]$ cd 10 </span></div><div><span style="background-color: rgba(0, 0, 0, 0);">[oneadmin@fc-server 10]$ ll
<br>total 41325
<br>-rw-rw-r-- 1 oneadmin oneadmin 971 Jul 11 14:35 deployment.0
<br>-rw-r--r-- 1 oneadmin oneadmin 41943040 Jul 11 14:35 disk.0
<br>-rw-r--r-- 1 oneadmin oneadmin 372736 Jul 11 14:35 disk.1
<br>lrwxrwxrwx 1 oneadmin oneadmin 37 Jul 11 14:35 disk.1.iso -> /var/lib/one/datastores/102/10/disk.1
<br>
<br>show log : </span></div><div><span style="background-color: rgba(0, 0, 0, 0);"><br>Fri Jul 11 14:35:26 2014 [DiM][D]: Deploying VM 10
<br>Fri Jul 11 14:35:26 2014 [ReM][D]: Req:8400 UID:0 VirtualMachineDeploy result SUCCESS, 10
<br>Fri Jul 11 14:35:31 2014 [TM][D]: Message received: TRANSFER SUCCESS 10 -
<br>
<br>Fri Jul 11 14:35:32 2014 [VMM][D]: Message received: LOG I 10 ExitCode: 0
<br>
<br>Fri Jul 11 14:35:32 2014 [VMM][D]: Message received: LOG I 10 Successfully execute network driver operation: pre.
<br>
<br>Fri Jul 11 14:35:33 2014 [VMM][D]: Message received: LOG I 10 Command execution fail: cat << EOT | /var/tmp/one/vmm/kvm/deploy
<br>'/var/lib/one//datastores/102/10/deployment.0' '192.168.0.199' 10 192.168.0.199
<br>
<br>Fri Jul 11 14:35:33 2014 [VMM][D]: Message received: LOG I 10 error: Failed to create domain from /var/lib/one//datastores/102/10/deployment.0
<br>
<br>Fri Jul 11 14:35:33 2014 [VMM][D]: Message received: LOG I 10 error: internal error process exited while connecting to monitor: qemu-kvm: -drive
<br>file=gluster+tcp://192.168.0.199:24007/fc-img/10/disk.0,if=none,id=drive-ide0-0-0,format=raw,cache=none: could not open disk image gluster+tcp://192.168.0.199:24007/fc-
<br>img/10/disk.0: No such file or directory
<br>
<br>Fri Jul 11 14:35:33 2014 [VMM][D]: Message received: LOG I 10 [2014-07-11 06:35:36.105637] E [afr-common.c:4157:afr_notify] 0-fc-img-replicate-0: All subvolumes are down.
<br>Going offline until atleast one of them comes back up.
<br>
<br>Fri Jul 11 14:35:33 2014 [VMM][D]: Message received: LOG I 10
<br>
<br>Fri Jul 11 14:35:33 2014 [VMM][D]: Message received: LOG E 10 Could not create domain from /var/lib/one//datastores/102/10/deployment.0
<br>
<br>Fri Jul 11 14:35:33 2014 [VMM][D]: Message received: LOG I 10 ExitCode: 255
<br>
<br>Fri Jul 11 14:35:33 2014 [VMM][D]: Message received: LOG I 10 Failed to execute virtualization driver operation: deploy.
<br>
<br>
<br>[oneadmin@fc-server 102]$ more /var/log/one/10.log
<br>Fri Jul 11 14:35:26 2014 [DiM][I]: New VM state is ACTIVE.
<br>Fri Jul 11 14:35:27 2014 [LCM][I]: New VM state is PROLOG.
<br>Fri Jul 11 14:35:32 2014 [LCM][I]: New VM state is BOOT
<br>Fri Jul 11 14:35:32 2014 [VMM][I]: Generating deployment file: /var/lib/one/vms/10/deployment.0
<br>Fri Jul 11 14:35:32 2014 [VMM][I]: ExitCode: 0
<br>Fri Jul 11 14:35:32 2014 [VMM][I]: Successfully execute network driver operation: pre.
<br>Fri Jul 11 14:35:33 2014 [VMM][I]: Command execution fail: cat << EOT | /var/tmp/one/vmm/kvm/deploy '/var/lib/one//datastores/102/10/deployment.0' '192.168.0.199
<br>' 10 192.168.0.199
<br>Fri Jul 11 14:35:33 2014 [VMM][I]: error: Failed to create domain from /var/lib/one//datastores/102/10/deployment.0
<br>Fri Jul 11 14:35:33 2014 [VMM][I]: error: internal error process exited while connecting to monitor: qemu-kvm: -drive file=gluster+tcp://192.168.0.199:24007/fc-i
<br>mg/10/disk.0,if=none,id=drive-ide0-0-0,format=raw,cache=none: could not open disk image gluster+tcp://192.168.0.199:24007/fc-img/10/disk.0: No such file or direc
<br>tory
<br>Fri Jul 11 14:35:33 2014 [VMM][I]: [2014-07-11 06:35:36.105637] E [afr-common.c:4157:afr_notify] 0-fc-img-replicate-0: All subvolumes are down. Going offline unt
<br>il atleast one of them comes back up.
<br>Fri Jul 11 14:35:33 2014 [VMM][I]:
<br>Fri Jul 11 14:35:33 2014 [VMM][E]: Could not create domain from /var/lib/one//datastores/102/10/deployment.0
<br>Fri Jul 11 14:35:33 2014 [VMM][I]: ExitCode: 255
<br>Fri Jul 11 14:35:33 2014 [VMM][I]: Failed to execute virtualization driver operation: deploy.
<br>Fri Jul 11 14:35:33 2014 [VMM][E]: Error deploying virtual machine: Could not create domain from /var/lib/one//datastores/102/10/deployment.0
<br>Fri Jul 11 14:35:35 2014 [DiM][I]: New VM state is FAILED
<br>
<br>qemu-kvm: -drive file=gluster+tcp://192.168.0.199:24007/fc-img/10/disk.0
<br>I think it should be gluster+tcp://192.168.0.199:24007/fc-sys/10/disk.0
<br>
<br>What advice do you have.Thanks. <br></span></div><div><span style="background-color: rgba(0, 0, 0, 0);"><br></span></div>
</body></html>