<html><head><meta http-equiv="content-type" content="text/html; charset=GB2312"><style>body { line-height: 1.5; }body { font-size: 10.5pt; font-family: Arial; color: rgb(0, 0, 0); line-height: 1.5; }</style></head><body>
<div><span></span><span style="background-color: rgba(0, 0, 0, 0);">Dear All, </span></div><div><span style="background-color: rgba(0, 0, 0, 0);"><br>I tried to deploy opennebula 4.6.2 base glusterfs 3.5.1</span></div><div><br></div><div><span style="background-color: rgba(0, 0, 0, 0);">all three server: </span></div><div><span style="background-color: rgba(0, 0, 0, 0);">1. one server,ip is 192.168.0.198;
<br>2. node0,ip is 192.168.0.199;
<br>3. node1,ip is 192.168.0.200;
<br>
<br><br>Datastores configuration: </span></div><div><span style="background-color: rgba(0, 0, 0, 0);"><br>[oneadmin@fc-server ]$ onedatastore show 102 </span></div><div><span style="background-color: rgba(0, 0, 0, 0); font-size: 10.5pt; line-height: 1.5;">DATASTORE 102 INFORMATION </span></div><div><span style="background-color: rgba(0, 0, 0, 0);">ID             : 102                 
<br>NAME           : sys                 
<br>USER           : oneadmin            
<br>GROUP          : oneadmin            
<br>CLUSTER        : c1                  
<br>TYPE           : SYSTEM              
<br>DS_MAD         : -                   
<br>TM_MAD         : shared              
<br>BASE PATH      : /var/lib/one//datastores/102
<br>DISK_TYPE      : FILE                
<br>
<br>DATASTORE CAPACITY                                                              
<br>TOTAL:         : 131.3G              
<br>FREE:          : 123.3G              
<br>USED:          : 41M                 
<br>LIMIT:         : -                   
<br>
<br>PERMISSIONS                                                                     
<br>OWNER          : um-                 
<br>GROUP          : u--                 
<br>OTHER          : ---                 
<br>
<br>DATASTORE TEMPLATE                                                              
<br>BASE_PATH="/var/lib/one//datastores/"
<br>GLUSTER_HOST="192.168.0.199:24007"
<br>GLUSTER_VOLUME="fc-sys"
<br>SHARED="YES"
<br>TM_MAD="shared"
<br>TYPE="SYSTEM_DS"
<br>       
<br>[oneadmin@fc-server ]$ onedatastore show 103 </span></div><div><span style="background-color: rgba(0, 0, 0, 0);">DATASTORE 103 INFORMATION                                                       
<br>ID             : 103                 
<br>NAME           : img                 
<br>USER           : oneadmin            
<br>GROUP          : oneadmin            
<br>CLUSTER        : c1                  
<br>TYPE           : IMAGE               
<br>DS_MAD         : fs                  
<br>TM_MAD         : shared              
<br>BASE PATH      : /var/lib/one//datastores/103
<br>DISK_TYPE      :                     
<br>
<br>DATASTORE CAPACITY                                                              
<br>TOTAL:         : 131.3G              
<br>FREE:          : 123.3G              
<br>USED:          : 41M                 
<br>LIMIT:         : -                   
<br>
<br>PERMISSIONS                                                                     
<br>OWNER          : um-                 
<br>GROUP          : u--                 
<br>OTHER          : ---                 
<br>
<br>DATASTORE TEMPLATE                                                              
<br>BASE_PATH="/var/lib/one//datastores/"
<br>CLONE_TARGET="SYSTEM"
<br>DISK_TYPE="GLUSTER"
<br>DS_MAD="fs"
<br>GLUSTER_HOST="192.168.0.199:24007"
<br>GLUSTER_VOLUME="fc-img"
<br>LN_TARGET="NONE"
<br>TM_MAD="shared"
<br>TYPE="IMAGE_DS"
<br>
<br>192.168.0.199:/fc-sys on /var/lib/one/datastores/102 type fuse.glusterfs (rw,default_permissions,allow_other,max_read=131072) </span></div><div><span style="background-color: rgba(0, 0, 0, 0);">192.168.0.199:/fc-img on /var/lib/one/datastores/103 type fuse.glusterfs (rw,default_permissions,allow_other,max_read=131072)
<br>
<br>deploy image to PERSISTENT, it's ok. </span></div><div><span style="background-color: rgba(0, 0, 0, 0);"><br>[oneadmin@fc-server ]$ oneimage show 1 </span></div><div><span style="background-color: rgba(0, 0, 0, 0);">IMAGE 1 INFORMATION                                                             
<br>ID             : 1                   
<br>NAME           : ttylinux            
<br>USER           : oneadmin            
<br>GROUP          : oneadmin            
<br>DATASTORE      : img                 
<br>TYPE           : OS                  
<br>REGISTER TIME  : 07/11 21:35:11      
<br>PERSISTENT     : Yes                 
<br>SOURCE         : /var/lib/one//datastores/103/4c40e4068ad2ff41c8767c40f85ae786
<br>PATH           : http://marketplace.c12g.com/appliance/4fc76a938fb81d3517000003/download/0
<br>SIZE           : 40M                 
<br>STATE          : used                
<br>RUNNING_VMS    : 1                   
<br>
<br>PERMISSIONS                                                                     
<br>OWNER          : um-                 
<br>GROUP          : ---                 
<br>OTHER          : ---                 
<br>
<br>IMAGE TEMPLATE                                                                  
<br>DEV_PREFIX="hd"
<br>FROM_APP="4fc76a938fb81d3517000003"
<br>FROM_APP_FILE="0"
<br>FROM_APP_NAME="ttylinux - kvm"
<br>MD5="04c7d00e88fa66d9aaa34d9cf8ad6aaa"
<br>
<br>VIRTUAL MACHINES
<br>
<br>    ID USER     GROUP    NAME            STAT UCPU    UMEM HOST             TIME
<br>     8 oneadmin oneadmin tt              runn    0    512M 192.168.0.  -1d 16h32
<br>[oneadmin@fc-server tm]$ 
<br>
<br>[oneadmin@fc-server 8]$ ll </span></div><div><span style="background-color: rgba(0, 0, 0, 0);">total 366
<br>-rw-rw-r-- 1 oneadmin oneadmin    992 Jul 11 13:44 deployment.0
<br>lrwxrwxrwx 1 oneadmin oneadmin     60 Jul 11 13:44 disk.0 -> /var/lib/one/datastores/103/4c40e4068ad2ff41c8767c40f85ae786
<br>-rw-r--r-- 1 oneadmin oneadmin 372736 Jul 11 13:44 disk.1
<br>lrwxrwxrwx 1 oneadmin oneadmin     36 Jul 11 13:44 disk.1.iso -> /var/lib/one/datastores/102/8/disk.1
<br>
<br>
<br>but deploy image to Non-persistent, it's no running. </span></div><div><span style="background-color: rgba(0, 0, 0, 0);"><br>[oneadmin@fc-server 102]$ oneimage show 1 </span></div><div><span style="background-color: rgba(0, 0, 0, 0);">IMAGE 1 INFORMATION                                                             
<br>ID             : 1                   
<br>NAME           : ttylinux            
<br>USER           : oneadmin            
<br>GROUP          : oneadmin            
<br>DATASTORE      : img                 
<br>TYPE           : OS                  
<br>REGISTER TIME  : 07/11 21:35:11      
<br>PERSISTENT     : No                  
<br>SOURCE         : /var/lib/one//datastores/103/4c40e4068ad2ff41c8767c40f85ae786
<br>PATH           : http://marketplace.c12g.com/appliance/4fc76a938fb81d3517000003/download/0
<br>SIZE           : 40M                 
<br>STATE          : used                
<br>RUNNING_VMS    : 1                   
<br>
<br>PERMISSIONS                                                                     
<br>OWNER          : um-                 
<br>GROUP          : ---                 
<br>OTHER          : ---                 
<br>
<br>IMAGE TEMPLATE                                                                  
<br>DEV_PREFIX="hd"
<br>FROM_APP="4fc76a938fb81d3517000003"
<br>FROM_APP_FILE="0"
<br>FROM_APP_NAME="ttylinux - kvm"
<br>MD5="04c7d00e88fa66d9aaa34d9cf8ad6aaa"
<br>
<br>VIRTUAL MACHINES
<br>
<br>    ID USER     GROUP    NAME            STAT UCPU    UMEM HOST             TIME
<br>    10 oneadmin oneadmin tt              fail    0      0K              0d 00h00
<br>
<br>[oneadmin@fc-server 102]$ ls </span></div><div><span style="background-color: rgba(0, 0, 0, 0);">10  
<br>[oneadmin@fc-server 102]$ cd 10 </span></div><div><span style="background-color: rgba(0, 0, 0, 0);">[oneadmin@fc-server 10]$ ll
<br>total 41325
<br>-rw-rw-r-- 1 oneadmin oneadmin      971 Jul 11 14:35 deployment.0
<br>-rw-r--r-- 1 oneadmin oneadmin 41943040 Jul 11 14:35 disk.0
<br>-rw-r--r-- 1 oneadmin oneadmin   372736 Jul 11 14:35 disk.1
<br>lrwxrwxrwx 1 oneadmin oneadmin       37 Jul 11 14:35 disk.1.iso -> /var/lib/one/datastores/102/10/disk.1
<br>
<br>show log : </span></div><div><span style="background-color: rgba(0, 0, 0, 0);"><br>Fri Jul 11 14:35:26 2014 [DiM][D]: Deploying VM 10
<br>Fri Jul 11 14:35:26 2014 [ReM][D]: Req:8400 UID:0 VirtualMachineDeploy result SUCCESS, 10
<br>Fri Jul 11 14:35:31 2014 [TM][D]: Message received: TRANSFER SUCCESS 10 -
<br>
<br>Fri Jul 11 14:35:32 2014 [VMM][D]: Message received: LOG I 10 ExitCode: 0
<br>
<br>Fri Jul 11 14:35:32 2014 [VMM][D]: Message received: LOG I 10 Successfully execute network driver operation: pre.
<br>
<br>Fri Jul 11 14:35:33 2014 [VMM][D]: Message received: LOG I 10 Command execution fail: cat << EOT | /var/tmp/one/vmm/kvm/deploy 
<br>'/var/lib/one//datastores/102/10/deployment.0' '192.168.0.199' 10 192.168.0.199
<br>
<br>Fri Jul 11 14:35:33 2014 [VMM][D]: Message received: LOG I 10 error: Failed to create domain from /var/lib/one//datastores/102/10/deployment.0
<br>
<br>Fri Jul 11 14:35:33 2014 [VMM][D]: Message received: LOG I 10 error: internal error process exited while connecting to monitor: qemu-kvm: -drive 
<br>file=gluster+tcp://192.168.0.199:24007/fc-img/10/disk.0,if=none,id=drive-ide0-0-0,format=raw,cache=none: could not open disk image gluster+tcp://192.168.0.199:24007/fc-
<br>img/10/disk.0: No such file or directory
<br>
<br>Fri Jul 11 14:35:33 2014 [VMM][D]: Message received: LOG I 10 [2014-07-11 06:35:36.105637] E [afr-common.c:4157:afr_notify] 0-fc-img-replicate-0: All subvolumes are down. 
<br>Going offline until atleast one of them comes back up.
<br>
<br>Fri Jul 11 14:35:33 2014 [VMM][D]: Message received: LOG I 10 
<br>
<br>Fri Jul 11 14:35:33 2014 [VMM][D]: Message received: LOG E 10 Could not create domain from /var/lib/one//datastores/102/10/deployment.0
<br>
<br>Fri Jul 11 14:35:33 2014 [VMM][D]: Message received: LOG I 10 ExitCode: 255
<br>
<br>Fri Jul 11 14:35:33 2014 [VMM][D]: Message received: LOG I 10 Failed to execute virtualization driver operation: deploy.
<br>
<br>
<br>[oneadmin@fc-server 102]$ more /var/log/one/10.log 
<br>Fri Jul 11 14:35:26 2014 [DiM][I]: New VM state is ACTIVE.
<br>Fri Jul 11 14:35:27 2014 [LCM][I]: New VM state is PROLOG.
<br>Fri Jul 11 14:35:32 2014 [LCM][I]: New VM state is BOOT
<br>Fri Jul 11 14:35:32 2014 [VMM][I]: Generating deployment file: /var/lib/one/vms/10/deployment.0
<br>Fri Jul 11 14:35:32 2014 [VMM][I]: ExitCode: 0
<br>Fri Jul 11 14:35:32 2014 [VMM][I]: Successfully execute network driver operation: pre.
<br>Fri Jul 11 14:35:33 2014 [VMM][I]: Command execution fail: cat << EOT | /var/tmp/one/vmm/kvm/deploy '/var/lib/one//datastores/102/10/deployment.0' '192.168.0.199
<br>' 10 192.168.0.199
<br>Fri Jul 11 14:35:33 2014 [VMM][I]: error: Failed to create domain from /var/lib/one//datastores/102/10/deployment.0
<br>Fri Jul 11 14:35:33 2014 [VMM][I]: error: internal error process exited while connecting to monitor: qemu-kvm: -drive file=gluster+tcp://192.168.0.199:24007/fc-i
<br>mg/10/disk.0,if=none,id=drive-ide0-0-0,format=raw,cache=none: could not open disk image gluster+tcp://192.168.0.199:24007/fc-img/10/disk.0: No such file or direc
<br>tory
<br>Fri Jul 11 14:35:33 2014 [VMM][I]: [2014-07-11 06:35:36.105637] E [afr-common.c:4157:afr_notify] 0-fc-img-replicate-0: All subvolumes are down. Going offline unt
<br>il atleast one of them comes back up.
<br>Fri Jul 11 14:35:33 2014 [VMM][I]: 
<br>Fri Jul 11 14:35:33 2014 [VMM][E]: Could not create domain from /var/lib/one//datastores/102/10/deployment.0
<br>Fri Jul 11 14:35:33 2014 [VMM][I]: ExitCode: 255
<br>Fri Jul 11 14:35:33 2014 [VMM][I]: Failed to execute virtualization driver operation: deploy.
<br>Fri Jul 11 14:35:33 2014 [VMM][E]: Error deploying virtual machine: Could not create domain from /var/lib/one//datastores/102/10/deployment.0
<br>Fri Jul 11 14:35:35 2014 [DiM][I]: New VM state is FAILED
<br>
<br>qemu-kvm: -drive file=gluster+tcp://192.168.0.199:24007/fc-img/10/disk.0
<br>I think it should be gluster+tcp://192.168.0.199:24007/fc-sys/10/disk.0
<br>
<br>What advice do you have.Thanks. <br></span></div><div><span style="background-color: rgba(0, 0, 0, 0);"><br></span></div>
</body></html>