[one-users] Fault Tolerance and shared storage

[Nuno Serro]

An HTML attachment was scrubbed...
URL: <http://lists.opennebula.org/pipermail/users-opennebula.org/attachments/20140327/4818b413/attachment-0002.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: ulisboa_reitoria_rgb_mail_170.gif
Type: image/gif
Size: 3273 bytes
Desc: not available
URL: <http://lists.opennebula.org/pipermail/users-opennebula.org/attachments/20140327/4818b413/attachment-0006.gif>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/gif
Size: 3273 bytes
Desc: not available
URL: <http://lists.opennebula.org/pipermail/users-opennebula.org/attachments/20140327/4818b413/attachment-0007.gif>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/gif
Size: 3273 bytes
Desc: not available
URL: <http://lists.opennebula.org/pipermail/users-opennebula.org/attachments/20140327/4818b413/attachment-0008.gif>
-------------- next part --------------
Thu Mar 27 11:04:11 2014 [VMM][I]: Command execution fail: 'if [ -x "/var/tmp/one/vmm/kvm/poll" ]; then /var/tmp/one/vmm/kvm/poll one-416 bl05 416 bl05; else exit 42; fi'
Thu Mar 27 11:04:11 2014 [VMM][I]: ssh: connect to host bl05 port 22: No route to host
Thu Mar 27 11:04:11 2014 [VMM][I]: ExitCode: 255
Thu Mar 27 11:04:11 2014 [VMM][E]: Error monitoring VM
Thu Mar 27 11:04:11 2014 [LCM][I]: New VM state is UNKNOWN
Thu Mar 27 11:04:12 2014 [HKM][I]: Success executing Hook: mail_unknown: . 
Thu Mar 27 11:06:41 2014 [VMM][I]: Command execution fail: 'if [ -x "/var/tmp/one/vmm/kvm/poll" ]; then /var/tmp/one/vmm/kvm/poll one-416 bl05 416 bl05; else exit 42; fi'
Thu Mar 27 11:06:41 2014 [VMM][I]: ssh: connect to host bl05 port 22: No route to host
Thu Mar 27 11:06:41 2014 [VMM][I]: ExitCode: 255
Thu Mar 27 11:06:41 2014 [VMM][E]: Error monitoring VM
Thu Mar 27 11:07:35 2014 [LCM][I]: New VM state is CLEANUP.
Thu Mar 27 11:07:35 2014 [VMM][I]: Driver command for 416 cancelled
Thu Mar 27 11:07:35 2014 [VMM][I]: Command execution fail: /var/tmp/one/vmm/kvm/cancel 'one-416' 'bl05' 416 bl05
Thu Mar 27 11:07:35 2014 [VMM][I]: ssh: connect to host bl05 port 22: Connection refused
Thu Mar 27 11:07:35 2014 [VMM][I]: ExitSSHCode: 255
Thu Mar 27 11:07:35 2014 [VMM][E]: Error connecting to bl05
Thu Mar 27 11:07:35 2014 [VMM][I]: Failed to execute virtualization driver operation: cancel.
Thu Mar 27 11:07:35 2014 [VMM][I]: ssh: connect to host bl05 port 22: Connection refused
Thu Mar 27 11:07:35 2014 [VMM][I]: ExitSSHCode: 255
Thu Mar 27 11:07:35 2014 [VMM][E]: Error connecting to bl05
Thu Mar 27 11:07:35 2014 [VMM][I]: Failed to execute network driver operation: clean.
Thu Mar 27 11:07:36 2014 [VMM][I]: Command execution fail: /var/lib/one/remotes/tm/lvm/delete bl05:/var/lib/one//datastores/109/416/disk.0 416 102
Thu Mar 27 11:07:36 2014 [VMM][E]: delete: Command " DEV=$(readlink /var/lib/one/datastores/109/416/disk.0)
Thu Mar 27 11:07:36 2014 [VMM][I]: LV_NAME=$(basename $DEV)
Thu Mar 27 11:07:36 2014 [VMM][I]: 
Thu Mar 27 11:07:36 2014 [VMM][I]: # remove link
Thu Mar 27 11:07:36 2014 [VMM][I]: rm -f /var/lib/one/datastores/109/416/disk.0
Thu Mar 27 11:07:36 2014 [VMM][I]: 
Thu Mar 27 11:07:36 2014 [VMM][I]: # The following attrs will only be there if the image is non-persistent
Thu Mar 27 11:07:36 2014 [VMM][I]: # lv-one-<image> ==> persistent
Thu Mar 27 11:07:36 2014 [VMM][I]: # lv-one-<image>-<vmid>-<diskid> ==> non-persistent (clone)
Thu Mar 27 11:07:36 2014 [VMM][I]: 
Thu Mar 27 11:07:36 2014 [VMM][I]: VMID=$(echo $LV_NAME|cut -d- -f4)
Thu Mar 27 11:07:36 2014 [VMM][I]: DISKID=$(echo $LV_NAME|cut -d- -f5)
Thu Mar 27 11:07:36 2014 [VMM][I]: 
Thu Mar 27 11:07:36 2014 [VMM][I]: if [ -n "$VMID" -a -n "$DISKID" ]; then
Thu Mar 27 11:07:36 2014 [VMM][I]: # this is a cloned image
Thu Mar 27 11:07:36 2014 [VMM][I]: sudo lvremove -f $DEV
Thu Mar 27 11:07:36 2014 [VMM][I]: fi" failed: ssh: connect to host bl05 port 22: Connection refused
Thu Mar 27 11:07:36 2014 [VMM][E]: Error deleting /var/lib/one/datastores/109/416/disk.0
Thu Mar 27 11:07:36 2014 [VMM][I]: ExitCode: 255
Thu Mar 27 11:07:36 2014 [VMM][I]: Failed to execute transfer manager driver operation: tm_delete.
Thu Mar 27 11:07:36 2014 [VMM][I]: Command execution fail: /var/lib/one/remotes/tm/shared/delete bl05:/var/lib/one//datastores/109/416 416 109
Thu Mar 27 11:07:36 2014 [VMM][I]: delete: Deleting /var/lib/one/datastores/109/416
Thu Mar 27 11:07:36 2014 [VMM][E]: delete: Command "[ -e "/var/lib/one/datastores/109/416" ] || exit 0
Thu Mar 27 11:07:36 2014 [VMM][I]: 
Thu Mar 27 11:07:36 2014 [VMM][I]: times=10
Thu Mar 27 11:07:36 2014 [VMM][I]: function="rm -rf /var/lib/one/datastores/109/416"
Thu Mar 27 11:07:36 2014 [VMM][I]: 
Thu Mar 27 11:07:36 2014 [VMM][I]: count=1
Thu Mar 27 11:07:36 2014 [VMM][I]: 
Thu Mar 27 11:07:36 2014 [VMM][I]: ret=$($function)
Thu Mar 27 11:07:36 2014 [VMM][I]: error=$?
Thu Mar 27 11:07:36 2014 [VMM][I]: 
Thu Mar 27 11:07:36 2014 [VMM][I]: while [ $count -lt $times -a "$error" != "0" ]; do
Thu Mar 27 11:07:36 2014 [VMM][I]: sleep 1
Thu Mar 27 11:07:36 2014 [VMM][I]: count=$(( $count + 1 ))
Thu Mar 27 11:07:36 2014 [VMM][I]: ret=$($function)
Thu Mar 27 11:07:36 2014 [VMM][I]: error=$?
Thu Mar 27 11:07:36 2014 [VMM][I]: done
Thu Mar 27 11:07:36 2014 [VMM][I]: 
Thu Mar 27 11:07:36 2014 [VMM][I]: [ "x$error" = "x0" ]" failed: ssh: connect to host bl05 port 22: Connection refused
Thu Mar 27 11:07:36 2014 [VMM][E]: Error deleting /var/lib/one/datastores/109/416
Thu Mar 27 11:07:36 2014 [VMM][I]: ExitCode: 255
Thu Mar 27 11:07:36 2014 [VMM][I]: Failed to execute transfer manager driver operation: tm_delete.
Thu Mar 27 11:07:36 2014 [VMM][I]: Host successfully cleaned.
Thu Mar 27 11:07:36 2014 [DiM][I]: New VM state is PENDING
Thu Mar 27 11:07:54 2014 [DiM][I]: New VM state is ACTIVE.
Thu Mar 27 11:07:54 2014 [LCM][I]: New VM state is PROLOG.
Thu Mar 27 11:07:54 2014 [TM][I]: Command execution fail: /var/lib/one/remotes/tm/lvm/ln bl01:vg-nebula.lv-one-144 bl02:/var/lib/one//datastores/109/416/disk.0 416 102
Thu Mar 27 11:07:54 2014 [TM][E]: ln: Command " set -e
Thu Mar 27 11:07:54 2014 [TM][I]: mkdir -p /var/lib/one/datastores/109/416
Thu Mar 27 11:07:54 2014 [TM][I]: ln -s "/dev/vg-nebula/lv-one-144" "/var/lib/one/datastores/109/416/disk.0"" failed: ln: failed to create symbolic link `/var/lib/one/datastores/109/416/disk.0': File exists
Thu Mar 27 11:07:54 2014 [TM][E]: Error linking /dev/vg-nebula/lv-one-144
Thu Mar 27 11:07:54 2014 [TM][I]: ExitCode: 1
Thu Mar 27 11:07:54 2014 [TM][E]: Error executing image transfer script: Error linking /dev/vg-nebula/lv-one-144
Thu Mar 27 11:07:54 2014 [DiM][I]: New VM state is FAILED
Thu Mar 27 11:07:55 2014 [HKM][I]: Success executing Hook: mail_failed: . 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 555 bytes
Desc: OpenPGP digital signature
URL: <http://lists.opennebula.org/pipermail/users-opennebula.org/attachments/20140327/4818b413/attachment-0002.pgp>