<html><head><meta http-equiv=Content-Type content="text/html; charset=utf-8"><meta name=Generator content="Microsoft Word 14 (filtered medium)"><!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
gfidisc.maxtelecom.bg {color:black; !important} </style><![endif]--><style><!--
@font-face
{font-family:calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:"arial narrow";
panose-1:2 11 6 6 2 2 2 3 2 4;}
p.msonormal, li.msonormal, div.msonormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"times new roman","serif";}
h1
{mso-style-priority:9;
mso-style-link:"heading 1 char";
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:24.0pt;
font-family:"times new roman","serif";
font-weight:bold;}
a:link, span.msohyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.msohyperlinkfollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p
{mso-style-priority:99;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:12.0pt;
font-family:"times new roman","serif";}
p.msoacetate, li.msoacetate, div.msoacetate
{mso-style-priority:99;
mso-style-link:"balloon text char";
margin:0cm;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"tahoma","sans-serif";}
span.heading1char
{mso-style-name:"heading 1 char";
mso-style-priority:9;
mso-style-link:"heading 1";
font-family:"cambria","serif";
color:#365f91;
font-weight:bold;}
span.emailstyle20
{mso-style-type:personal-reply;
font-family:"calibri","sans-serif";
color:#1f497d;}
span.balloontextchar
{mso-style-name:"balloon text char";
mso-style-priority:99;
mso-style-link:"balloon text";
font-family:"tahoma","sans-serif";}
.msochpdefault
{mso-style-type:export-only;
font-family:"calibri","sans-serif";}
@page wordsection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.wordsection1
{page:wordsection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--> <meta name="application-name" content="gfidisc.maxtelecom.bg "> </head><body link=blue vlink=purple><div class=WordSection1><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>We have 3 datastores with the following ids: </span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>0 - system </span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>101 - ceph_data </span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>102 - system_mc </span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Live migration happens without a problem when we move the data from the datastore directory to the migration target machine datastore directory before that. </span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'> </span></p><p class=MsoNormal><b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'>From:</span></b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'> Jaime Melis [mailto:jmelis@opennebula.org] <br><b>Sent:</b> 05 май 2014 г. 12:54 ч.<br><b>To:</b> Stefan Ivanov<br><b>Cc:</b> users@lists.opennebula.org<br><b>Subject:</b> Re: [one-users] Live migration leads to UNKNOWM state </span></p><p class=MsoNormal> </p><div><p class=MsoNormal>Hi Stefan, </p><div><p class=MsoNormal> </p></div><div><p class=MsoNormal>what changes did you make? is this a bug you're reporting? </p></div><div><p class=MsoNormal> </p></div><div><p class=MsoNormal>cheers,<br>Jaime </p></div><div><p class=MsoNormal style='margin-bottom:12.0pt'> </p><div><p class=MsoNormal>On Wed, Apr 30, 2014 at 2:57 PM, Stefan Ivanov <<a href="mailto:s.ivanov@maxtelecom.bg">s.ivanov@maxtelecom.bg</a>> wrote: </p><div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Hello Jaime </span> </p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'> </span> </p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Problem is resolved, </span> </p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'> </span> </p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>After little modification of live migrate scripts everything is fine. The problem is that: checkpoint and deployment file not copied to target node. </span> </p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'> </span> </p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Right now I upgrade to 4.6 and test how is live migration I this version. </span> </p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'> </span> </p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Thanks and best regards, </span> </p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Stefan Ivanov </span> </p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'> </span> </p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'>From:</span></b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'> Jaime Melis [mailto:<a href="mailto:jmelis@opennebula.org">jmelis@opennebula.org</a>] <br><b>Sent:</b> 30 април 2014 г. 15:50 ч.<br><b>To:</b> Stefan Ivanov<br><b>Cc:</b> <a href="mailto:users@lists.opennebula.org">users@lists.opennebula.org</a><br><b>Subject:</b> Re: [one-users] Live migration leads to UNKNOWM state </span> </p><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'> </p><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Hi Stefan, </p><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'> </p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>can you verify if after a while the vms reverts back to the RUNNING state. </p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'> </p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Can you also manually confirm that the VM is indeed in the target server (by running virsh -c qemu:///system list) </p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'> </p></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>cheers,<br>Jaime </p></div></div></div><div><p class=MsoNormal style='mso-margin-top-alt:auto;margin-bottom:12.0pt'> </p><div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>On Thu, Apr 24, 2014 at 11:46 AM, Stefan Ivanov <<a href="mailto:s.ivanov@maxtelecom.bg">s.ivanov@maxtelecom.bg</a>> wrote: </p></div><div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>I`m running OpenNebula + CEPH + KVM. When I try to make live migration from one host to other everything looks good, no have errors, process is running on right host but Virtual machine go to UNKNOWN state(RUNNING(host1) -> MIGRATE -> RUNNING(host2) -> UNKNOWN(host2)). In vm log I see this: VM running but it was not found. Boot and delete actions available or try to recover it manually, New VM state is UNKNOWN.<br><br>About my configuration:<br>Ceph datastore:<br> ID 101<br> Name ceph_data<br> Cluster SunSystem<br> Base path /var/lib/one/datastores/101<br> Capacity<br> Total 36.4TB<br> Used 3.4TB<br> Free 33TB<br> Limit -<br><br>System datastores:<br> system<br> /var/lib/one//datastores/0<br> SHARED NO<br> TM_MAD ssh<br> TYPE SYSTEM_DS<br> system_mc<br> /var/lib/one//datastores/102<br> SHARED NO<br> TM_MAD ssh<br> TYPE SYSTEM_DS<br><br>VM LOG:<br> Thu Apr 24 12:15:49 2014 [LCM][I]: New VM state is MIGRATE<br> Thu Apr 24 12:15:49 2014 [VMM][I]: Successfully execute transfer manager driver operation: tm_premigrate.<br> Thu Apr 24 12:15:49 2014 [VMM][I]: ExitCode: 0<br> Thu Apr 24 12:15:49 2014 [VMM][I]: Successfully execute network driver operation: pre.<br> Thu Apr 24 12:15:55 2014 [VMM][I]: ExitCode: 0<br> Thu Apr 24 12:15:55 2014 [VMM][I]: Successfully execute virtualization driver operation: migrate.<br> Thu Apr 24 12:15:55 2014 [VMM][I]: ExitCode: 0<br> Thu Apr 24 12:15:55 2014 [VMM][I]: Successfully execute network driver operation: clean.<br> Thu Apr 24 12:15:55 2014 [VMM][I]: ExitCode: 0<br> Thu Apr 24 12:15:55 2014 [VMM][I]: Successfully execute network driver operation: post.<br> Thu Apr 24 12:15:55 2014 [VMM][I]: Successfully execute transfer manager driver operation: tm_postmigrate.<br> Thu Apr 24 12:15:55 2014 [LCM][I]: New VM state is RUNNING<br> Thu Apr 24 12:16:04 2014 [VMM][I]: VM running but it was not found. Boot and delete actions available or try to recover it manually<br> Thu Apr 24 12:16:04 2014 [LCM][I]: New VM state is UNKNOWN<br><br>Version of OpenNebula 4.4.1<br><br><br>CONFIDENTIALITY NOTICE<br>The information contained in this message (including any attachments) is confidential and may be legally privileged or otherwise protected from disclosure. This message is intended solely for the addressee(s). If you are not the intended recipient, please notify the sender by return e-mail and delete this message from your system. Any unauthorised use, reproduction, or dissemination of this message is strictly prohibited. Any liability arising from any third party acting, or refraining from acting, on any information contained in this e-mail is hereby excluded. Please note that e-mails are susceptible to change. Max Telecom shall not be liable for the improper or incomplete transmission of the information contained in this communication, nor shall it be liable for any delay in its receipt.<br><br><br>_______________________________________________<br>Users mailing list<br><a href="mailto:Users@lists.opennebula.org">Users@lists.opennebula.org</a><br><a href="http://lists.opennebula.org/listinfo.cgi/users-opennebula.org">http://lists.opennebula.org/listinfo.cgi/users-opennebula.org</a> </p></div></div></div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'> </p></div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'> </p><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'> </p></div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>-- </p><div><div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Jaime Melis<br>Project Engineer<br>OpenNebula - Flexible Enterprise Cloud Made Simple<br><a href="http://www.OpenNebula.org">www.OpenNebula.org</a> | <a href="mailto:jmelis@opennebula.org">jmelis@opennebula.org</a> </p></div></div></div></div><p class=MsoNormal style='margin-top:6.0pt;line-height:16.0pt'><strong><span style='font-size:9.0pt;font-family:"Arial Narrow","sans-serif";font-variant:small-caps;color:gray'>Confidentiality notice</span></strong> </p><div class=MsoNormal align=center style='text-align:center'><hr size=2 align=center></div><div><p> </p><p class=MsoNormal style='text-align:justify'><span style='font-size:9.0pt;font-family:"Arial Narrow","sans-serif";color:gray'>The information contained in this message (including any attachments) is confidential and may be legally privileged or otherwise protected from disclosure. This message is intended solely for the addressee(s). If you are not the intended recipient, please notify the sender by return e-mail and delete this message from your system. Any unauthorised use, reproduction, or dissemination of this message is strictly prohibited. Any liability arising from any third party acting, or refraining from acting, on any information contained in this e-mail is hereby excluded. Please note that e-mails are susceptible to change. Max Telecom shall not be liable for the improper or incomplete transmission of the information contained in this communication, nor shall it be liable for any delay in its receipt.</span> </p></div></div><p class=MsoNormal style='margin-bottom:12.0pt'><br>_______________________________________________<br>Users mailing list<br><a href="mailto:Users@lists.opennebula.org">Users@lists.opennebula.org</a><br><a href="http://lists.opennebula.org/listinfo.cgi/users-opennebula.org">http://lists.opennebula.org/listinfo.cgi/users-opennebula.org</a> </p></div><p class=MsoNormal style='margin-bottom:12.0pt'> </p><div><p class=MsoNormal> </p></div><p class=MsoNormal>-- </p><div><div><p class=MsoNormal>Jaime Melis<br>Project Engineer<br>OpenNebula - Flexible Enterprise Cloud Made Simple<br><a href="http://www.OpenNebula.org">www.OpenNebula.org</a> | <a href="mailto:jmelis@opennebula.org">jmelis@opennebula.org</a> </p></div></div></div></div></div><p class="gfidisc.maxtelecom.bg" id="gfidisc.maxtelecom.bg" style="gfidisc.maxtelecom.bg"></p><a id="gfidisc.maxtelecom.bg" title="gfidisc.maxtelecom.bg" href="gfidisc.maxtelecom.bg" class="gfidisc.maxtelecom.bg" style="text-decoration: none !important;"></a><gfidisc.maxtelecom.bg/><h1 class="gfidisc.maxtelecom.bg" style="gfidisc.maxtelecom.bg"></h1><p class="MsoNormal" style="line-height: 16pt; margin: 6pt 0cm 0pt; mso-line-height-rule: exactly;"><strong><span lang="EN-GB" style="font-variant: small-caps; font-family: 'Arial Narrow','sans-serif'; color: gray; font-size: 9pt; mso-ansi-language: EN-GB; mso-fareast-language: BG;">Confidentiality notice</span></strong></p>
<hr />
<p> </p>
<p class="MsoNormal" style="text-align: justify; margin: 0cm 0cm 0pt;"><span lang="EN-GB" style="font-family: 'Arial Narrow','sans-serif'; color: gray; font-size: 9pt; mso-ansi-language: EN-GB; mso-fareast-language: BG;">The information contained in this message (including any attachments) is confidential and may be legally privileged or otherwise protected from disclosure. This message is intended solely for the addressee(s). If you are not the intended recipient, please notify the sender by return e-mail and delete this message from your system. Any unauthorised use, reproduction, or dissemination of this message is strictly prohibited. Any liability arising from any third party acting, or refraining from acting, on any information contained in this e-mail is hereby excluded. Please note that e-mails are susceptible to change. Max Telecom shall not be liable for the improper or incomplete transmission of the information contained in this communication, nor shall it be liable for any delay in its receipt.</span></p><p class="gfidisc.maxtelecom.bg" id="gfidisc.maxtelecom.bg" style="gfidisc.maxtelecom.bg"></p><a id="gfidisc.maxtelecom.bg" title="gfidisc.maxtelecom.bg" href="gfidisc.maxtelecom.bg" class="gfidisc.maxtelecom.bg" style="text-decoration: none !important;"></a><gfidisc.maxtelecom.bg/><h1 class="gfidisc.maxtelecom.bg" style="gfidisc.maxtelecom.bg"></h1></body></html>