<html><head></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><div>Hi Tino,</div><div><br></div><div>i think it is done, i found the bug!!!</div><div><br></div><div>After debugging Mad it turned out, that it didn't receive the "DEPLOY SUCCESS" message. I know that you are "sending" this message via a System.out.println in the VMWare driver. Normally a println is terminated by a "\n" and therefore it was clear that you are buffering the message until you receive this character. The big question was now, whether the MAD didn't receive the "DEPLOY SUCCESS" or just the terminating "\n". It was the second case.</div><div><br></div><div>To be honest, i don't understand why it isn't received. Every println is terminated not necessarily by a "\n" but by the value of the system property "line.separator". In Linux this should be the newline character, so everything should be fine.</div><div><br></div><div>Nevertheless i encourage you to use my bug fix. Append a "\n" to every send message of the "OneVmmVmware" Java class(method send_message). In that way your driver will be OS-independent and also work e.g. under Mac OS.</div><div><br></div><div>Thank you for all your help, you are doing a great job ;-)</div><div><br></div><div>Best regards</div><div>Stefan</div><div><br></div><div><div>Am 22.02.2010 um 15:52 schrieb Tino Vazquez:</div><br class="Apple-interchange-newline"><blockquote type="cite"><div>Hi Stefan,<br><br>Sorry for the delay, we are really busy right now.<br><br>The machines in the "boot" state are probably due to some missing<br>"DEPLOY SUCCESS" messages that "oned" should receive from the drivers<br>and is not getting. This may happen for a variety of reasons, one can<br>be that the drivers crashes (do you see anything in the oned.log?).<br><br>One possible experiment could be to log all incoming and outgoing<br>messages in the MAD, and try to reproduce the problem. Then, for the<br>machines in pending state, we can look to the DEPLOY SUCCESS messages<br>to see if they got one.<br><br>Hope it helps, thanks again for the feedback,<br><br>-Tino<br><br>--<br>Constantino Vázquez, Grid & Virtualization Technology<br>Engineer/Researcher: <a href="http://www.dsa-research.org/tinova">http://www.dsa-research.org/tinova</a><br>DSA Research Group: <a href="http://dsa-research.org">http://dsa-research.org</a><br>Globus GridWay Metascheduler: <a href="http://www.GridWay.org">http://www.GridWay.org</a><br>OpenNebula Virtual Infrastructure Engine: <a href="http://www.OpenNebula.org">http://www.OpenNebula.org</a><br><br><br><br>On Thu, Feb 11, 2010 at 8:06 PM, Stefan Reichel<br><<a href="mailto:Stefan.Reichel@student.hpi.uni-potsdam.de">Stefan.Reichel@student.hpi.uni-potsdam.de</a>> wrote:<br><blockquote type="cite">Hi Tino,<br></blockquote><blockquote type="cite">i am glad to here, that you are still investigating our problem, thanks.<br></blockquote><blockquote type="cite">What we try is easy to sum up. We make sure that the vm list is empty.<br></blockquote><blockquote type="cite">Afterwards we make a "onevm create" with our virtual machine templates. The<br></blockquote><blockquote type="cite">machines are therefore "new" for opennebula and get new Ids. Then we can see<br></blockquote><blockquote type="cite">that VM-Ware Server starts to power on the VM. Nevertheless "onevm list"<br></blockquote><blockquote type="cite">shows often, not always, the wrong old "booting" state.<br></blockquote><blockquote type="cite">We also now, that the Java VmWare driver, seems to work correctly in 100% of<br></blockquote><blockquote type="cite">the cases. This was verified byt putting additional System.put.println in<br></blockquote><blockquote type="cite">the code and redirecting the "disabled" standard output from /dev/null to a<br></blockquote><blockquote type="cite">text file.<br></blockquote><blockquote type="cite">Could this whole issue be releated to a performance problem? I mean during<br></blockquote><blockquote type="cite">the deployment phase the cpu is in heavy use, because our frontend and<br></blockquote><blockquote type="cite">VM-Ware server are on the same test machine. Can this confuse ruby or the<br></blockquote><blockquote type="cite">oned? I don't know what to test, so i can't provide you further information.<br></blockquote><blockquote type="cite">Best regards<br></blockquote><blockquote type="cite">Stefan<br></blockquote><blockquote type="cite">Am 11.02.2010 um 16:22 schrieb Tino Vazquez:<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Hi Stefan,<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">I think I am a bit lost now, let's see if you can get me back on<br></blockquote><blockquote type="cite">track. For what I gather, the VMware drivers are working as expected,<br></blockquote><blockquote type="cite">and the VMs seen in boot state are the ones that were previously<br></blockquote><blockquote type="cite">registered and not unregistered due to a ONE shutdown before this<br></blockquote><blockquote type="cite">could happen.<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">If this is not correct, could you please elaborate a bit more on this?<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Regards,<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">-Tino<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">--<br></blockquote><blockquote type="cite">Constantino Vázquez, Grid & Virtualization Technology<br></blockquote><blockquote type="cite">Engineer/Researcher: <a href="http://www.dsa-research.org/tinova">http://www.dsa-research.org/tinova</a><br></blockquote><blockquote type="cite">DSA Research Group: <a href="http://dsa-research.org">http://dsa-research.org</a><br></blockquote><blockquote type="cite">Globus GridWay Metascheduler: <a href="http://www.GridWay.org">http://www.GridWay.org</a><br></blockquote><blockquote type="cite">OpenNebula Virtual Infrastructure Engine: <a href="http://www.OpenNebula.org">http://www.OpenNebula.org</a><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">On Sat, Feb 6, 2010 at 2:59 PM, Stefan Reichel<br></blockquote><blockquote type="cite"><<a href="mailto:stefan.reichel@student.hpi.uni-potsdam.de">stefan.reichel@student.hpi.uni-potsdam.de</a>> wrote:<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Hello Tino,<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">are there any new information available about the described bug? Or should i<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">make some further tests?<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Regards and have a nice weekend<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Stefan<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Am 02.02.2010 um 01:04 schrieb Stefan Reichel:<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Hi Tino,<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">you are right, the output was collected while the machines were still<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">running. The behavior of the vmm_vmware driver was correct. I also send you<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">a mail on sunday with additional output, which also underlines that the Java<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">part of the driver works as expected. Therefore i assume the problem must be<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">somewhere in the other parts of the driver.<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Best regards<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Stefan<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Am 01.02.2010 um 12:55 schrieb Tino Vazquez:<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Hi Stefan,<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">For what I read in the java stack trace, the machine is already<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">powered on, that is why is failing. This may happen when you kill<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">OpenNebula (without letting it shutdown the VMs), clear it's DB and<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">try to submit VMs again, the names will clash (if one-1 is still<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">running, a new deployment of a one-1 will fail).<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">If this is not the case, please let me know and we will look at something<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">else.<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Regards,<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">-Tino<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">--<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Constantino Vázquez, Grid & Virtualization Technology<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Engineer/Researcher: <a href="http://www.dsa-research.org/tinova">http://www.dsa-research.org/tinova</a><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">DSA Research Group: <a href="http://dsa-research.org">http://dsa-research.org</a><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Globus GridWay Metascheduler: <a href="http://www.GridWay.org">http://www.GridWay.org</a><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">OpenNebula Virtual Infrastructure Engine: <a href="http://www.OpenNebula.org">http://www.OpenNebula.org</a><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">On Fri, Jan 29, 2010 at 2:18 AM, Stefan Reichel<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><<a href="mailto:Stefan.Reichel@student.hpi.uni-potsdam.de">Stefan.Reichel@student.hpi.uni-potsdam.de</a>> wrote:<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Hi Tino,<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">i tried your command with 5 parameters, i think you missed the checkpoint.<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">The result is easy to describe: there is nothing. The script itself hangs<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">and the log files don't contain any failure or success.<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Therefore i tried the java class directly by calling:<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">java -Ddebug=1 OneVmmVmware --username oneadmin --password xxxx --ignorecert<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">And pasting:<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">DEPLOY 1 fqdn /usr/share/one/var/1/deployment.0 CP1<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">The script itself seems to work because of the error i get(at the end of<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">this document). I also got once another error which was connected to the<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">network, but think this was caused by network misconfiguration. Nevertheless<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">i included also that log and the network file. The oned.log is also quiet<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">useless after the "prolog success" message the monitoring begins, no deploy<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">success at all. I also saw once after it a line "failure: " without any<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">reason. Perhaps this is connected to the java output below, because there is<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">also no reason. In that case it would be probably caused by a race<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">condition, which would also explain why it only happens sometimes.<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">I hope the output and descriptions give you an indication of how to find the<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">reason for our problem.<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Best regards<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Stefan<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Output of java -Ddebug=1 OneVmmVmware --username oneadmin --password xxxx<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">--ignorecert:<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">DEPLOY 1 fqdn /usr/share/one/var/1/deployment.0 CP1<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">DEPLOY FAILURE 1 Failed deploying VM in host fqdn.<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">[29.01.2010 01:52:17] Failed deploying VM 1 into fqdn.Reason: null<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">---- Debug stack trace ----<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">AxisFault<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">faultCode: ServerFaultCode<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">faultSubcode:<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">faultString: The attempted operation cannot be performed in the current<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">state (Powered On).<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">faultActor:<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">faultNode:<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">faultDetail:<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">{urn:vim2}InvalidPowerStateFault:<requestedState>poweredOn</requestedState><existingState>poweredOn</existingState><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">The attempted operation cannot be performed in the current state (Powered<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">On).<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">at<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">at<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">at java.lang.reflect.Constructor.newInstance(Constructor.java:532)<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">at java.lang.Class.newInstance0(Class.java:372)<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">at java.lang.Class.newInstance(Class.java:325)<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">at<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">org.apache.axis.encoding.ser.BeanDeserializer.<init>(BeanDeserializer.java:104)<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">at<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">org.apache.axis.encoding.ser.BeanDeserializer.<init>(BeanDeserializer.java:90)<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">at<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">com.vmware.vim.InvalidPowerState.getDeserializer(InvalidPowerState.java:156)<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">at<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">at<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">at java.lang.reflect.Method.invoke(Method.java:616)<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">......<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">at org.apache.axis.client.AxisClient.invoke(AxisClient.java:206)<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">at org.apache.axis.client.Call.invokeEngine(Call.java:2784)<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">at org.apache.axis.client.Call.invoke(Call.java:2767)<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">at org.apache.axis.client.Call.invoke(Call.java:2443)<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">at org.apache.axis.client.Call.invoke(Call.java:2366)<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">at org.apache.axis.client.Call.invoke(Call.java:1812)<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">at com.vmware.vim.VimBindingStub.powerOnVM_Task(VimBindingStub.java:24320)<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">at OperationsOverVM.powerOn(OperationsOverVM.java:82)<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">at OneVmmVmware.loop(OneVmmVmware.java:204)<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">at OneVmmVmware.main(OneVmmVmware.java:57)<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">[29.01.2010 01:52:17] ---------------------------<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Outputof java -Ddebug=1 OneVmmVmware .... based on network misconfiguration?<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">DEPLOY FAILURE 0 Failed deploying VM in host fqdn.<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">[29.01.2010 01:10:43] Failed deploying VM 0 into fqdn.Reason: null<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">---- Debug stack trace ----<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">java.lang.NullPointerException<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">at DeployVM.configureNetwork(DeployVM.java:268)<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">at DeployVM.shapeVM(DeployVM.java:220)<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">at OneVmmVmware.loop(OneVmmVmware.java:168)<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">at OneVmmVmware.main(OneVmmVmware.java:57)<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">[29.01.2010 01:10:43] ---------------------------<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Old network config:<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">NAME = "VMWareNet"<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">TYPE = RANGED<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">BRIDGE = NAT<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">NETWORK_ADDRESS = 192.168.189.200<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">NETWORK_SIZE = 254<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Oned.log (extract)<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Fri Jan 29 00:55:28 2010 [TM][D]: Message received: TRANSFER SUCCESS 0 -<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Fri Jan 29 00:55:28 2010 [LCM][I]: prolog success:<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Fri Jan 29 00:55:39 2010 [VMM][I]: Recovering VMM drivers<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Fri Jan 29 00:56:03 2010 [ReM][D]: VirtualMachinePoolInfo method invoked<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Fri Jan 29 00:56:06 2010 [ReM][D]: VirtualMachinePoolInfo method invoked<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Fri Jan 29 00:56:51 2010 [VMM][I]: Monitoring VM 86.<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Fri Jan 29 00:56:54 2010 [InM][I]: Monitoring host fqdn (0)<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Fri Jan 29 00:56:57 2010 [InM][D]: Host 0 successfully monitored.<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Fri Jan 29 00:56:57 2010 [ReM][D]: VirtualMachinePoolInfo method invoked<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Fri Jan 29 00:57:01 2010 [VMM][D]: Message received: POLL SUCCESS 0 STATE=a<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Am 28.01.2010 um 19:37 schrieb Tino Vazquez:<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Hi Stefan,<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Let's try executing the driver by hand. The VMM driver talks with<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">OpenNebula core using an ASCII protocol. So, if you execute the<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">driver:<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">$ONE_LOCATION/lib/mads/one_vmm_vmware<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">and hit enter, it should wait for input in the standard input, and you<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">will need to type:<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">---8<----<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">DEPLOY 0 fqdn var/77/images/deployment.0<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">--->8----<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">assuming that $ONE_LOCATION/var/77 exists (i.e. a previous attempt to<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">run a VM with OpenNebula ID 77 has been made, it didn't have to<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">suceed).<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Then answer we are waiting for is a DEPLOY 0 SUCCESS, this is what the<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">OpenNebula core seems to be not getting.<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Your use case is very interesting, we are happy to help. OpenNebula<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">doesn't feature a web GUIU per-se, but we offer a REST interface using<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">EC2 or OCCI, over which an AJAX application can be build.<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Best regards,<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">-Tino<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">--<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Constantino Vázquez, Grid & Virtualization Technology<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Engineer/Researcher: <a href="http://www.dsa-research.org/tinova">http://www.dsa-research.org/tinova</a><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">DSA Research Group: <a href="http://dsa-research.org">http://dsa-research.org</a><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Globus GridWay Metascheduler: <a href="http://www.GridWay.org">http://www.GridWay.org</a><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">OpenNebula Virtual Infrastructure Engine: <a href="http://www.OpenNebula.org">http://www.OpenNebula.org</a><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">On Thu, Jan 28, 2010 at 1:05 AM, Stefan Reichel<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><<a href="mailto:Stefan.Reichel@student.hpi.uni-potsdam.de">Stefan.Reichel@student.hpi.uni-potsdam.de</a>> wrote:<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Hi Tino,<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">i just wanted to write, that everything is fine, but it isn't. The problem<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">only occurs sometimes. At the end of this mail you will find some logs.<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">VM(77) is up and running in the VM-Server, but in the same time in "boot"<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">state. By the way we currently use VMware-server-2.0.2-203138.i386 .<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">As you can see in the logs, the "DEPLOY SUCCESS" message is send at least<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">this believes the OneVmmVmware.java. But it seems that it is never received.<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Sometimes it works, but this is not deterministic, in that case it would<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">also be appear in oned.log.<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">The main goal of our project is to setup a network environment, in which<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">students can test and investigate several security weaknesses on live<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">systems. For every such scenario we need different computers which are<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">simulated via VMs. In effect when a new scenario is loaded, OpenNebula will<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">be responsable for the VM setup and management.<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">We will primarily use VMWare images(with VM-Server) but also KVM. To control<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">our scenarios we will implement a webinterface, which will be used for<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">management but also monitoring purpose. As far as i know, OpenNebula has<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">only a command line frontend?<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Best Regards<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Stefan<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">VM.LOG :<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Wed Jan 27 23:57:41 2010 [DiM][I]: New VM state is ACTIVE.<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Wed Jan 27 23:57:42 2010 [LCM][I]: New VM state is PROLOG.<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Wed Jan 27 23:57:42 2010 [VM][I]: Virtual Machine has no context<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Wed Jan 27 23:58:46 2010 [TM][I]: tm_clone.sh:<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">fqdn:/srv/seclab/images-src/vmware/XP2 fqdn:/srv/seclab/vms/77/images/disk.0<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Wed Jan 27 23:58:46 2010 [TM][I]: tm_clone.sh: Cloning<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">fqdn:/srv/seclab/images-src/vmware/XP2<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Wed Jan 27 23:58:46 2010 [LCM][I]: New VM state is BOOT<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Wed Jan 27 23:58:46 2010 [VMM][I]: Generating deployment file:<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">/usr/share/one/var/77/deployment.0<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">ONED.LOG :<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Wed Jan 27 23:57:41 2010 [DiM][D]: Deploying VM 77<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Wed Jan 27 23:57:44 2010 [InM][I]: Monitoring host fqdn (0)<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Wed Jan 27 23:57:48 2010 [InM][D]: Host 0 successfully monitored.<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Wed Jan 27 23:57:52 2010 [VMM][I]: Monitoring VM 76.<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Wed Jan 27 23:57:53 2010 [VMM][D]: Message received: POLL SUCCESS 76 STATE=a<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">USEDMEMORY=25 USEDCPU=0<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Wed Jan 27 23:58:46 2010 [TM][D]: Message received: LOG - 77 tm_clone.sh:<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">fqdn:/srv/seclab/images-src/vmware/XP2 fqdn:/srv/seclab/vms/77/images/disk.0<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Wed Jan 27 23:58:46 2010 [TM][D]: Message received: LOG - 77 tm_clone.sh:<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Cloning fqdn:/srv/seclab/images-src/vmware/XP2<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Wed Jan 27 23:58:46 2010 [TM][D]: Message received: TRANSFER SUCCESS 77 -<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Wed Jan 27 23:58:46 2010 [LCM][I]: prolog success:<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">VMM_VMWARE.LOG (Output added to OneVmmVWare.java)<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">[27.01.2010 23:41:40] TRY TO POWER ON<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">[27.01.2010 23:41:45] DEPLOY SUCCESS<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">[27.01.2010 23:58:50] TRY TO POWER ON<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">[27.01.2010 23:58:54] DEPLOY SUCCESS<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Am 27.01.2010 um 13:04 schrieb Tino Vazquez:<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Hi Stefan,<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">comments inline,<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">On Wed, Jan 27, 2010 at 10:27 AM, Stefan Reichel<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><<a href="mailto:stefan.reichel@student.hpi.uni-potsdam.de">stefan.reichel@student.hpi.uni-potsdam.de</a>> wrote:<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Hi,<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">i tried to analyze the bug and finally solve this problem. For now these are<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">my results, please correct my if i am wrong.<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">First of all, the VM is running in VMware but in the "onevm list" it is<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">still booting. The VirtualMachineManager::deploy_action was finished. These<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">were the facts now my theory:<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Normally the MadManager will receive a message, and forward it to the<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">corresponding VM-Driver by calling the protocol method. In my case this<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">would be the VirtualMachineManagerDriver. Nevertheless its protocol method<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">is not called and therefore it can't call the LifeCycleManager, which would<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">in effect set the "running" state, after reacting on a "DEPLOY_SUCCESS".<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Therefore i assume, that the corresponding message is never send. But who<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">should send it???<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">The VMware VMM mad is responsible to send back the DEPLOY SUCESS, so<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">it is probably failing to do so. you mentioned in a previous email<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">that the VM is already running, so I guess the driver is crashing<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">badly after performing the powerOn (otherwise it will send the "DEPLOY<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">FAILED " and you would get a "fail" instead of a "boot" in the VM<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">state). Do you see anything in the one_vmm_vmware log file?<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">I temporary fixed the problem by setting the running state manually in the<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">mentioned deploy_action. I hope that someone will finally answer one of my<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">messages. Indeed its my third unanswered? message to this community.<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Sorry for the delay in my answers, please take into account that this<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">is a best effort support mailing list.<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">We try to use opennebula in our current project, but the focus of our<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">project is not to get software to do what it is used to do. Nevertheless we<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">are software developers and therefore we could also fix and extend the<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">openNebula project if there would be any support from you.<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">That is great news!! Could you please elaborate a bit on what is that<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">you intend to do with the software? We are happy to provide best<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">effort support.<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Best regards,<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">-Tino<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Kind regards,<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Stefan<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Am 26.01.2010 um 21:41 schrieb Stefan Reichel:<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Hi OpenNebula team,<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">our developer team tried to use OpenNebula and now we are able to start vms<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">in VMWare. But we have a serious problem. Every VM we start stays in the<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">"boot" state. What is the reason for that, where ca we gather more<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">information about the problem? We use OpenNebula 1.4 / SVN version on Ubuntu<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">9.10 in combination with VMWare Server 2. Any help would be appreciated.<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Sincerely<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Stefan<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">_______________________________________________<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Users mailing list<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><a href="mailto:Users@lists.opennebula.org">Users@lists.opennebula.org</a><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><a href="http://lists.opennebula.org/listinfo.cgi/users-opennebula.org">http://lists.opennebula.org/listinfo.cgi/users-opennebula.org</a><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">--<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Constantino Vázquez, Grid & Virtualization Technology<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Engineer/Researcher: <a href="http://www.dsa-research.org/tinova">http://www.dsa-research.org/tinova</a><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">DSA Research Group: <a href="http://dsa-research.org">http://dsa-research.org</a><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Globus GridWay Metascheduler: <a href="http://www.GridWay.org">http://www.GridWay.org</a><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">OpenNebula Virtual Infrastructure Engine: <a href="http://www.OpenNebula.org">http://www.OpenNebula.org</a><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">_____________________________________<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Stefan Reichel, M.Sc. Candidate<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Hasso-Plattner-Institut für Softwaresystemtechnik GmbH<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Postfach 900460, D-14440 Potsdam, Germany<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><a href="http://www.hpi.uni-potsdam.de">http://www.hpi.uni-potsdam.de</a><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Telefon: 03322/206306 Mobile: 0178/5495023<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Email: <a href="mailto:stefan.reichel@student.hpi.uni-potsdam.de">stefan.reichel@student.hpi.uni-potsdam.de</a><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">_____________________________________<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">_____________________________________<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Stefan Reichel, M.Sc. Candidate<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Hasso-Plattner-Institut für Softwaresystemtechnik GmbH<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Postfach 900460, D-14440 Potsdam, Germany<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><a href="http://www.hpi.uni-potsdam.de">http://www.hpi.uni-potsdam.de</a><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Telefon: 03322/206306 Mobile: 0178/5495023<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Email: <a href="mailto:stefan.reichel@student.hpi.uni-potsdam.de">stefan.reichel@student.hpi.uni-potsdam.de</a><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">_____________________________________<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">_______________________________________________<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Users mailing list<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><a href="mailto:Users@lists.opennebula.org">Users@lists.opennebula.org</a><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><a href="http://lists.opennebula.org/listinfo.cgi/users-opennebula.org">http://lists.opennebula.org/listinfo.cgi/users-opennebula.org</a><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">_____________________________________<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Stefan Reichel, M.Sc. Candidate<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Hasso-Plattner-Institut für Softwaresystemtechnik GmbH<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Postfach 900460, D-14440 Potsdam, Germany<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><a href="http://www.hpi.uni-potsdam.de">http://www.hpi.uni-potsdam.de</a><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Telefon: 03322/206306 Mobile: 0178/5495023<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Email: <a href="mailto:stefan.reichel@student.hpi.uni-potsdam.de">stefan.reichel@student.hpi.uni-potsdam.de</a><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">_____________________________________<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">_____________________________________<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Stefan Reichel, M.Sc. Candidate<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Hasso-Plattner-Institut für Softwaresystemtechnik GmbH<br></blockquote><blockquote type="cite">Postfach 900460, D-14440 Potsdam, Germany<br></blockquote><blockquote type="cite"><a href="http://www.hpi.uni-potsdam.de">http://www.hpi.uni-potsdam.de</a><br></blockquote><blockquote type="cite">Telefon: 03322/206306 Mobile: 0178/5495023<br></blockquote><blockquote type="cite">Email: <a href="mailto:stefan.reichel@student.hpi.uni-potsdam.de">stefan.reichel@student.hpi.uni-potsdam.de</a><br></blockquote><blockquote type="cite">_____________________________________<br></blockquote><blockquote type="cite"><br></blockquote></div></blockquote></div><br><div>
<div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-size: medium; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; "><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-size: medium; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; "><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-size: medium; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; "><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-size: medium; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; "><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">_____________________________________<br><br><b>Stefan Reichel, M.Sc.</b><font class="Apple-style-span" size="3"><span class="Apple-style-span" style="font-size: 12px; "><b> Candidate</b></span></font><br><br><font class="Apple-style-span" size="2"><span class="Apple-style-span" style="font-size: 10px; ">Hasso-Plattner-Institut für Softwaresystemtechnik GmbH <br></span></font><div><font class="Apple-style-span" size="2"><span class="Apple-style-span" style="font-size: 10px; ">Postfach 900460, D-14440 Potsdam, Germany </span></font></div><div><font class="Apple-style-span" size="2"><span class="Apple-style-span" style="font-size: 10px; "><a href="http://www.hpi.uni-potsdam.de">http://www.hpi.uni-potsdam.de</a></span></font></div><div><font class="Apple-style-span" size="2"><span class="Apple-style-span" style="font-size: 10px; "><br></span></font></div><div><b><font class="Apple-style-span" size="2"><span class="Apple-style-span" style="font-size: 10px; ">Telefon:</span></font></b><font class="Apple-style-span" size="2"><span class="Apple-style-span" style="font-size: 10px; "> 03322/206306 </span></font><b><font class="Apple-style-span" size="2"><span class="Apple-style-span" style="font-size: 10px; ">Mobile:</span></font></b><font class="Apple-style-span" size="2"><span class="Apple-style-span" style="font-size: 10px; "> 0178/5495023 <br></span></font><b><font class="Apple-style-span" size="2"><span class="Apple-style-span" style="font-size: 10px; ">Email:</span></font></b><font class="Apple-style-span" size="2"><span class="Apple-style-span" style="font-size: 10px; "> <a href="mailto:stefan.reichel@student.hpi.uni-potsdam.de">stefan.reichel@student.hpi.uni-potsdam.de</a></span></font><br>_____________________________________</div></div></span></div></span></div></span></div></span></div>
</div>
<br></body></html>