Hi Liu,<br>it seems that you have a problem with your configuration of libvirt in the nodes. For OpenNebula to be able to set up the tap interface the oneadmin user in the nodes must be able to connect to qemu:///system.<br>
<br>First of all, are you able to connect to qemu:///system as root (in the nodes)? If that's not the case you have a problem with your installation. Supposing that you can, please check that the following options are set in your libvirtd.conf:<br>
<br>unix_sock_group = "libvirtd"<br>unix_sock_rw_perms = "0770"<br><br>The sockets libvirt creates belong to unix_sock_group (which if unset defaults to 'root', therefore unwriteable by the rest of users).<br>
<br>You can find them here:<br><br>srwxrwx--- 1 root libvirtd 0 2009-10-15 20:20 /var/run/libvirt/libvirt-sock<br>srwxrwxrwx 1 root libvirtd 0 2009-10-15 20:20 /var/run/libvirt/libvirt-sock-ro<br><br>According to the above configuration, the oneadmin user should belong to group libvirtd to be able to read and write to the socket.<br>
<br>Hope this helps.<br><br>regards,<br>Jaime<br><br><div class="gmail_quote">On Thu, Oct 15, 2009 at 2:11 PM, Ruben S. Montero <span dir="ltr"><<a href="mailto:rubensm@dacya.ucm.es">rubensm@dacya.ucm.es</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">That only changes the live migration. Add something like:<br>
<br>
Line 88:<br>
command="-c qemu:///system create #{remote_deployment_file}"<br>
<br>
and the std_actions, Line 103, 107...<br>
<br>
std_action("SHUTDOWN", "-c qemu:///system shutdown #{args[3]}", args)<br>
<br>
<br>
Cheers<br>
<br>
On Thu, Oct 15, 2009 at 1:28 PM, Liu, Zhentao<br>
<div><div></div><div class="h5"><<a href="mailto:Zhentao.Liu@fokus-extern.fraunhofer.de">Zhentao.Liu@fokus-extern.fraunhofer.de</a>> wrote:<br>
> Hi,<br>
><br>
> I have changed the file "/usr/lib/one/mads/one_vmm_kvm.rb"<br>
><br>
> -----------------------------------------------------------------------------------------------<br>
> def action_migrate(args)<br>
> std_action("MIGRATE", "migrate --live #{args[3]}<br>
> qemu+tcp://#{args[4]}/session", args)<br>
> ----------------------------------------------------------------------------------------------<br>
><br>
> I have changed "session" to "system", and I also add "oneadmin" to libvirtd<br>
> group, but there is still the same error.<br>
><br>
> Other ideas?<br>
><br>
> Regards<br>
><br>
> Zhentao<br>
><br>
> -----Original Message-----<br>
> From: <a href="mailto:rsmontero@gmail.com">rsmontero@gmail.com</a> on behalf of Ruben S. Montero<br>
> Sent: Thu 10/15/2009 11:18 AM<br>
> To: Liu, Zhentao<br>
> Cc: Jaime Melis; <a href="mailto:users@lists.opennebula.org">users@lists.opennebula.org</a><br>
> Subject: Re: [one-users] Failed to create<br>
> domainfrom/var/lib/one//5/images/deployment.0<br>
><br>
> Hi,<br>
><br>
> The problem<br>
><br>
> "Failed to add tap interface 'vnet%d' to bridge 'br2' "<br>
><br>
> is because of libvirt not able to join the tap interface to br2. In<br>
> order to do so, the connection URI should be qemu:///system (and you<br>
> have to be in the libvirt group, also libvirt should be using socket<br>
> auth and not policy kit), it seems that your configuration is using<br>
> qemu:///session instead. You can add this to the virsh commands in<br>
> one_vmm_kvm.rb (virsh -c qemu:///system).<br>
><br>
> Beaware that in this case you also need a fix (already in trunk) to<br>
> make stop/resume and migration work.<br>
><br>
> Cheers<br>
><br>
> Ruben<br>
><br>
> On Thu, Oct 15, 2009 at 9:48 AM, Liu, Zhentao<br>
> <<a href="mailto:Zhentao.Liu@fokus-extern.fraunhofer.de">Zhentao.Liu@fokus-extern.fraunhofer.de</a>> wrote:<br>
>> Hello, Jaime<br>
>><br>
>> I have added both my user, root und oneadmin to the libvirtd group. But it<br>
>> still can't work.<br>
>> Have you other suggestions?<br>
>><br>
>><br>
>> -----------------------------------------------------------------------------------------------------------------------------------------------------<br>
>> root@taresian:/# id oneadmin<br>
>> uid=408(oneadmin) gid=65534(nogroup) Gruppen=65534(nogroup),0(root)<br>
>> root@taresian:/# id zli<br>
>> uid=823(zli) gid=1700(extern)<br>
>><br>
>> Gruppen=1700(extern),4(adm),20(dialout),24(cdrom),46(plugdev),106(lpadmin),121(admin),122(sambashare),125(libvirtd)<br>
>> root@taresian:/# id root<br>
>> uid=0(root) gid=0(root)<br>
>> Gruppen=0(root),124(kvm),125(libvirtd),129(vde2-net),1002(tun)<br>
>><br>
>> ------------------------------------------------------------------------------------------------------------------------------------------------------------<br>
>><br>
>> Regards<br>
>><br>
>> Zhentao<br>
>><br>
>><br>
>> -----Original Message-----<br>
>> From: <a href="mailto:users-bounces@lists.opennebula.org">users-bounces@lists.opennebula.org</a> on behalf of Jaime Melis<br>
>> Sent: Wed 10/14/2009 10:38 AM<br>
>> To: Liu, Zhentao<br>
>> Cc: <a href="mailto:users@lists.opennebula.org">users@lists.opennebula.org</a><br>
>> Subject: Re: [one-users] Failed to create<br>
>> domainfrom/var/lib/one//5/images/deployment.0<br>
>><br>
>> Hello,<br>
>><br>
>> It seems that the oneadmin user does not belong to group libvirtd. Try<br>
>> adding both your user account and oneadmin to this group.<br>
>><br>
>> Regards,<br>
>> Jaime<br>
>><br>
>> On Wed, Oct 14, 2009 at 10:32 AM, Liu, Zhentao <<br>
>> <a href="mailto:Zhentao.Liu@fokus-extern.fraunhofer.de">Zhentao.Liu@fokus-extern.fraunhofer.de</a>> wrote:<br>
>><br>
>>> Hello,<br>
>>><br>
>>> I have changed the disk partitions to sda, but it still doesn't work.<br>
>>> There<br>
>>> is still the same error.<br>
>>><br>
>>><br>
>>><br>
>>><br>
>>> --------------------------------------------------------------------------------------------------------------------------------------------------------<br>
>>><br>
>>> Tue Oct 13 17:43:18 2009 [VMM][D]: Message received: LOG - 7 error:<br>
>>> Failed<br>
>>> to create domain from /var/lib/one//7/images/deployment.0<br>
>>><br>
>>> Tue Oct 13 17:43:18 2009 [VMM][D]: Message received: LOG - 7 error:<br>
>>> internal error Failed to add tap interface 'vnet%d' to bridge 'br2' :<br>
>>> Permission denied<br>
>>><br>
>>> Tue Oct 13 17:43:18 2009 [VMM][D]: Message received: LOG - 7 ExitCode: 1<br>
>>><br>
>>> Tue Oct 13 17:43:18 2009 [VMM][D]: Message received: DEPLOY FAILURE 7<br>
>>> Failed to create domain from /var/lib/one//7/images/deployment.0<br>
>>><br>
>>><br>
>>><br>
>>> --------------------------------------------------------------------------------------------------------------------------------------------------------<br>
>>> ps: I have changed the interface to br2. This is my network<br>
>>> configuration.<br>
>>><br>
>>><br>
>>><br>
>>><br>
>>> ------------------------------------------------------------------------------<br>
>>><br>
>>> auto lo<br>
>>> iface lo inet loopback<br>
>>><br>
>>><br>
>>> auto eth2<br>
>>> iface eth2 inet manual<br>
>>><br>
>>> auto br2<br>
>>> iface br2 inet dhcp<br>
>>> bridge_ports eth2<br>
>>> bridge_stp off<br>
>>> bridge_fd 0<br>
>>> bridge_maxwait 0<br>
>>> metric 1<br>
>>><br>
>>> --------------------------------------------------------------------------<br>
>>><br>
>>> I can't run virsh correctly on the node. Maybe is it the problem?<br>
>>> -------------------------------------------------------------<br>
>>> root@forest:/var/run/libvirt# virsh -c qemu:///system list<br>
>>> error: unable to connect to '/var/run/libvirt/libvirt-sock': Connection<br>
>>> refused<br>
>>> error: failed to connect to the hypervisor<br>
>>><br>
>>> -------------------------------------------------------------<br>
>>><br>
>>> Any ideas?<br>
>>><br>
>>> Regards<br>
>>><br>
>>> Zhentao<br>
>>><br>
>>><br>
>>><br>
>>><br>
>>> -----Original Message-----<br>
>>> From: <a href="mailto:users-bounces@lists.opennebula.org">users-bounces@lists.opennebula.org</a> on behalf of Javier Fontan<br>
>>> Sent: Tue 10/13/2009 2:09 PM<br>
>>> To: Liu, Zhentao<br>
>>> Cc: <a href="mailto:users@lists.opennebula.org">users@lists.opennebula.org</a><br>
>>> Subject: Re: [one-users] Failed to create domain<br>
>>> from/var/lib/one//5/images/deployment.0<br>
>>><br>
>>> Hello,<br>
>>><br>
>>> kvm is unable to bind images to disk partitions, that is, sda1. You<br>
>>> only can bind the image to a full disk device, for example sda.<br>
>>><br>
>>> Bye<br>
>>><br>
>>> On Tue, Oct 13, 2009 at 1:48 PM, Liu, Zhentao<br>
>>> <<a href="mailto:Zhentao.Liu@fokus-extern.fraunhofer.de">Zhentao.Liu@fokus-extern.fraunhofer.de</a>> wrote:<br>
>>> > Hello,<br>
>>> ><br>
>>> > I have deployed a vm into my node, but the vm dosen't work. It has this<br>
>>> > error:<br>
>>> ><br>
>>> > oned.log<br>
>>> ><br>
>>><br>
>>><br>
>>> ------------------------------------------------------------------------------------------------<br>
>>> > Tue Oct 13 12:45:31 2009 [TM][D]: Message received: LOG - 5<br>
>>> > tm_clone.sh:<br>
>>> > taresian:/boot/euca-debian-5.0-x86_64/debian.5-0.x86-64.img<br>
>>> > 193.175.134.144:/var/lib/one//5/images/disk.0<br>
>>> ><br>
>>> > Tue Oct 13 12:45:31 2009 [TM][D]: Message received: LOG - 5<br>
>>> > tm_clone.sh:<br>
>>> > DST: /var/lib/one//5/images/disk.0<br>
>>> ><br>
>>> > Tue Oct 13 12:45:31 2009 [TM][D]: Message received: LOG - 5<br>
>>> > tm_clone.sh:<br>
>>> > Creating directory /var/lib/one//5/images<br>
>>> ><br>
>>> > Tue Oct 13 12:46:10 2009 [VMM][I]: --Mark--<br>
>>> > Tue Oct 13 12:46:26 2009 [TM][D]: Message received: LOG - 5<br>
>>> > tm_clone.sh:<br>
>>> > Executed "ssh 193.175.134.144 mkdir -p /var/lib/one//5/images".<br>
>>> ><br>
>>> > Tue Oct 13 12:46:26 2009 [TM][D]: Message received: LOG - 5<br>
>>> > tm_clone.sh:<br>
>>> > Cloning taresian:/boot/euca-debian-5.0-x86_64/debian.5-0.x86-64.img<br>
>>> ><br>
>>> > Tue Oct 13 12:46:28 2009 [InM][D]: Host 4 successfully monitored.<br>
>>> > Tue Oct 13 12:46:42 2009 [InM][I]: --Mark--<br>
>>> > Tue Oct 13 12:46:42 2009 [InM][I]: Monitoring host 193.175.134.144 (4)<br>
>>> > Tue Oct 13 12:48:51 2009 [TM][D]: Message received: LOG - 5<br>
>>> > tm_clone.sh:<br>
>>> > Executed "scp<br>
>>> > taresian:/boot/euca-debian-5.0-x86_64/debian.5-0.x86-64.img<br>
>>> > 193.175.134.144:/var/lib/one//5/images/disk.0".<br>
>>> ><br>
>>> > Tue Oct 13 12:49:18 2009 [InM][D]: Host 4 successfully monitored.<br>
>>> > Tue Oct 13 12:49:38 2009 [InM][I]: Monitoring host 193.175.134.144 (4)<br>
>>> > Tue Oct 13 12:49:41 2009 [TM][D]: Message received: LOG - 5<br>
>>> > tm_clone.sh:<br>
>>> > Executed "ssh 193.175.134.144 chmod a+w /var/lib/one//5/images/disk.0".<br>
>>> ><br>
>>> > Tue Oct 13 12:49:41 2009 [TM][D]: Message received: LOG - 5<br>
>>> > tm_mkswap.sh:<br>
>>> > Creating 1024Mb image in /var/lib/one//5/images/disk.1<br>
>>> ><br>
>>> > Tue Oct 13 12:50:31 2009 [TM][D]: Message received: LOG - 5<br>
>>> > tm_mkswap.sh:<br>
>>> > Executed "ssh 193.175.134.144 mkdir -p /var/lib/one//5/images".<br>
>>> ><br>
>>> > Tue Oct 13 12:51:21 2009 [TM][D]: Message received: LOG - 5<br>
>>> > tm_mkswap.sh:<br>
>>> > Executed "ssh 193.175.134.144 dd if=/dev/zero<br>
>>> > of=/var/lib/one//5/images/disk.1 bs=1 count=1 seek=1024M".<br>
>>> ><br>
>>> > Tue Oct 13 12:51:21 2009 [TM][D]: Message received: LOG - 5<br>
>>> > tm_mkswap.sh:<br>
>>> > Initializing swap space<br>
>>> ><br>
>>> > Tue Oct 13 12:52:15 2009 [TM][D]: Message received: LOG - 5<br>
>>> > tm_mkswap.sh:<br>
>>> > Executed "ssh 193.175.134.144 /sbin/mkswap<br>
>>> /var/lib/one//5/images/disk.1".<br>
>>> ><br>
>>> > Tue Oct 13 12:53:08 2009 [TM][D]: Message received: LOG - 5<br>
>>> > tm_mkswap.sh:<br>
>>> > Executed "ssh 193.175.134.144 chmod a+w /var/lib/one//5/images/disk.1".<br>
>>> ><br>
>>> > Tue Oct 13 12:53:08 2009 [TM][D]: Message received: TRANSFER SUCCESS 5<br>
>>> > -<br>
>>> ><br>
>>> > Tue Oct 13 12:53:08 2009 [VMM][D]: Message received: LOG - 5 Command:<br>
>>> > scp<br>
>>> > /var/lib/one/5/deployment.0<br>
>>> > 193.175.134.144:/var/lib/one//5/images/deployment.0<br>
>>> ><br>
>>> > Tue Oct 13 12:53:58 2009 [VMM][D]: Message received: LOG - 5 Copy<br>
>>> > success<br>
>>> ><br>
>>> > Tue Oct 13 12:54:51 2009 [VMM][D]: Message received: LOG - 5 error:<br>
>>> Failed<br>
>>> > to create domain from /var/lib/one//5/images/deployment.0<br>
>>> ><br>
>>> > Tue Oct 13 12:54:51 2009 [VMM][D]: Message received: LOG - 5 error:<br>
>>> internal<br>
>>> > error unsupported disk type 'sda1'<br>
>>> ><br>
>>> > Tue Oct 13 12:54:51 2009 [VMM][D]: Message received: LOG - 5 ExitCode:<br>
>>> > 1<br>
>>> ><br>
>>> > Tue Oct 13 12:54:51 2009 [VMM][D]: Message received: DEPLOY FAILURE 5<br>
>>> Failed<br>
>>> > to create domain from /var/lib/one//5/images/deployment.0<br>
>>> ><br>
>>><br>
>>><br>
>>> --------------------------------------------------------------------------------------------------------------------------------------------<br>
>>> ><br>
>>> > deployment.0<br>
>>> ><br>
>>> ><br>
>>><br>
>>><br>
>>> -----------------------------------------------------------------------------------------<br>
>>> ><br>
>>> > <domain type='kvm'><br>
>>> > <name>one-5</name><br>
>>> > <vcpu>1</vcpu><br>
>>> > <memory>131072</memory><br>
>>> > <os><br>
>>> > <type>hvm</type><br>
>>> ><br>
>>> ><br>
>>><br>
>>><br>
>>> <kernel>/boot/euca-ubuntu-9.04-x86_64/kvm-kernel/vmlinuz-2.6.28-11-generic</kernel><br>
>>> ><br>
>>> ><br>
>>><br>
>>><br>
>>> <initrd>/boot/euca-ubuntu-9.04-x86_64/kvm-kernel/initrd.img-2.6.28-11-generic</initrd><br>
>>> > <cmdline>root=/dev/sda1 </cmdline><br>
>>> > <boot dev='hd'/><br>
>>> > </os><br>
>>> > <devices><br>
>>> > <emulator>/usr/bin/kvm</emulator><br>
>>> > <disk type='file' device='disk'><br>
>>> > <source file='/var/lib/one//5/images/disk.0'/><br>
>>> > <target dev='sda1'/><br>
>>> > </disk><br>
>>> > <disk type='file' device='disk'><br>
>>> > <source file='/var/lib/one//5/images/disk.1'/><br>
>>> > <target dev='sdb'/><br>
>>> > </disk><br>
>>> > <interface type='bridge'><br>
>>> > <source bridge='eth0'/><br>
>>> > <mac address='00:16:0a:00:01:01'/><br>
>>> > </interface><br>
>>> > </devices><br>
>>> > <features><br>
>>> > <acpi/><br>
>>> > </features><br>
>>> > </domain><br>
>>> ><br>
>>><br>
>>><br>
>>> -------------------------------------------------------------------------------------------------<br>
>>> ><br>
>>> > Otherwise there is also a error, when I run "virsh" on the node:<br>
>>> ><br>
>>> ><br>
>>><br>
>>><br>
>>> ----------------------------------------------------------------------------<br>
>>> > $ virsh -c qemu:///system list<br>
>>> > error: unable to connect to '/var/run/libvirt/libvirt-sock': Permission<br>
>>> > denied<br>
>>> > error: failed to connect to the hypervisor<br>
>>> ><br>
>>> ><br>
>>> > -------------------------------------------------------------------------<br>
>>> ><br>
>>> > Is the error "Failed to create domain from<br>
>>> > /var/lib/one//5/images/deployment.0" caused by wrong "virsh"?<br>
>>> ><br>
>>> > Any helps?<br>
>>> ><br>
>>> > Regards<br>
>>> ><br>
>>> > Zhentao<br>
>>> ><br>
>>> ><br>
>>> > _______________________________________________<br>
>>> > Users mailing list<br>
>>> > <a href="mailto:Users@lists.opennebula.org">Users@lists.opennebula.org</a><br>
>>> > <a href="http://lists.opennebula.org/listinfo.cgi/users-opennebula.org" target="_blank">http://lists.opennebula.org/listinfo.cgi/users-opennebula.org</a><br>
>>> ><br>
>>> ><br>
>>><br>
>>><br>
>>><br>
>>> --<br>
>>> Javier Fontan, Grid & Virtualization Technology Engineer/Researcher<br>
>>> DSA Research Group: <a href="http://dsa-research.org" target="_blank">http://dsa-research.org</a><br>
>>> Globus GridWay Metascheduler: <a href="http://www.GridWay.org" target="_blank">http://www.GridWay.org</a><br>
>>> OpenNebula Virtual Infrastructure Engine: <a href="http://www.OpenNebula.org" target="_blank">http://www.OpenNebula.org</a><br>
>>> _______________________________________________<br>
>>> Users mailing list<br>
>>> <a href="mailto:Users@lists.opennebula.org">Users@lists.opennebula.org</a><br>
>>> <a href="http://lists.opennebula.org/listinfo.cgi/users-opennebula.org" target="_blank">http://lists.opennebula.org/listinfo.cgi/users-opennebula.org</a><br>
>>><br>
>>><br>
>>> _______________________________________________<br>
>>> Users mailing list<br>
>>> <a href="mailto:Users@lists.opennebula.org">Users@lists.opennebula.org</a><br>
>>> <a href="http://lists.opennebula.org/listinfo.cgi/users-opennebula.org" target="_blank">http://lists.opennebula.org/listinfo.cgi/users-opennebula.org</a><br>
>>><br>
>>><br>
>><br>
>><br>
>> _______________________________________________<br>
>> Users mailing list<br>
>> <a href="mailto:Users@lists.opennebula.org">Users@lists.opennebula.org</a><br>
>> <a href="http://lists.opennebula.org/listinfo.cgi/users-opennebula.org" target="_blank">http://lists.opennebula.org/listinfo.cgi/users-opennebula.org</a><br>
>><br>
>><br>
><br>
><br>
><br>
> --<br>
> +---------------------------------------------------------------+<br>
> Dr. Ruben Santiago Montero<br>
> Associate Professor<br>
> Distributed System Architecture Group (<a href="http://dsa-research.org" target="_blank">http://dsa-research.org</a>)<br>
><br>
> URL: <a href="http://dsa-research.org/doku.php?id=people:ruben" target="_blank">http://dsa-research.org/doku.php?id=people:ruben</a><br>
> Weblog: <a href="http://blog.dsa-research.org/?author=7" target="_blank">http://blog.dsa-research.org/?author=7</a><br>
><br>
> GridWay, <a href="http://www.gridway.org" target="_blank">http://www.gridway.org</a><br>
> OpenNebula, <a href="http://www.opennebula.org" target="_blank">http://www.opennebula.org</a><br>
> +---------------------------------------------------------------+<br>
><br>
><br>
<br>
<br>
<br>
</div></div>--<br>
<div><div></div><div class="h5">+---------------------------------------------------------------+<br>
Dr. Ruben Santiago Montero<br>
Associate Professor<br>
Distributed System Architecture Group (<a href="http://dsa-research.org" target="_blank">http://dsa-research.org</a>)<br>
<br>
URL: <a href="http://dsa-research.org/doku.php?id=people:ruben" target="_blank">http://dsa-research.org/doku.php?id=people:ruben</a><br>
Weblog: <a href="http://blog.dsa-research.org/?author=7" target="_blank">http://blog.dsa-research.org/?author=7</a><br>
<br>
GridWay, <a href="http://www.gridway.org" target="_blank">http://www.gridway.org</a><br>
OpenNebula, <a href="http://www.opennebula.org" target="_blank">http://www.opennebula.org</a><br>
+---------------------------------------------------------------+<br>
</div></div></blockquote></div><br>