[one-users] OpenNebula 3.8.3 and VMWare ESXi 5.0: internal error HTTP response code 403 for upload
chenxiang at aquala-tech.com
chenxiang at aquala-tech.com
Mon Apr 22 23:54:10 PDT 2013
Now I am able to get VM's running with ESXi nodes. I would like to share
what I did to make things work, and would like you guys to help me
further.
>From Marketplace I imported the ttylinux-vmware image to local
infrastructure. When the images becomes READY, login to the front end
server and browse to var/datastores/1 and further browse to the directory
holding that particular image. Below was what I had when things did not
work:
oneadmin at opennebula:~/var/datastores/1/10fc21f21a452add3838d76d63052457$
ls -l
total 104864
-rw------- 1 oneadmin cloud 107374080 Jul 3 2012 ttylinux-flat.vmdk
-rw------- 1 oneadmin cloud 509 Jul 3 2012 ttylinux.vmdk
Base on the error message I got from VM log, I decided to copy
ttylinux.vmdk to disk.vmdk. So I did that and then I had the following:
oneadmin at opennebula:~/var/datastores/1/10fc21f21a452add3838d76d63052457$
cp ttylinux.vmdk disk.vmdk
oneadmin at opennebula:~/var/datastores/1/10fc21f21a452add3838d76d63052457$
ls -l
total 104868
-rw------- 1 oneadmin cloud 509 Apr 23 14:33 disk.vmdk
-rw------- 1 oneadmin cloud 107374080 Jul 3 2012 ttylinux-flat.vmdk
-rw------- 1 oneadmin cloud 509 Jul 3 2012 ttylinux.vmdk
Now I went back to the same template, and instantiated a VM instance, now
it worked.
Now I have a new problem. This front-end has been tested for KVM with
hundreds of VM instances before I tried ESXi. Now I am trying VM-ID above
100. Now the VM instances were running, but I was not able to connect to
the VM console via VNC from SunStone. What should I do? (VM Console in
vSphere Client still works.)
Thanks a lot for your assistance.
Chen Xiang
> With the proper NFS settings, I was able to define the domain, but fail to
> create the VM. The error message says "File [0] 120/disk.0/disk.vmdk was
> not found".
>
> I login to the ESXi box, and verified that I do have /vmfs/volumes/0
> pointing to the right NFS mount. And inside /vmfs/volumes/0 I do have
> 120/disk.0/disk.vmdk .
>
> Any ideas?
>
> Below is a copy of the VM log.
>
> Tue Apr 23 13:12:58 2013 [DiM][I]: New VM state is ACTIVE.
> Tue Apr 23 13:12:58 2013 [LCM][I]: New VM state is PROLOG.
> Tue Apr 23 13:12:58 2013 [VM][I]: Virtual Machine has no context
> Tue Apr 23 13:13:12 2013 [TM][I]: clone: Cloning
> /vmfs/volumes/1/10fc21f21a452add3838d76d63052457 in
> vmware02:/vmfs/volumes/0/120/disk.0
> Tue Apr 23 13:13:12 2013 [TM][I]: ExitCode: 0
> Tue Apr 23 13:13:12 2013 [LCM][I]: New VM state is BOOT
> Tue Apr 23 13:13:12 2013 [VMM][I]: Generating deployment file:
> /srv/cloud/one/var/vms/120/deployment.0
> Tue Apr 23 13:13:12 2013 [VMM][I]: ExitCode: 0
> Tue Apr 23 13:13:12 2013 [VMM][I]: Successfully execute network driver
> operation: pre.
> Tue Apr 23 13:13:24 2013 [VMM][I]: Command execution fail:
> /srv/cloud/one/var/remotes/vmm/vmware/deploy
> /srv/cloud/one/var/vms/120/deployment.0 vmware02 120 vmware02
> Tue Apr 23 13:13:24 2013 [VMM][D]: deploy: Successfully defined domain
> one-120.
> Tue Apr 23 13:13:24 2013 [VMM][E]: deploy: Error executing: virsh -c
> 'esx://vmware02/?no_verify=1&auto_answer=1' start one-120 err: ExitCode: 1
> Tue Apr 23 13:13:24 2013 [VMM][I]: out:
> Tue Apr 23 13:13:24 2013 [VMM][I]: error: Failed to start domain one-120
> Tue Apr 23 13:13:24 2013 [VMM][I]: error: internal error Could not start
> domain: FileNotFound - File [0] 120/disk.0/disk.vmdk was not found
> Tue Apr 23 13:13:24 2013 [VMM][I]:
> Tue Apr 23 13:13:24 2013 [VMM][I]: ExitCode: 1
> Tue Apr 23 13:13:24 2013 [VMM][I]: Failed to execute virtualization driver
> operation: deploy.
> Tue Apr 23 13:13:24 2013 [VMM][E]: Error deploying virtual machine
> Tue Apr 23 13:13:24 2013 [DiM][I]: New VM state is FAILED
>
>
>
> Chen Xiang
>
>> Hi,
>>
>> Please use root_squash instead of no_root_squash
>>
>> --
>> /srv/cloud/one/var/datastores/0
>> *(rw,sync,no_subtree_check,no_root_squash,anonuid=10000,anongid=10000)
>> /srv/cloud/one/var/datastores/1
>> *(rw,sync,no_subtree_check,no_root_squash,anonuid=10000,anongid=10000)
>> --
>>
>> You will need to force the nfs server to re-read the conf file.
>>
>> Regards,
>>
>> -Tino
>> --
>> Constantino Vázquez Blanco, PhD, MSc
>> Project Engineer
>> OpenNebula - The Open-Source Solution for Data Center Virtualization
>> www.OpenNebula.org | @tinova79 | @OpenNebula
>>
>>
>> On Mon, Apr 22, 2013 at 3:46 PM, <chenxiang at aquala-tech.com> wrote:
>>> Here is what I got when trying to define the VM via virsh:
>>>
>>> oneadmin at opennebula:~/images$ virsh -c
>>> 'esx://vmware02/?no_verify=1&auto_answer=1'
>>> Enter username for vmware02 [root]:
>>> Enter root's password for vmware02:
>>> Welcome to virsh, the virtualization interactive terminal.
>>>
>>> Type: 'help' for help with commands
>>> 'quit' to quit
>>>
>>> virsh # define /srv/cloud/one/var/vms/111/deployment.0
>>> 2013-04-22 13:24:49.391+0000: 17332: info : libvirt version: 0.9.10
>>> 2013-04-22 13:24:49.391+0000: 17332: warning : virVMXFormatVNC:3224 :
>>> VNC
>>> port 6011 it out of [5900..5964] range
>>> error: Failed to define domain from
>>> /srv/cloud/one/var/vms/111/deployment.0
>>> error: internal error HTTP response code 403 for upload to
>>> 'https://vmware02:443/folder/111%2fdisk%2e0/one%2d111.vmx?dcPath=ha%2ddatacenter&dsName=0'
>>>
>>> virsh # exit
>>>
>>>
>>>
>>>
>>>
>>>> Hi,
>>>>
>>>> I am running OpenNebula 3.8.3 on Ubuntu 12.04 (front end) with VMWare
>>>> ESXi
>>>> 5.0 (node). I am able to create a VMWare node in SunStone, register
>>>> the
>>>> ttylinux images (ttylinux.vmdk.tar download from C12G.com), but failed
>>>> to
>>>> instantiate a VM.
>>>>
>>>> Here is what I have as the NFS exports:
>>>>
>>>> /srv/cloud/one/var/datastores/0
>>>> *(rw,sync,no_subtree_check,no_root_squash,anonuid=10000,anongid=10000)
>>>> /srv/cloud/one/var/datastores/1
>>>> *(rw,sync,no_subtree_check,no_root_squash,anonuid=10000,anongid=10000)
>>>>
>>>> One the ESXi node I mounted the NFS exports to /vmfs/volumes/0 and
>>>> /vmfs/volumes/1 respectively.
>>>>
>>>> Yes I configured libvirt-0.9.10 and make it worked with VMWare,
>>>> verified
>>>> by command lines such as the following command (where vmware02 is my
>>>> ESXi
>>>> hostname):
>>>>
>>>> virsh -c 'esx://vmware02/?no_verify=1&auto_answer=1'
>>>>
>>>> Below is my VM template:
>>>>
>>>> CPU="1"
>>>> DISK=[
>>>> IMAGE="tty_vmdk",
>>>> IMAGE_UNAME="oneadmin" ]
>>>> GRAPHICS=[
>>>> LISTEN="0.0.0.0",
>>>> TYPE="vnc" ]
>>>> MEMORY="512"
>>>> NAME="ttylinux"
>>>>
>>>> Below is what I got when trying to instantiate a VM:
>>>>
>>>>
>>>> Mon Apr 22 21:27:11 2013 [DiM][I]: New VM state is ACTIVE.
>>>> Mon Apr 22 21:27:11 2013 [LCM][I]: New VM state is PROLOG.
>>>> Mon Apr 22 21:27:11 2013 [VM][I]: Virtual Machine has no context
>>>> Mon Apr 22 21:27:17 2013 [TM][I]: clone: Cloning
>>>> /vmfs/volumes/1/43352fb75cee9bbc1da3c1e7ff474e26 in
>>>> vmware02:/vmfs/volumes/0/112/disk.0
>>>> Mon Apr 22 21:27:17 2013 [TM][I]: ExitCode: 0
>>>> Mon Apr 22 21:27:17 2013 [LCM][I]: New VM state is BOOT
>>>> Mon Apr 22 21:27:17 2013 [VMM][I]: Generating deployment file:
>>>> /srv/cloud/one/var/vms/112/deployment.0
>>>> Mon Apr 22 21:27:17 2013 [VMM][I]: ExitCode: 0
>>>> Mon Apr 22 21:27:17 2013 [VMM][I]: Successfully execute network driver
>>>> operation: pre.
>>>> Mon Apr 22 21:27:22 2013 [VMM][I]: Command execution fail:
>>>> /srv/cloud/one/var/remotes/vmm/vmware/deploy
>>>> /srv/cloud/one/var/vms/112/deployment.0 vmware02 112 vmware02
>>>> Mon Apr 22 21:27:22 2013 [VMM][E]: deploy: Error executing: virsh -c
>>>> 'esx://vmware02/?no_verify=1&auto_answer=1' define
>>>> /srv/cloud/one/var/vms/112/deployment.0 err: ExitCode: 1
>>>> Mon Apr 22 21:27:22 2013 [VMM][I]: out:
>>>> Mon Apr 22 21:27:22 2013 [VMM][I]: 2013-04-22 13:27:21.858+0000:
>>>> 17586:
>>>> info : libvirt version: 0.9.10
>>>> Mon Apr 22 21:27:22 2013 [VMM][I]: 2013-04-22 13:27:21.858+0000:
>>>> 17586:
>>>> warning : virVMXFormatVNC:3224 : VNC port 6012 it out of [5900..5964]
>>>> range
>>>> Mon Apr 22 21:27:22 2013 [VMM][I]: error: Failed to define domain from
>>>> /srv/cloud/one/var/vms/112/deployment.0
>>>> Mon Apr 22 21:27:22 2013 [VMM][I]: error: internal error HTTP response
>>>> code 403 for upload to
>>>> 'https://vmware02:443/folder/112%2fdisk%2e0/one%2d112.vmx?dcPath=ha%2ddatacenter&dsName=0'
>>>> Mon Apr 22 21:27:22 2013 [VMM][I]:
>>>> Mon Apr 22 21:27:22 2013 [VMM][I]: ExitCode: 255
>>>> Mon Apr 22 21:27:22 2013 [VMM][I]: Failed to execute virtualization
>>>> driver
>>>> operation: deploy.
>>>> Mon Apr 22 21:27:22 2013 [VMM][E]: Error deploying virtual machine
>>>> Mon Apr 22 21:27:22 2013 [DiM][I]: New VM state is FAILED
>>>>
>>>> What might be wrong? This looks like that I did not have write access
>>>> to
>>>> some place. So I tried both the oneadmin and root acount in
>>>> etc/vmwarerc,
>>>> with not much luck.
>>>>
>>>> On the front end the oneadmin user belongs to the following groups:
>>>> cloud,
>>>> adm, sudo, libvirtd.
>>>>
>>>> Best regards,
>>>>
>>>> Chen Xiang
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> _______________________________________________
>>>> Users mailing list
>>>> Users at lists.opennebula.org
>>>> http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
>>>>
>>>
>>> _______________________________________________
>>> Users mailing list
>>> Users at lists.opennebula.org
>>> http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
>>
>
> _______________________________________________
> Users mailing list
> Users at lists.opennebula.org
> http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
>
More information about the Users
mailing list