[one-users] VMFS datastore image creation issue
Tino Vazquez
cvazquez at c12g.com
Mon Jul 8 07:20:01 PDT 2013
Hi Michael,
The relevant process here is oned, not sunstone. The log is showing
that the 'vifs' tool is trying to do SSL checks with the ESX server,
and failing at that:
--
Mon Jul 8 06:34:40 2013 [ImG][D]: Message received: LOG E 9 cp:
Command "vifs --server 192.168.250.38 --username oneadmin --password
XXXXXXX --mkdir [1]3082ff704119400bcd206bb0d4d5b725" failed: S
erver version unavailable at
'https://192.168.250.38:443/sdk/vimService.wsdl' at
/usr/share/perl/5.14/VMware/VICommon.pm line 546.
--
What happens if you follow the following process:
* one stop
* sunstone-server stop
* export PERL_LWP_SSL_VERIFY_HOSTNAME=0
* one start
* sunstone-server start
* try to create an OS image again
* try to create a DATABLOCK again
Regards,
-Tino
--
Constantino Vázquez Blanco, PhD, MSc
C12G Labs - OpenNebula for the Enterprise
www.c12g.com | cvazquez at c12g.com | @C12G
--
Confidentiality Warning: The information contained in this e-mail and
any accompanying documents, unless otherwise expressly indicated, is
confidential and privileged, and is intended solely for the person
and/or entity to whom it is addressed (i.e. those identified in the
"To" and "cc" box). They are the property of C12G Labs S.L..
Unauthorized distribution, review, use, disclosure, or copying of this
communication, or any part thereof, is strictly prohibited and may be
unlawful. If you have received this e-mail in error, please notify us
immediately by e-mail at abuse at c12g.com and delete the e-mail and
attachments and any copy from your system. C12G thanks you for your
cooperation.
On Mon, Jul 8, 2013 at 4:15 PM, Michael Curran
<michael.curran at connectsolutions.com> wrote:
> Mon Jul 8 06:34:39 2013 [ImM][I]: Copying /var/tmp/sunstone-upload20130708-1204-q5ygx7-0 to repository for image 9
> Mon Jul 8 06:34:39 2013 [ReM][D]: Req:8384 UID:0 ImageAllocate result SUCCESS, 9
> Mon Jul 8 06:34:39 2013 [ReM][D]: Req:2768 UID:0 ImageInfo invoked, 9
> Mon Jul 8 06:34:39 2013 [ReM][D]: Req:2768 UID:0 ImageInfo result SUCCESS, "<IMAGE><ID>9</ID><UI..."
> Mon Jul 8 06:34:40 2013 [ImG][D]: Message received: LOG I 9 Command execution fail: /var/lib/one/remotes/datastore/vmfs/cp PERTX0RSSVZFUl9BQ1RJT05fREFUQT48SU1BR0U+PElEPjk8L0lEPjxVSUQ+MDwvVUlEPjxHS
> UQ+MDwvR0lEPjxVTkFNRT5vbmVhZG1pbjwvVU5BTUU+PEdOQU1FPm9uZWFkbWluPC9HTkFNRT48TkFNRT5XaW5kb3dzLVZhbmlsbGE8L05BTUU+PFBFUk1JU1NJT05TPjxPV05FUl9VPjE8L09XTkVSX1U+PE9XTkVSX00+MTwvT1dORVJfTT48T1dORVJfQT4wPC
> 9PV05FUl9BPjxHUk9VUF9VPjA8L0dST1VQX1U+PEdST1VQX00+MDwvR1JPVVBfTT48R1JPVVBfQT4wPC9HUk9VUF9BPjxPVEhFUl9VPjA8L09USEVSX1U+PE9USEVSX00+MDwvT1RIRVJfTT48T1RIRVJfQT4wPC9PVEhFUl9BPjwvUEVSTUlTU0lPTlM+PFRZUEU
> +MDwvVFlQRT48RElTS19UWVBFPjA8L0RJU0tfVFlQRT48UEVSU0lTVEVOVD4wPC9QRVJTSVNURU5UPjxSRUdUSU1FPjEzNzMyOTA0Nzk8L1JFR1RJTUU+PFNPVVJDRT48L1NPVVJDRT48UEFUSD4vdmFyL3RtcC9zdW5zdG9uZS11cGxvYWQyMDEzMDcwOC0xMjA0
> LXE1eWd4Ny0wPC9QQVRIPjxGU1RZUEU+PC9GU1RZUEU+PFNJWkU+MTwvU0laRT48U1RBVEU+NDwvU1RBVEU+PFJVTk5JTkdfVk1TPjA8L1JVTk5JTkdfVk1TPjxDTE9OSU5HX09QUz4wPC9DTE9OSU5HX09QUz48Q0xPTklOR19JRD4tMTwvQ0xPTklOR19JRD48R
> EFUQVNUT1JFX0lEPjE8L0RBVEFTVE9SRV9JRD48REFUQVNUT1JFPmRlZmF1bHQ8L0RBVEFTVE9SRT48Vk1TPjwvVk1TPjxDTE9ORVM+PC9DTE9ORVM+PFRFTVBMQVRFPjxERVZfUFJFRklYPjwhW0NEQVRBW2hkXV0+PC9ERVZfUFJFRklYPjwvVEVNUExBVEU+PC
> 9JTUFHRT48REFUQVNUT1JFPjxJRD4xPC9JRD48VUlEPjA8L1VJRD48R0lEPjA8L0dJRD48VU5BTUU+b25lYWRtaW48L1VOQU1FPjxHTkFNRT5vbmVhZG1pbjwvR05BTUU+PE5BTUU+ZGVmYXVsdDwvTkFNRT48UEVSTUlTU0lPTlM+PE9XTkVSX1U+MTwvT1dORVJ
> fVT48T1dORVJfTT4xPC9PV05FUl9NPjxPV05FUl9BPjA8L09XTkVSX0E+PEdST1VQX1U+MTwvR1JPVVBfVT48R1JPVVBfTT4wPC9HUk9VUF9NPjxHUk9VUF9BPjA8L0dST1VQX0E+PE9USEVSX1U+MTwvT1RIRVJfVT48T1RIRVJfTT4wPC9PVEhFUl9NPjxPVEhF
> Ul9BPjA8L09USEVSX0E+PC9QRVJNSVNTSU9OUz48RFNfTUFEPnZtZnM8L0RTX01BRD48VE1fTUFEPnZtZnM8L1RNX01BRD48QkFTRV9QQVRIPi92YXIvbGliL29uZS9kYXRhc3RvcmVzLzE8L0JBU0VfUEFUSD48VFlQRT4wPC9UWVBFPjxESVNLX1RZUEU+MDwvR
> ElTS19UWVBFPjxDTFVTVEVSX0lEPi0xPC9DTFVTVEVSX0lEPjxDTFVTVEVSPjwvQ0xVU1RFUj48SU1BR0VTPjxJRD4wPC9JRD48SUQ+ODwvSUQ+PC9JTUFHRVM+PFRFTVBMQVRFPjxCUklER0VfTElTVD48IVtDREFUQVsxOTIuMTY4LjI1MC4zNCAxOTIuMTY4Lj
> I1MC4zOF1dPjwvQlJJREdFX0xJU1Q+PERTX01BRD48IVtDREFUQVt2bWZzXV0+PC9EU19NQUQ+PFRNX01BRD48IVtDREFUQVt2bWZzXV0+PC9UTV9NQUQ+PFRZUEU+PCFbQ0RBVEFbSU1BR0VfRFNdXT48L1RZUEU+PC9URU1QTEFURT48L0RBVEFTVE9SRT48L0R
> TX0RSSVZFUl9BQ1RJT05fREFUQT4= 9
>
> Mon Jul 8 06:34:40 2013 [ImM][I]: Command execution fail: /var/lib/one/remotes/datastore/vmfs/cp PERTX0RSSVZFUl9BQ1RJT05fREFUQT48SU1BR0U+PElEPjk8L0lEPjxVSUQ+MDwvVUlEPjxHSUQ+MDwvR0lEPjxVTkFNRT5vbmV
> hZG1pbjwvVU5BTUU+PEdOQU1FPm9uZWFkbWluPC9HTkFNRT48TkFNRT5XaW5kb3dzLVZhbmlsbGE8L05BTUU+PFBFUk1JU1NJT05TPjxPV05FUl9VPjE8L09XTkVSX1U+PE9XTkVSX00+MTwvT1dORVJfTT48T1dORVJfQT4wPC9PV05FUl9BPjxHUk9VUF9VPjA8
> L0dST1VQX1U+PEdST1VQX00+MDwvR1JPVVBfTT48R1JPVVBfQT4wPC9HUk9VUF9BPjxPVEhFUl9VPjA8L09USEVSX1U+PE9USEVSX00+MDwvT1RIRVJfTT48T1RIRVJfQT4wPC9PVEhFUl9BPjwvUEVSTUlTU0lPTlM+PFRZUEU+MDwvVFlQRT48RElTS19UWVBFP
> jA8L0RJU0tfVFlQRT48UEVSU0lTVEVOVD4wPC9QRVJTSVNURU5UPjxSRUdUSU1FPjEzNzMyOTA0Nzk8L1JFR1RJTUU+PFNPVVJDRT48L1NPVVJDRT48UEFUSD4vdmFyL3RtcC9zdW5zdG9uZS11cGxvYWQyMDEzMDcwOC0xMjA0LXE1eWd4Ny0wPC9QQVRIPjxGU1
> RZUEU+PC9GU1RZUEU+PFNJWkU+MTwvU0laRT48U1RBVEU+NDwvU1RBVEU+PFJVTk5JTkdfVk1TPjA8L1JVTk5JTkdfVk1TPjxDTE9OSU5HX09QUz4wPC9DTE9OSU5HX09QUz48Q0xPTklOR19JRD4tMTwvQ0xPTklOR19JRD48REFUQVNUT1JFX0lEPjE8L0RBVEF
> TVE9SRV9JRD48REFUQVNUT1JFPmRlZmF1bHQ8L0RBVEFTVE9SRT48Vk1TPjwvVk1TPjxDTE9ORVM+PC9DTE9ORVM+PFRFTVBMQVRFPjxERVZfUFJFRklYPjwhW0NEQVRBW2hkXV0+PC9ERVZfUFJFRklYPjwvVEVNUExBVEU+PC9JTUFHRT48REFUQVNUT1JFPjxJ
> RD4xPC9JRD48VUlEPjA8L1VJRD48R0lEPjA8L0dJRD48VU5BTUU+b25lYWRtaW48L1VOQU1FPjxHTkFNRT5vbmVhZG1pbjwvR05BTUU+PE5BTUU+ZGVmYXVsdDwvTkFNRT48UEVSTUlTU0lPTlM+PE9XTkVSX1U+MTwvT1dORVJfVT48T1dORVJfTT4xPC9PV05FU
> l9NPjxPV05FUl9BPjA8L09XTkVSX0E+PEdST1VQX1U+MTwvR1JPVVBfVT48R1JPVVBfTT4wPC9HUk9VUF9NPjxHUk9VUF9BPjA8L0dST1VQX0E+PE9USEVSX1U+MTwvT1RIRVJfVT48T1RIRVJfTT4wPC9PVEhFUl9NPjxPVEhFUl9BPjA8L09USEVSX0E+PC9QRV
> JNSVNTSU9OUz48RFNfTUFEPnZtZnM8L0RTX01BRD48VE1fTUFEPnZtZnM8L1RNX01BRD48QkFTRV9QQVRIPi92YXIvbGliL29uZS9kYXRhc3RvcmVzLzE8L0JBU0VfUEFUSD48VFlQRT4wPC9UWVBFPjxESVNLX1RZUEU+MDwvRElTS19UWVBFPjxDTFVTVEVSX0l
> EPi0xPC9DTFVTVEVSX0lEPjxDTFVTVEVSPjwvQ0xVU1RFUj48SU1BR0VTPjxJRD4wPC9JRD48SUQ+ODwvSUQ+PC9JTUFHRVM+PFRFTVBMQVRFPjxCUklER0VfTElTVD48IVtDREFUQVsxOTIuMTY4LjI1MC4zNCAxOTIuMTY4LjI1MC4zOF1dPjwvQlJJREdFX0xJ
> U1Q+PERTX01BRD48IVtDREFUQVt2bWZzXV0+PC9EU19NQUQ+PFRNX01BRD48IVtDREFUQVt2bWZzXV0+PC9UTV9NQUQ+PFRZUEU+PCFbQ0RBVEFbSU1BR0VfRFNdXT48L1RZUEU+PC9URU1QTEFURT48L0RBVEFTVE9SRT48L0RTX0RSSVZFUl9BQ1RJT05fREFUQ
> T4= 9
> Mon Jul 8 06:34:40 2013 [ImG][D]: Message received: LOG E 9 cp: Command "vifs --server 192.168.250.38 --username oneadmin --password XXXXXXX --mkdir [1]3082ff704119400bcd206bb0d4d5b725" failed: S
> erver version unavailable at 'https://192.168.250.38:443/sdk/vimService.wsdl' at /usr/share/perl/5.14/VMware/VICommon.pm line 546.
>
> Mon Jul 8 06:34:40 2013 [ImM][E]: cp: Command "vifs --server 192.168.250.38 --username oneadmin --password XXXXXX --mkdir [1]3082ff704119400bcd206bb0d4d5b725" failed: Server version unavailable
> at 'https://192.168.250.38:443/sdk/vimService.wsdl' at /usr/share/perl/5.14/VMware/VICommon.pm line 546.
> Mon Jul 8 06:34:40 2013 [ImG][D]: Message received: LOG E 9 Cannot create [1]3082ff704119400bcd206bb0d4d5b725 in 192.168.250.38
>
> Mon Jul 8 06:34:40 2013 [ImM][E]: Cannot create [1]3082ff704119400bcd206bb0d4d5b725 in 192.168.250.38
> Mon Jul 8 06:34:40 2013 [ImG][D]: Message received: LOG I 9 ExitCode: 1
>
> Mon Jul 8 06:34:40 2013 [ImM][I]: ExitCode: 1
> Mon Jul 8 06:34:40 2013 [ImG][D]: Message received: CP FAILURE 9 Cannot create [1]3082ff704119400bcd206bb0d4d5b725 in 192.168.250.38
>
> Mon Jul 8 06:34:40 2013 [ImM][E]: Error copying image in the datastore: Cannot create [1]3082ff704119400bcd206bb0d4d5b725 in 192.168.250.38
>
> And the environment variables already show it exported -- I wonder if maybe by putting the variable export in rc.local is later than sunstone starting??
>
> oneadmin at u-cmh-neb-dev01:/var/log/one$ env
> SHELL=/bin/bash
> TERM=xterm
> OLDPWD=/var/lib/one/.one
> USER=oneadmin
> MAIL=/var/mail/oneadmin
> PATH=/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/opt/packages/vmware-vsphere-cli-distrib/bin/
> PWD=/var/log/one
> LANG=en_US.UTF-8
> SHLVL=1
> HOME=/var/lib/one
> PERL_LWP_SSL_VERIFY_HOSTNAME=0
> LOGNAME=oneadmin
> _=/usr/bin/env
> oneadmin at u-cmh-neb-dev01:/var/log/one$
>
> Michael Curran | connectsolutions | Lead Network Architect
> Phone 614.568.2285 | Mobile 614.403.6320 | www.connectsolutions.com
>
> -----Original Message-----
> From: Tino Vazquez [mailto:cvazquez at c12g.com]
> Sent: Monday, July 08, 2013 10:11 AM
> To: Michael Curran
> Cc: users at lists.opennebula.org
> Subject: Re: [one-users] VMFS datastore image creation issue
>
> Hi,
>
> comments inline,
>
> On Mon, Jul 8, 2013 at 4:04 PM, Michael Curran <michael.curran at connectsolutions.com> wrote:
>> Okay -- so I run into this while using the sunstone
>>
>> It created the image for DATABLOCK, it's still set to LOCKED but
>> claims its only a 1mb file -- it cant be copying still after 35 mins
>
> Send us the /var/lib/one/oned.log to figure out what is going on with that DATABLOCK. We would need the id of the DATABLOCK as well.
>
>>
>> When I try to create the image as OS -- I get an error for "Server Version unavailable"
>>
>> I set the PERL_LWP_SSL_VERIFY_HOSTNAME=0 in rc.local so it should show up with any running system process -- but I only get successes on the create when I run the vifs command from the CLI , is there something that needs to be added to SUNSTONE to skip that verify step?
>
> That error does indeed imply that the PERL_LWP_SSL_VERIFY_HOSTNAME needs to be set to 0. This variable needs to be enforced for the OpenNebula daemon (oned) rather than Sunstone. To ensure this, please do the following:
>
> * one stop
> * sunstone-server stop
> * export PERL_LWP_SSL_VERIFY_HOSTNAME=0
> * one start
> * sunstone-server start
> * try to create an OS image again
>
> Regards,
>
> -Tino
>
>>
>> Michael Curran | connectsolutions | Lead Network Architect Phone
>> 614.568.2285 | Mobile 614.403.6320 | www.connectsolutions.com
>>
>> -----Original Message-----
>> From: Tino Vazquez [mailto:cvazquez at c12g.com]
>> Sent: Monday, July 08, 2013 8:58 AM
>> To: Michael Curran
>> Cc: users at lists.opennebula.org
>> Subject: Re: [one-users] VMFS datastore image creation issue
>>
>> Glad to hear that ;)
>> --
>> Constantino Vázquez Blanco, PhD, MSc
>> C12G Labs - OpenNebula for the Enterprise www.c12g.com |
>> cvazquez at c12g.com | @C12G
>>
>> --
>> Confidentiality Warning: The information contained in this e-mail and any accompanying documents, unless otherwise expressly indicated, is confidential and privileged, and is intended solely for the person and/or entity to whom it is addressed (i.e. those identified in the "To" and "cc" box). They are the property of C12G Labs S.L..
>> Unauthorized distribution, review, use, disclosure, or copying of this communication, or any part thereof, is strictly prohibited and may be unlawful. If you have received this e-mail in error, please notify us immediately by e-mail at abuse at c12g.com and delete the e-mail and attachments and any copy from your system. C12G thanks you for your cooperation.
>>
>>
>> On Mon, Jul 8, 2013 at 1:57 PM, Michael Curran <michael.curran at connectsolutions.com> wrote:
>>> That was it -- I deleted and re-added the storage device to rename it just 1 , and its working now.
>>>
>>> Michael Curran | connectsolutions | Lead Network Architect Phone
>>> 614.568.2285 | Mobile 614.403.6320 | www.connectsolutions.com
>>>
>>> -----Original Message-----
>>> From: users-bounces at lists.opennebula.org
>>> [mailto:users-bounces at lists.opennebula.org] On Behalf Of Michael
>>> Curran
>>> Sent: Monday, July 08, 2013 7:54 AM
>>> To: Tino Vazquez
>>> Cc: users at lists.opennebula.org
>>> Subject: Re: [one-users] VMFS datastore image creation issue
>>>
>>> I think the problem is that it is named 1(1) instead of just 1
>>>
>>> When I try to rename the device to just 1 -- it fails and shows up
>>> again as 1(1)
>>>
>>> Michael Curran | connectsolutions | Lead Network Architect Phone
>>> 614.568.2285 | Mobile 614.403.6320 | www.connectsolutions.com
>>>
>>> -----Original Message-----
>>> From: Tino Vazquez [mailto:cvazquez at c12g.com]
>>> Sent: Monday, July 08, 2013 7:33 AM
>>> To: Michael Curran
>>> Cc: users at lists.opennebula.org
>>> Subject: Re: [one-users] VMFS datastore image creation issue
>>>
>>> Hi Michael,
>>>
>>> Do you have a datastore named "1" in the ESX? If so, could you rescan the datastore (through the VI client) and try again?
>>>
>>> If the above doesn't work, please send us the output of:
>>>
>>> * vifs --server 192.168.250.38 --username oneadmin --password
>>> c0NN3cT4 --mkdir [1]36f2381589196c82e8cffd46b53c3e49
>>> * vifs --server 192.168.250.38 --username oneadmin --password
>>> c0NN3cT4 --mkdir /vmfs/volumes/1/36f2381589196c82e8cffd46b53c3e49
>>>
>>> as well as the version of the vSphere CLI installed in the front-end (I assume you are using VMFS drivers without SSH connection).
>>>
>>> Regards,
>>>
>>> -Tino
>>>
>>> --
>>> Constantino Vázquez Blanco, PhD, MSc
>>> C12G Labs - OpenNebula for the Enterprise www.c12g.com |
>>> cvazquez at c12g.com | @C12G
>>>
>>> --
>>> Confidentiality Warning: The information contained in this e-mail and any accompanying documents, unless otherwise expressly indicated, is confidential and privileged, and is intended solely for the person and/or entity to whom it is addressed (i.e. those identified in the "To" and "cc" box). They are the property of C12G Labs S.L..
>>> Unauthorized distribution, review, use, disclosure, or copying of this communication, or any part thereof, is strictly prohibited and may be unlawful. If you have received this e-mail in error, please notify us immediately by e-mail at abuse at c12g.com and delete the e-mail and attachments and any copy from your system. C12G thanks you for your cooperation.
>>> _______________________________________________
>>> Users mailing list
>>> Users at lists.opennebula.org
>>> http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
>>> _______________________________________________
>>> Users mailing list
>>> Users at lists.opennebula.org
>>> http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
>> _______________________________________________
>> Users mailing list
>> Users at lists.opennebula.org
>> http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
> _______________________________________________
> Users mailing list
> Users at lists.opennebula.org
> http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
More information about the Users
mailing list