[one-users] images upload problems
Daniel Molina
dmolina at opennebula.org
Thu Jan 9 06:41:01 PST 2014
Hi,
On 8 January 2014 19:00, kiran ranjane <kiran.ranjane at gmail.com> wrote:
> Hi Daniel,
>
> Thanks for the update, However I was referring to get an update on mail
> trail mentioned below :
> -- I was getting md5 mismatch error in logs while uploading the image and
> it was fixed by bypassing proxy server, If I use sunstone through proxy
> server then I get this error.
>
Could you please open a ticket in our dev page with the details of the
problem so we can debug it.
Cheers
> -- Also I would like some inputs on point 2 and 3 mention below.
>
> Thanks
> Kiran Ranjane
>
>
> Previous Mail :
>
> Hi Daniel,
>
> -- I re-tested uploading image issue using a new virtual appliance from
> marketplace and booted it on VMware Workstation.
> -- I tested with 2 scenarios 1) importing image from Marketplace 2)
> uploading ISO to image from files.
> -- While uploading after sometime the image goes into ERROR STATE, I have
> attached the logs as well as a screenshot.
>
> -- I also have few questions and concerns.
>
> *1)* I tried the 1st scenario by selecting virtual router 4.2 and it show
> size of around 83MB in marketplace, However when the import starts the size
> reached to 200M, if I do ls -lh in datastore 1, also in oneimage command
> the size shows as 83M, Why there is a mismatch of size?
> *2)* May be this is a enhancement request, In oneimage and also in
> sunstone it should show UID of the image (UID that you get from datastore1
> when using ls -lh) along with the name, Like example mentioned below
>
> oneimage list
> ID USER GROUP NAME DATASTORE SIZE TYPE PER
> STAT RVMS *UID*
> 12 oneadmin oneadmin Centos 6.4 Iso default 702M CD No err
> 0 09d94b3dcc6daa7840fa3e214b2f1b86
>
> This helps in recognising the image while troubleshooting issues related
> to image.
>
> *3) *When I delete images from sunstone it shows that it is deleted, also
> in oneimage command I do not see the image entry but the image is still
> there in data-store 1 (Highlighted in blue in the logs below), also the
> total image size in sunstone varies. In sunstone it shows 5 Total and 6.5
> used. however in data-store1 when I do ls -lh the total size if you
> calculate is around 7.3 GB utilized.
>
>
> *LOGS ATTACHED :- *
>
> oned.log
>
> *(While importing image from marketplace {virtual router 4.2})*
>
> Thu Jan 2 00:32:02 2014 [ReM][D]: Req:384 UID:1 DocumentPoolInfo invoked,
> -2, -1, -1, 100
> Thu Jan 2 00:32:02 2014 [ReM][D]: Req:384 UID:1 DocumentPoolInfo result
> SUCCESS, "<DOCUMENT_POOL></DOC..."
> Thu Jan 2 00:32:03 2014 [ReM][D]: Req:2016 UID:0 UserPoolInfo invoked
> Thu Jan 2 00:32:03 2014 [ReM][D]: Req:2016 UID:0 UserPoolInfo result
> SUCCESS, "<USER_POOL><USER><ID..."
> Thu Jan 2 00:32:09 2014 [InM][D]: Monitoring datastore default (1)
> Thu Jan 2 00:32:09 2014 [InM][D]: Monitoring datastore files (2)
> Thu Jan 2 00:32:09 2014 [ImM][D]: Datastore files (2) successfully
> monitored.
> Thu Jan 2 00:32:09 2014 [ImM][D]: Datastore default (1) successfully
> monitored.
> Thu Jan 2 00:32:15 2014 [ImM][I]: Command execution fail:
> /var/lib/one/remotes/datastore/fs/cp
> PERTX0RSSVZFUl9BQ1RJT05fREFUQT48SU1BR0U+PElEPjExPC9JRD48VUlEPjA8L1VJRD48
>
> R0lEPjA8L0dJRD48VU5BTUU+b25lYWRtaW48L1VOQU1FPjxHTkFNRT5vbmVhZG1pbjwvR05BTUU+PE5BTUU+T3Blbk5lYnVsYSA0LjIgVmlydHVhbCBSb3V0ZXI8L05BTUU+PFBFUk1JU1NJT05TPjxPV05FUl9VPjE8L09X
>
> TkVSX1U+PE9XTkVSX00+MTwvT1dORVJfTT48T1dORVJfQT4wPC9PV05FUl9BPjxHUk9VUF9VPjA8L0dST1VQX1U+PEdST1VQX00+MDwvR1JPVVBfTT48R1JPVVBfQT4wPC9HUk9VUF9BPjxPVEhFUl9VPjA8L09USEVSX1U+
>
> PE9USEVSX00+MDwvT1RIRVJfTT48T1RIRVJfQT4wPC9PVEhFUl9BPjwvUEVSTUlTU0lPTlM+PFRZUEU+MDwvVFlQRT48RElTS19UWVBFPjA8L0RJU0tfVFlQRT48UEVSU0lTVEVOVD4wPC9QRVJTSVNURU5UPjxSRUdUSU1F
>
> PjEzODg2MTg5ODE8L1JFR1RJTUU+PFNPVVJDRT48L1NPVVJDRT48UEFUSD5odHRwOi8vbWFya2V0cGxhY2UuYzEyZy5jb20vYXBwbGlhbmNlLzUxZjJhMDlmOGZiODFkNGQxOTAwMDAwNC9kb3dubG9hZDwvUEFUSD48RlNU
>
> WVBFPjwvRlNUWVBFPjxTSVpFPjgzPC9TSVpFPjxTVEFURT40PC9TVEFURT48UlVOTklOR19WTVM+MDwvUlVOTklOR19WTVM+PENMT05JTkdfT1BTPjA8L0NMT05JTkdfT1BTPjxDTE9OSU5HX0lEPi0xPC9DTE9OSU5HX0lE
>
> PjxEQVRBU1RPUkVfSUQ+MTwvREFUQVNUT1JFX0lEPjxEQVRBU1RPUkU+ZGVmYXVsdDwvREFUQVNUT1JFPjxWTVM+PC9WTVM+PENMT05FUz48L0NMT05FUz48VEVNUExBVEU+PERFVl9QUkVGSVg+PCFbQ0RBVEFbaGRdXT48
>
> L0RFVl9QUkVGSVg+PERSSVZFUj48IVtDREFUQVtyYXddXT48L0RSSVZFUj48TUQ1PjwhW0NEQVRBWzc4ZDQ2ZjU1MTZjMDhlMGQ5NmE4ZGM5MmFhMjZjODM4XV0+PC9NRDU+PFNIQTE+PCFbQ0RBVEFbYTJhNTM4MDI3ZDVm
>
> OWY5ZmNiYmFkNmM4YWRhZDNmNjdkMmRlNTI0Ml1dPjwvU0hBMT48L1RFTVBMQVRFPjwvSU1BR0U+PERBVEFTVE9SRT48SUQ+MTwvSUQ+PFVJRD4wPC9VSUQ+PEdJRD4wPC9HSUQ+PFVOQU1FPm9uZWFkbWluPC9VTkFNRT48
>
> R05BTUU+b25lYWRtaW48L0dOQU1FPjxOQU1FPmRlZmF1bHQ8L05BTUU+PFBFUk1JU1NJT05TPjxPV05FUl9VPjE8L09XTkVSX1U+PE9XTkVSX00+MTwvT1dORVJfTT48T1dORVJfQT4wPC9PV05FUl9BPjxHUk9VUF9VPjE8
>
> L0dST1VQX1U+PEdST1VQX00+MTwvR1JPVVBfTT48R1JPVVBfQT4wPC9HUk9VUF9BPjxPVEhFUl9VPjE8L09USEVSX1U+PE9USEVSX00+MTwvT1RIRVJfTT48T1RIRVJfQT4wPC9PVEhFUl9BPjwvUEVSTUlTU0lPTlM+PERT
>
> X01BRD5mczwvRFNfTUFEPjxUTV9NQUQ+c2hhcmVkPC9UTV9NQUQ+PEJBU0VfUEFUSD4vdmFyL2xpYi9vbmUvZGF0YXN0b3Jlcy8xPC9CQVNFX1BBVEg+PFRZUEU+MDwvVFlQRT48RElTS19UWVBFPjA8L0RJU0tfVFlQRT48
>
> Q0xVU1RFUl9JRD4tMTwvQ0xVU1RFUl9JRD48Q0xVU1RFUj48L0NMVVNURVI+PFRPVEFMX01CPjEwMDc5PC9UT1RBTF9NQj48RlJFRV9NQj42NzQ3PC9GUkVFX01CPjxVU0VEX01CPjEzODU8L1VTRURfTUI+PElNQUdFUz48
>
> SUQ+MDwvSUQ+PElEPjk8L0lEPjxJRD4xMDwvSUQ+PC9JTUFHRVM+PFRFTVBMQVRFPjxDTE9ORV9UQVJHRVQ+PCFbQ0RBVEFbU1lTVEVNXV0+PC9DTE9ORV9UQVJHRVQ+PERTX01BRD48IVtDREFUQVtmc11dPjwvRFNfTUFE
>
> PjxMTl9UQVJHRVQ+PCFbQ0RBVEFbTk9ORV1dPjwvTE5fVEFSR0VUPjxTQUZFX0RJUlM+PCFbQ0RBVEFbL11dPjwvU0FGRV9ESVJTPjxUTV9NQUQ+PCFbQ0RBVEFbc2hhcmVkXV0+PC9UTV9NQUQ+PFRZUEU+PCFbQ0RBVEFb
> SU1BR0VfRFNdXT48L1RZUEU+PC9URU1QTEFURT48L0RBVEFTVE9SRT48L0RTX0RSSVZFUl9BQ1RJT05fREFUQT4=
> 11
> Thu Jan 2 00:32:15 2014 [ImM][I]: cp: Downloading
> http://marketplace.c12g.com/appliance/51f2a09f8fb81d4d19000004/download to
> the image repository
> Thu Jan 2 00:32:15 2014 [ImM][E]: cp: Command
> "/var/lib/one/remotes/datastore/fs/../downloader.sh --md5
> 78d46f5516c08e0d96a8dc92aa26c838 --sha1 a2a538027d5f9f9fcbbad6c
> 8adad3f67d2de5242
> http://marketplace.c12g.com/appliance/51f2a09f8fb81d4d19000004/download /var/lib/one/datastores/1/b009532933650d5448fced7e3ac6f1d1"
> failed: Hash does
> not match
> Thu Jan 2 00:32:15 2014 [ImM][E]: Error downloading
> http://marketplace.c12g.com/appliance/51f2a09f8fb81d4d19000004/download
> Thu Jan 2 00:32:15 2014 [ImM][I]: ExitCode: 255
> Thu Jan 2 00:32:15 2014 [ImM][E]: Error copying image in the datastore:
> Error downloading
> http://marketplace.c12g.com/appliance/51f2a09f8fb81d4d19000004/download
> Thu Jan 2 00:32:15 2014 [InM][D]: Monitoring datastore default (1)
> Thu Jan 2 00:32:15 2014 [ImM][D]: Datastore default (1) successfully
> monitored.
> Thu Jan 2 00:32:16 2014 [ImM][D]: Datastore system (0) successfully
> monitored.
> Thu Jan 2 00:32:16 2014 [InM][D]: Host one-sandbox (1) successfully
> monitored.
>
>
>
> *(While uploading ISO)*
>
> Thu Jan 2 00:45:16 2014 [ImM][D]: Datastore default (1) successfully
> monitored.
> Thu Jan 2 00:45:16 2014 [ImM][I]: Command execution fail:
> /var/lib/one/remotes/datastore/fs/cp
> PERTX0RSSVZFUl9BQ1RJT05fREFUQT48SU1BR0U+PElEPjEyPC9JRD48VUlEPjA8L1VJRD48
>
> R0lEPjA8L0dJRD48VU5BTUU+b25lYWRtaW48L1VOQU1FPjxHTkFNRT5vbmVhZG1pbjwvR05BTUU+PE5BTUU+Q2VudG9zIDYuNCBJc288L05BTUU+PFBFUk1JU1NJT05TPjxPV05FUl9VPjE8L09XTkVSX1U+PE9XTkVSX00+
>
> MTwvT1dORVJfTT48T1dORVJfQT4wPC9PV05FUl9BPjxHUk9VUF9VPjA8L0dST1VQX1U+PEdST1VQX00+MDwvR1JPVVBfTT48R1JPVVBfQT4wPC9HUk9VUF9BPjxPVEhFUl9VPjA8L09USEVSX1U+PE9USEVSX00+MDwvT1RI
>
> RVJfTT48T1RIRVJfQT4wPC9PVEhFUl9BPjwvUEVSTUlTU0lPTlM+PFRZUEU+MTwvVFlQRT48RElTS19UWVBFPjA8L0RJU0tfVFlQRT48UEVSU0lTVEVOVD4wPC9QRVJTSVNURU5UPjxSRUdUSU1FPjEzODg2MTk5MDQ8L1JF
>
> R1RJTUU+PFNPVVJDRT48L1NPVVJDRT48UEFUSD4vdmFyL3RtcC90aGluLWJvZHkyMDE0MDEwMi0xNjk5LTdkMTZrOS0wPC9QQVRIPjxGU1RZUEU+PC9GU1RZUEU+PFNJWkU+NzAyPC9TSVpFPjxTVEFURT40PC9TVEFURT48
>
> UlVOTklOR19WTVM+MDwvUlVOTklOR19WTVM+PENMT05JTkdfT1BTPjA8L0NMT05JTkdfT1BTPjxDTE9OSU5HX0lEPi0xPC9DTE9OSU5HX0lEPjxEQVRBU1RPUkVfSUQ+MTwvREFUQVNUT1JFX0lEPjxEQVRBU1RPUkU+ZGVm
>
> YXVsdDwvREFUQVNUT1JFPjxWTVM+PC9WTVM+PENMT05FUz48L0NMT05FUz48VEVNUExBVEU+PERFVl9QUkVGSVg+PCFbQ0RBVEFbaGRdXT48L0RFVl9QUkVGSVg+PERSSVZFUj48IVtDREFUQVtyYXddXT48L0RSSVZFUj48
>
> TUQ1PjwhW0NEQVRBWzc4ZDQ2ZjU1MTZjMDhlMGQ5NmE4ZGM5MmFhMjZjODM4XV0+PC9NRDU+PFNIQTE+PCFbQ0RBVEFbYTJhNTM4MDI3ZDVmOWY5ZmNiYmFkNmM4YWRhZDNmNjdkMmRlNTI0Ml1dPjwvU0hBMT48L1RFTVBM
>
> QVRFPjwvSU1BR0U+PERBVEFTVE9SRT48SUQ+MTwvSUQ+PFVJRD4wPC9VSUQ+PEdJRD4wPC9HSUQ+PFVOQU1FPm9uZWFkbWluPC9VTkFNRT48R05BTUU+b25lYWRtaW48L0dOQU1FPjxOQU1FPmRlZmF1bHQ8L05BTUU+PFBF
>
> Uk1JU1NJT05TPjxPV05FUl9VPjE8L09XTkVSX1U+PE9XTkVSX00+MTwvT1dORVJfTT48T1dORVJfQT4wPC9PV05FUl9BPjxHUk9VUF9VPjE8L0dST1VQX1U+PEdST1VQX00+MTwvR1JPVVBfTT48R1JPVVBfQT4wPC9HUk9V
>
> UF9BPjxPVEhFUl9VPjE8L09USEVSX1U+PE9USEVSX00+MTwvT1RIRVJfTT48T1RIRVJfQT4wPC9PVEhFUl9BPjwvUEVSTUlTU0lPTlM+PERTX01BRD5mczwvRFNfTUFEPjxUTV9NQUQ+c2hhcmVkPC9UTV9NQUQ+PEJBU0Vf
>
> UEFUSD4vdmFyL2xpYi9vbmUvZGF0YXN0b3Jlcy8xPC9CQVNFX1BBVEg+PFRZUEU+MDwvVFlQRT48RElTS19UWVBFPjA8L0RJU0tfVFlQRT48Q0xVU1RFUl9JRD4tMTwvQ0xVU1RFUl9JRD48Q0xVU1RFUj48L0NMVVNURVI+
>
> PFRPVEFMX01CPjEwMDc5PC9UT1RBTF9NQj48RlJFRV9NQj42MDY2PC9GUkVFX01CPjxVU0VEX01CPjE1ODU8L1VTRURfTUI+PElNQUdFUz48SUQ+MDwvSUQ+PElEPjk8L0lEPjxJRD4xMDwvSUQ+PElEPjExPC9JRD48L0lN
>
> QUdFUz48VEVNUExBVEU+PENMT05FX1RBUkdFVD48IVtDREFUQVtTWVNURU1dXT48L0NMT05FX1RBUkdFVD48RFNfTUFEPjwhW0NEQVRBW2ZzXV0+PC9EU19NQUQ+PExOX1RBUkdFVD48IVtDREFUQVtOT05FXV0+PC9MTl9U
>
> QVJHRVQ+PFNBRkVfRElSUz48IVtDREFUQVsvXV0+PC9TQUZFX0RJUlM+PFRNX01BRD48IVtDREFUQVtzaGFyZWRdXT48L1RNX01BRD48VFlQRT48IVtDREFUQVtJTUFHRV9EU11dPjwvVFlQRT48L1RFTVBMQVRFPjwvREFU
> QVNUT1JFPjwvRFNfRFJJVkVSX0FDVElPTl9EQVRBPg== 12
> Thu Jan 2 00:45:16 2014 [ImM][I]: cp: Copying local image
> /var/tmp/thin-body20140102-1699-7d16k9-0 to the image repository
> Thu Jan 2 00:45:16 2014 [ImM][E]: cp: Command
> "/var/lib/one/remotes/datastore/fs/../downloader.sh --md5
> 78d46f5516c08e0d96a8dc92aa26c838 --sha1 a2a538027d5f9f9fcbbad6c
> 8adad3f67d2de5242 /var/tmp/thin-body20140102-1699-7d16k9-0
> /var/lib/one/datastores/1/09d94b3dcc6daa7840fa3e214b2f1b86" failed: Hash
> does not match
> Thu Jan 2 00:45:16 2014 [ImM][E]: Error copying
> /var/tmp/thin-body20140102-1699-7d16k9-0 to
> /var/lib/one/datastores/1/09d94b3dcc6daa7840fa3e214b2f1b86
> Thu Jan 2 00:45:16 2014 [ImM][I]: ExitCode: 255
> Thu Jan 2 00:45:16 2014 [ImM][E]: Error copying image in the datastore:
> Error copying /var/tmp/thin-body20140102-1699-7d16k9-0 to
> /var/lib/one/datastores/1/09d94b3dcc6
> daa7840fa3e214b2f1b86
> Thu Jan 2 00:45:16 2014 [InM][D]: Monitoring datastore default (1)
> Thu Jan 2 00:45:17 2014 [ImM][D]: Datastore default (1) successfully
> monitored.
> Thu Jan 2 00:45:21 2014 [ReM][D]: Req:8560 UID:0 ImageInfo invoked, 12
>
>
> *DATASTORE 1 OUTPUT*
>
> [root at one-sandbox datastores]# ls
> 0 1 2
> [root at one-sandbox datastores]# cd 1
> [root at one-sandbox 1]# ls
> 2637dfdd7d7779633d6af1426c172278 b009532933650d5448fced7e3ac6f1d1
> fc2b4e42e4bd3daa17c8217b9fbad3db
> 3326aa6ceeebea4fda2f15543d16902b f5394317d377beaa09fc07697df9ff68
> [oneadmin at one-sandbox 1]$ls -lh
> total 2.3G
> -rw-r--r-- 1 oneadmin oneadmin 702M Jan 2 00:45
> 09d94b3dcc6daa7840fa3e214b2f1b86
> *-rw-r--r-- 1 oneadmin oneadmin 672M Dec 5 07:05
> 2637dfdd7d7779633d6af1426c172278*
> -rw-r--r-- 1 oneadmin oneadmin 672M Dec 15 07:20
> 3326aa6ceeebea4fda2f15543d16902b
> -rw-r--r-- 1 oneadmin oneadmin 201M Jan 2 00:32
> b009532933650d5448fced7e3ac6f1d1
> -rw-rw---- 1 oneadmin oneadmin 40M Nov 21 2012
> f5394317d377beaa09fc07697df9ff68
> -rw-r--r-- 1 oneadmin oneadmin 5.1G Dec 15 07:21
> fc2b4e42e4bd3daa17c8217b9fbad3db
>
>
>
> *oneimage list*
> ID USER GROUP NAME DATASTORE SIZE TYPE PER
> STAT RVMS
> 0 oneadmin oneadmin ttylinux default 40M OS No
> used 1
> 9 oneadmin oneadmin un 13.10 default 672M CD Yes
> used 1
> 10 oneadmin oneadmin un 13.10 image default 5G OS No
> used 1
> 11 oneadmin oneadmin OpenNebula 4.2 default 83M OS No err
> 0
> 12 oneadmin oneadmin Centos 6.4 Iso default 702M CD No err
> 0
>
>
> Thanks and Regards
>
>
> On Wed, Jan 8, 2014 at 3:10 PM, Daniel Molina <dmolina at opennebula.org>wrote:
>
>> Hi,
>>
>> Uploading large files through sunstone is not recommended, and if you do
>> so, you should deploy Sunstone on top of Passenger [1]
>>
>> Cheers
>>
>> [1]
>> http://docs.opennebula.org/stable/advanced_administration/scalability/suns_advance.html?highlight=passenger
>>
>>
>> On 7 January 2014 23:11, kiran ranjane <kiran.ranjane at gmail.com> wrote:
>>
>>> Hi Daniel,
>>>
>>> Any findings on this issue from your side.
>>>
>>> Thanks and regards
>>> Kiran Ranjane
>>>
>>>
>>> On Fri, Jan 3, 2014 at 11:21 AM, hansz <hanshizhunjob at 126.com> wrote:
>>>
>>>>
>>>> Hi ，
>>>>> I use opennebula4.2 install on centos6.4 and esxi5.1 ,ruby is 1.8.7
>>>>> when i upload the image (i tar disk-flat.vmdk(8G) and disk.vmdk a
>>>>> disk.tar.bz2 ,the size of the disk.tar.bz2 is about 3G )
>>>>> then i upload the disk.tar.bz2 through the sunstone ,
>>>>> even though i run oneimage list as the oneadmin it show the image is
>>>>> rdy ,but on the sunstone the images is uploading .
>>>>> anything wrong?
>>>>>
>>>>
>>>>> you can have a look the pics
>>>>>
>>>>>
>>>>>
>>>>> i use sunstone stop but could not kill the pid ,i must kill the id
>>>>> Manual
>>>>>
>>>>
>>>>
>>>>
>>>> _______________________________________________
>>>> Users mailing list
>>>> Users at lists.opennebula.org
>>>> http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
>>>>
>>>>
>>>
>>
>>
>> --
>> --
>> Daniel Molina
>> Project Engineer
>> OpenNebula - Flexible Enterprise Cloud Made Simple
>> www.OpenNebula.org | dmolina at opennebula.org | @OpenNebula
>>
>
>
--
--
Daniel Molina
Project Engineer
OpenNebula - Flexible Enterprise Cloud Made Simple
www.OpenNebula.org | dmolina at opennebula.org | @OpenNebula
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.opennebula.org/pipermail/users-opennebula.org/attachments/20140109/26ea8077/attachment-0002.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/png
Size: 27168 bytes
Desc: not available
URL: <http://lists.opennebula.org/pipermail/users-opennebula.org/attachments/20140109/26ea8077/attachment-0004.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/png
Size: 101123 bytes
Desc: not available
URL: <http://lists.opennebula.org/pipermail/users-opennebula.org/attachments/20140109/26ea8077/attachment-0005.png>
More information about the Users
mailing list