[one-users] images upload problems

kiran ranjane kiran.ranjane at gmail.com
Wed Jan 8 10:00:34 PST 2014


Hi Daniel,

Thanks for the update, However I was referring to get an update on mail
trail mentioned below :
-- I was getting md5 mismatch error in logs while uploading the image and
it was  fixed by bypassing proxy server, If I use sunstone through proxy
server then I get this error.
-- Also I would like some inputs on point 2 and 3 mention below.

Thanks
Kiran Ranjane


Previous Mail :

Hi Daniel,

-- I re-tested uploading image issue using a new virtual appliance from
marketplace and booted it on VMware Workstation.
-- I tested with 2 scenarios 1) importing image from Marketplace 2)
uploading ISO to image from files.
-- While uploading after sometime the image goes into ERROR STATE, I have
attached the logs as well as a screenshot.

-- I also have few questions and concerns.

*1)* I tried the 1st scenario by selecting virtual router 4.2 and it show
size of around 83MB in marketplace, However when the import starts the size
reached to 200M, if I do ls -lh in datastore 1, also in oneimage command
the size shows as 83M, Why there is a mismatch of size?
*2)* May be this is a enhancement request, In oneimage and also in sunstone
it should show UID of the image (UID that you get from datastore1 when
using ls -lh) along with the name, Like example mentioned below

oneimage list
  ID USER       GROUP      NAME            DATASTORE     SIZE TYPE PER STAT
RVMS *UID*
  12 oneadmin   oneadmin   Centos 6.4 Iso  default       702M CD    No err
    0                  09d94b3dcc6daa7840fa3e214b2f1b86

This helps in recognising the image while troubleshooting issues related to
image.

*3) *When I delete images from sunstone it shows that it is deleted, also
in oneimage command I do not see the image entry but the image is still
there in data-store 1 (Highlighted in blue in the logs below), also the
total image size in sunstone varies. In sunstone it  shows 5 Total and 6.5
used. however in data-store1 when I do ls -lh the total size if you
calculate is around 7.3 GB utilized.


*LOGS ATTACHED :- *

oned.log

*(While importing image from marketplace {virtual router 4.2})*

Thu Jan  2 00:32:02 2014 [ReM][D]: Req:384 UID:1 DocumentPoolInfo invoked,
-2, -1, -1, 100
Thu Jan  2 00:32:02 2014 [ReM][D]: Req:384 UID:1 DocumentPoolInfo result
SUCCESS, "<DOCUMENT_POOL></DOC..."
Thu Jan  2 00:32:03 2014 [ReM][D]: Req:2016 UID:0 UserPoolInfo invoked
Thu Jan  2 00:32:03 2014 [ReM][D]: Req:2016 UID:0 UserPoolInfo result
SUCCESS, "<USER_POOL><USER><ID..."
Thu Jan  2 00:32:09 2014 [InM][D]: Monitoring datastore default (1)
Thu Jan  2 00:32:09 2014 [InM][D]: Monitoring datastore files (2)
Thu Jan  2 00:32:09 2014 [ImM][D]: Datastore files (2) successfully
monitored.
Thu Jan  2 00:32:09 2014 [ImM][D]: Datastore default (1) successfully
monitored.
Thu Jan  2 00:32:15 2014 [ImM][I]: Command execution fail:
/var/lib/one/remotes/datastore/fs/cp
PERTX0RSSVZFUl9BQ1RJT05fREFUQT48SU1BR0U+PElEPjExPC9JRD48VUlEPjA8L1VJRD48
R0lEPjA8L0dJRD48VU5BTUU+b25lYWRtaW48L1VOQU1FPjxHTkFNRT5vbmVhZG1pbjwvR05BTUU+PE5BTUU+T3Blbk5lYnVsYSA0LjIgVmlydHVhbCBSb3V0ZXI8L05BTUU+PFBFUk1JU1NJT05TPjxPV05FUl9VPjE8L09X
TkVSX1U+PE9XTkVSX00+MTwvT1dORVJfTT48T1dORVJfQT4wPC9PV05FUl9BPjxHUk9VUF9VPjA8L0dST1VQX1U+PEdST1VQX00+MDwvR1JPVVBfTT48R1JPVVBfQT4wPC9HUk9VUF9BPjxPVEhFUl9VPjA8L09USEVSX1U+
PE9USEVSX00+MDwvT1RIRVJfTT48T1RIRVJfQT4wPC9PVEhFUl9BPjwvUEVSTUlTU0lPTlM+PFRZUEU+MDwvVFlQRT48RElTS19UWVBFPjA8L0RJU0tfVFlQRT48UEVSU0lTVEVOVD4wPC9QRVJTSVNURU5UPjxSRUdUSU1F
PjEzODg2MTg5ODE8L1JFR1RJTUU+PFNPVVJDRT48L1NPVVJDRT48UEFUSD5odHRwOi8vbWFya2V0cGxhY2UuYzEyZy5jb20vYXBwbGlhbmNlLzUxZjJhMDlmOGZiODFkNGQxOTAwMDAwNC9kb3dubG9hZDwvUEFUSD48RlNU
WVBFPjwvRlNUWVBFPjxTSVpFPjgzPC9TSVpFPjxTVEFURT40PC9TVEFURT48UlVOTklOR19WTVM+MDwvUlVOTklOR19WTVM+PENMT05JTkdfT1BTPjA8L0NMT05JTkdfT1BTPjxDTE9OSU5HX0lEPi0xPC9DTE9OSU5HX0lE
PjxEQVRBU1RPUkVfSUQ+MTwvREFUQVNUT1JFX0lEPjxEQVRBU1RPUkU+ZGVmYXVsdDwvREFUQVNUT1JFPjxWTVM+PC9WTVM+PENMT05FUz48L0NMT05FUz48VEVNUExBVEU+PERFVl9QUkVGSVg+PCFbQ0RBVEFbaGRdXT48
L0RFVl9QUkVGSVg+PERSSVZFUj48IVtDREFUQVtyYXddXT48L0RSSVZFUj48TUQ1PjwhW0NEQVRBWzc4ZDQ2ZjU1MTZjMDhlMGQ5NmE4ZGM5MmFhMjZjODM4XV0+PC9NRDU+PFNIQTE+PCFbQ0RBVEFbYTJhNTM4MDI3ZDVm
OWY5ZmNiYmFkNmM4YWRhZDNmNjdkMmRlNTI0Ml1dPjwvU0hBMT48L1RFTVBMQVRFPjwvSU1BR0U+PERBVEFTVE9SRT48SUQ+MTwvSUQ+PFVJRD4wPC9VSUQ+PEdJRD4wPC9HSUQ+PFVOQU1FPm9uZWFkbWluPC9VTkFNRT48
R05BTUU+b25lYWRtaW48L0dOQU1FPjxOQU1FPmRlZmF1bHQ8L05BTUU+PFBFUk1JU1NJT05TPjxPV05FUl9VPjE8L09XTkVSX1U+PE9XTkVSX00+MTwvT1dORVJfTT48T1dORVJfQT4wPC9PV05FUl9BPjxHUk9VUF9VPjE8
L0dST1VQX1U+PEdST1VQX00+MTwvR1JPVVBfTT48R1JPVVBfQT4wPC9HUk9VUF9BPjxPVEhFUl9VPjE8L09USEVSX1U+PE9USEVSX00+MTwvT1RIRVJfTT48T1RIRVJfQT4wPC9PVEhFUl9BPjwvUEVSTUlTU0lPTlM+PERT
X01BRD5mczwvRFNfTUFEPjxUTV9NQUQ+c2hhcmVkPC9UTV9NQUQ+PEJBU0VfUEFUSD4vdmFyL2xpYi9vbmUvZGF0YXN0b3Jlcy8xPC9CQVNFX1BBVEg+PFRZUEU+MDwvVFlQRT48RElTS19UWVBFPjA8L0RJU0tfVFlQRT48
Q0xVU1RFUl9JRD4tMTwvQ0xVU1RFUl9JRD48Q0xVU1RFUj48L0NMVVNURVI+PFRPVEFMX01CPjEwMDc5PC9UT1RBTF9NQj48RlJFRV9NQj42NzQ3PC9GUkVFX01CPjxVU0VEX01CPjEzODU8L1VTRURfTUI+PElNQUdFUz48
SUQ+MDwvSUQ+PElEPjk8L0lEPjxJRD4xMDwvSUQ+PC9JTUFHRVM+PFRFTVBMQVRFPjxDTE9ORV9UQVJHRVQ+PCFbQ0RBVEFbU1lTVEVNXV0+PC9DTE9ORV9UQVJHRVQ+PERTX01BRD48IVtDREFUQVtmc11dPjwvRFNfTUFE
PjxMTl9UQVJHRVQ+PCFbQ0RBVEFbTk9ORV1dPjwvTE5fVEFSR0VUPjxTQUZFX0RJUlM+PCFbQ0RBVEFbL11dPjwvU0FGRV9ESVJTPjxUTV9NQUQ+PCFbQ0RBVEFbc2hhcmVkXV0+PC9UTV9NQUQ+PFRZUEU+PCFbQ0RBVEFb
SU1BR0VfRFNdXT48L1RZUEU+PC9URU1QTEFURT48L0RBVEFTVE9SRT48L0RTX0RSSVZFUl9BQ1RJT05fREFUQT4=
11
Thu Jan  2 00:32:15 2014 [ImM][I]: cp: Downloading
http://marketplace.c12g.com/appliance/51f2a09f8fb81d4d19000004/download to
the image repository
Thu Jan  2 00:32:15 2014 [ImM][E]: cp: Command
"/var/lib/one/remotes/datastore/fs/../downloader.sh --md5
78d46f5516c08e0d96a8dc92aa26c838 --sha1 a2a538027d5f9f9fcbbad6c
8adad3f67d2de5242
http://marketplace.c12g.com/appliance/51f2a09f8fb81d4d19000004/download
/var/lib/one/datastores/1/b009532933650d5448fced7e3ac6f1d1"
failed: Hash does
not match
Thu Jan  2 00:32:15 2014 [ImM][E]: Error downloading
http://marketplace.c12g.com/appliance/51f2a09f8fb81d4d19000004/download
Thu Jan  2 00:32:15 2014 [ImM][I]: ExitCode: 255
Thu Jan  2 00:32:15 2014 [ImM][E]: Error copying image in the datastore:
Error downloading
http://marketplace.c12g.com/appliance/51f2a09f8fb81d4d19000004/download
Thu Jan  2 00:32:15 2014 [InM][D]: Monitoring datastore default (1)
Thu Jan  2 00:32:15 2014 [ImM][D]: Datastore default (1) successfully
monitored.
Thu Jan  2 00:32:16 2014 [ImM][D]: Datastore system (0) successfully
monitored.
Thu Jan  2 00:32:16 2014 [InM][D]: Host one-sandbox (1) successfully
monitored.



*(While uploading ISO)*

Thu Jan  2 00:45:16 2014 [ImM][D]: Datastore default (1) successfully
monitored.
Thu Jan  2 00:45:16 2014 [ImM][I]: Command execution fail:
/var/lib/one/remotes/datastore/fs/cp
PERTX0RSSVZFUl9BQ1RJT05fREFUQT48SU1BR0U+PElEPjEyPC9JRD48VUlEPjA8L1VJRD48
R0lEPjA8L0dJRD48VU5BTUU+b25lYWRtaW48L1VOQU1FPjxHTkFNRT5vbmVhZG1pbjwvR05BTUU+PE5BTUU+Q2VudG9zIDYuNCBJc288L05BTUU+PFBFUk1JU1NJT05TPjxPV05FUl9VPjE8L09XTkVSX1U+PE9XTkVSX00+
MTwvT1dORVJfTT48T1dORVJfQT4wPC9PV05FUl9BPjxHUk9VUF9VPjA8L0dST1VQX1U+PEdST1VQX00+MDwvR1JPVVBfTT48R1JPVVBfQT4wPC9HUk9VUF9BPjxPVEhFUl9VPjA8L09USEVSX1U+PE9USEVSX00+MDwvT1RI
RVJfTT48T1RIRVJfQT4wPC9PVEhFUl9BPjwvUEVSTUlTU0lPTlM+PFRZUEU+MTwvVFlQRT48RElTS19UWVBFPjA8L0RJU0tfVFlQRT48UEVSU0lTVEVOVD4wPC9QRVJTSVNURU5UPjxSRUdUSU1FPjEzODg2MTk5MDQ8L1JF
R1RJTUU+PFNPVVJDRT48L1NPVVJDRT48UEFUSD4vdmFyL3RtcC90aGluLWJvZHkyMDE0MDEwMi0xNjk5LTdkMTZrOS0wPC9QQVRIPjxGU1RZUEU+PC9GU1RZUEU+PFNJWkU+NzAyPC9TSVpFPjxTVEFURT40PC9TVEFURT48
UlVOTklOR19WTVM+MDwvUlVOTklOR19WTVM+PENMT05JTkdfT1BTPjA8L0NMT05JTkdfT1BTPjxDTE9OSU5HX0lEPi0xPC9DTE9OSU5HX0lEPjxEQVRBU1RPUkVfSUQ+MTwvREFUQVNUT1JFX0lEPjxEQVRBU1RPUkU+ZGVm
YXVsdDwvREFUQVNUT1JFPjxWTVM+PC9WTVM+PENMT05FUz48L0NMT05FUz48VEVNUExBVEU+PERFVl9QUkVGSVg+PCFbQ0RBVEFbaGRdXT48L0RFVl9QUkVGSVg+PERSSVZFUj48IVtDREFUQVtyYXddXT48L0RSSVZFUj48
TUQ1PjwhW0NEQVRBWzc4ZDQ2ZjU1MTZjMDhlMGQ5NmE4ZGM5MmFhMjZjODM4XV0+PC9NRDU+PFNIQTE+PCFbQ0RBVEFbYTJhNTM4MDI3ZDVmOWY5ZmNiYmFkNmM4YWRhZDNmNjdkMmRlNTI0Ml1dPjwvU0hBMT48L1RFTVBM
QVRFPjwvSU1BR0U+PERBVEFTVE9SRT48SUQ+MTwvSUQ+PFVJRD4wPC9VSUQ+PEdJRD4wPC9HSUQ+PFVOQU1FPm9uZWFkbWluPC9VTkFNRT48R05BTUU+b25lYWRtaW48L0dOQU1FPjxOQU1FPmRlZmF1bHQ8L05BTUU+PFBF
Uk1JU1NJT05TPjxPV05FUl9VPjE8L09XTkVSX1U+PE9XTkVSX00+MTwvT1dORVJfTT48T1dORVJfQT4wPC9PV05FUl9BPjxHUk9VUF9VPjE8L0dST1VQX1U+PEdST1VQX00+MTwvR1JPVVBfTT48R1JPVVBfQT4wPC9HUk9V
UF9BPjxPVEhFUl9VPjE8L09USEVSX1U+PE9USEVSX00+MTwvT1RIRVJfTT48T1RIRVJfQT4wPC9PVEhFUl9BPjwvUEVSTUlTU0lPTlM+PERTX01BRD5mczwvRFNfTUFEPjxUTV9NQUQ+c2hhcmVkPC9UTV9NQUQ+PEJBU0Vf
UEFUSD4vdmFyL2xpYi9vbmUvZGF0YXN0b3Jlcy8xPC9CQVNFX1BBVEg+PFRZUEU+MDwvVFlQRT48RElTS19UWVBFPjA8L0RJU0tfVFlQRT48Q0xVU1RFUl9JRD4tMTwvQ0xVU1RFUl9JRD48Q0xVU1RFUj48L0NMVVNURVI+
PFRPVEFMX01CPjEwMDc5PC9UT1RBTF9NQj48RlJFRV9NQj42MDY2PC9GUkVFX01CPjxVU0VEX01CPjE1ODU8L1VTRURfTUI+PElNQUdFUz48SUQ+MDwvSUQ+PElEPjk8L0lEPjxJRD4xMDwvSUQ+PElEPjExPC9JRD48L0lN
QUdFUz48VEVNUExBVEU+PENMT05FX1RBUkdFVD48IVtDREFUQVtTWVNURU1dXT48L0NMT05FX1RBUkdFVD48RFNfTUFEPjwhW0NEQVRBW2ZzXV0+PC9EU19NQUQ+PExOX1RBUkdFVD48IVtDREFUQVtOT05FXV0+PC9MTl9U
QVJHRVQ+PFNBRkVfRElSUz48IVtDREFUQVsvXV0+PC9TQUZFX0RJUlM+PFRNX01BRD48IVtDREFUQVtzaGFyZWRdXT48L1RNX01BRD48VFlQRT48IVtDREFUQVtJTUFHRV9EU11dPjwvVFlQRT48L1RFTVBMQVRFPjwvREFU
QVNUT1JFPjwvRFNfRFJJVkVSX0FDVElPTl9EQVRBPg== 12
Thu Jan  2 00:45:16 2014 [ImM][I]: cp: Copying local image
/var/tmp/thin-body20140102-1699-7d16k9-0 to the image repository
Thu Jan  2 00:45:16 2014 [ImM][E]: cp: Command
"/var/lib/one/remotes/datastore/fs/../downloader.sh --md5
78d46f5516c08e0d96a8dc92aa26c838 --sha1 a2a538027d5f9f9fcbbad6c
8adad3f67d2de5242 /var/tmp/thin-body20140102-1699-7d16k9-0
/var/lib/one/datastores/1/09d94b3dcc6daa7840fa3e214b2f1b86" failed: Hash
does not match
Thu Jan  2 00:45:16 2014 [ImM][E]: Error copying
/var/tmp/thin-body20140102-1699-7d16k9-0 to
/var/lib/one/datastores/1/09d94b3dcc6daa7840fa3e214b2f1b86
Thu Jan  2 00:45:16 2014 [ImM][I]: ExitCode: 255
Thu Jan  2 00:45:16 2014 [ImM][E]: Error copying image in the datastore:
Error copying /var/tmp/thin-body20140102-1699-7d16k9-0 to
/var/lib/one/datastores/1/09d94b3dcc6
daa7840fa3e214b2f1b86
Thu Jan  2 00:45:16 2014 [InM][D]: Monitoring datastore default (1)
Thu Jan  2 00:45:17 2014 [ImM][D]: Datastore default (1) successfully
monitored.
Thu Jan  2 00:45:21 2014 [ReM][D]: Req:8560 UID:0 ImageInfo invoked, 12


*DATASTORE 1 OUTPUT*

[root at one-sandbox datastores]# ls
0  1  2
[root at one-sandbox datastores]# cd 1
[root at one-sandbox 1]# ls
2637dfdd7d7779633d6af1426c172278  b009532933650d5448fced7e3ac6f1d1
 fc2b4e42e4bd3daa17c8217b9fbad3db
3326aa6ceeebea4fda2f15543d16902b  f5394317d377beaa09fc07697df9ff68
[oneadmin at one-sandbox 1]$ls -lh
total 2.3G
-rw-r--r-- 1 oneadmin oneadmin 702M Jan  2 00:45
09d94b3dcc6daa7840fa3e214b2f1b86
*-rw-r--r-- 1 oneadmin oneadmin 672M Dec  5 07:05
2637dfdd7d7779633d6af1426c172278*
-rw-r--r-- 1 oneadmin oneadmin 672M Dec 15 07:20
3326aa6ceeebea4fda2f15543d16902b
-rw-r--r-- 1 oneadmin oneadmin 201M Jan  2 00:32
b009532933650d5448fced7e3ac6f1d1
-rw-rw---- 1 oneadmin oneadmin  40M Nov 21  2012
f5394317d377beaa09fc07697df9ff68
-rw-r--r-- 1 oneadmin oneadmin 5.1G Dec 15 07:21
fc2b4e42e4bd3daa17c8217b9fbad3db



 *oneimage list*
  ID USER       GROUP      NAME            DATASTORE     SIZE TYPE PER STAT
RVMS
   0 oneadmin   oneadmin   ttylinux        default        40M OS    No used
   1
   9 oneadmin   oneadmin   un 13.10        default       672M CD   Yes used
   1
  10 oneadmin   oneadmin   un 13.10 image  default         5G OS    No used
   1
  11 oneadmin   oneadmin   OpenNebula 4.2  default        83M OS    No err
    0
  12 oneadmin   oneadmin   Centos 6.4 Iso  default       702M CD    No err
    0


Thanks and Regards


On Wed, Jan 8, 2014 at 3:10 PM, Daniel Molina <dmolina at opennebula.org>wrote:

> Hi,
>
> Uploading large files through sunstone is not recommended, and if you do
> so, you should deploy Sunstone on top of Passenger [1]
>
> Cheers
>
> [1]
> http://docs.opennebula.org/stable/advanced_administration/scalability/suns_advance.html?highlight=passenger
>
>
> On 7 January 2014 23:11, kiran ranjane <kiran.ranjane at gmail.com> wrote:
>
>> Hi Daniel,
>>
>> Any findings on this issue from your side.
>>
>> Thanks and regards
>> Kiran Ranjane
>>
>>
>> On Fri, Jan 3, 2014 at 11:21 AM, hansz <hanshizhunjob at 126.com> wrote:
>>
>>>
>>>  Hi ,
>>>> I use opennebula4.2 install on centos6.4 and esxi5.1 ,ruby is 1.8.7
>>>>  when i upload the image (i tar  disk-flat.vmdk(8G) and disk.vmdk  a
>>>> disk.tar.bz2 ,the size of the disk.tar.bz2 is about 3G )
>>>> then i upload the disk.tar.bz2  through the sunstone ,
>>>> even though i run oneimage list as the oneadmin it show the image is
>>>> rdy  ,but on the sunstone the images is uploading .
>>>> anything wrong?
>>>>
>>>
>>>> you can have a look the pics
>>>>
>>>>
>>>>
>>>> i use sunstone stop but could not kill the pid ,i must kill the id
>>>>  Manual
>>>>
>>>
>>>
>>>
>>> _______________________________________________
>>> Users mailing list
>>> Users at lists.opennebula.org
>>> http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
>>>
>>>
>>
>
>
> --
> --
> Daniel Molina
> Project Engineer
> OpenNebula - Flexible Enterprise Cloud Made Simple
> www.OpenNebula.org | dmolina at opennebula.org | @OpenNebula
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.opennebula.org/pipermail/users-opennebula.org/attachments/20140108/9a27d266/attachment-0002.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/png
Size: 101123 bytes
Desc: not available
URL: <http://lists.opennebula.org/pipermail/users-opennebula.org/attachments/20140108/9a27d266/attachment-0004.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/png
Size: 27168 bytes
Desc: not available
URL: <http://lists.opennebula.org/pipermail/users-opennebula.org/attachments/20140108/9a27d266/attachment-0005.png>


More information about the Users mailing list