[one-users] EC2 testing

sebastien goasguen sebgoa at clemson.edu
Sun Sep 20 18:54:33 PDT 2009


If you have the latest opennebula from svn, try to do:

econe-upload -M test.img

it will use a multipart upload without using curb...which is the problem.



On Sun, Sep 20, 2009 at 12:54 PM, Rogier Mars <rogier at fortytwo.nl> wrote:
> Hi,
>
> I got the same problem.
>
> First I got the following error:
> [rogierm at cloudtest3 one]$ econe-upload /home/rogierm/test.img
> /usr/lib/ruby/1.8/rdoc/ri/ri_options.rb:53: uninitialized constant RI::Paths
> (NameError)
>        from /usr/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:31:in
> `gem_original_require'
>        from /usr/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:31:in
> `require'
>        from /usr/lib/ruby/1.8/rdoc/usage.rb:72
>        from /usr/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:31:in
> `gem_original_require'
>        from /usr/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:31:in
> `require'
>        from /usr/local/one/bin/econe-upload:61
>
> I fixed this by adding the following line in econe-upload:
> require 'rdoc/ri/ri_paths'
>
> After this change I got the following error when trying to upload an image:
>
> [rogierm at cloudtest3 one]$ econe-upload /home/rogierm/test.img
> /usr/local/one/lib/ruby/econe/EC2QueryClient.rb:164:in `http_post': server
> returned nothing (no headers, no data) (Curl::Err::GotNothingError)
>        from /usr/local/one/lib/ruby/econe/EC2QueryClient.rb:164:in
> `upload_image'
>        from /usr/local/one/bin/econe-upload:114
> [rogierm at cloudtest3 one]$
>
> I have the following gems installed:
> [rogierm at cloudtest3 one]$ gem list
>
> *** LOCAL GEMS ***
>
> amazon-ec2 (0.5.5)
> cgi_multipart_eof_fix (2.5.0)
> curb (0.5.1.0)
> daemons (1.0.10)
> eventmachine (0.12.8)
> macaddr (1.0.0)
> mkrf (0.2.3)
> nokogiri (1.3.3)
> rack (1.0.0)
> rake (0.8.7)
> sequel (3.4.0)
> sinatra (0.9.4)
> sqlite3-ruby (1.2.4)
> thin (1.2.4)
> uuid (2.0.2)
> xml-simple (1.0.12)
> xmlparser (0.6.81)
>
>
> The server runs CentOS 5 with ruby 1.8.5 (2006-08-25) [i386-linux] installed
> via yum.
>
> I installed the code from the SVN repository.
>
> Another strange thing I noticed is that the econe.log file only gets written
> after I kill the econe-server process.
>
> When I kill the server the following entry gets written in the log file:
>
> #<OcaConfiguration:0xb7c02774
>  @conf=
>  {"VM_TYPE"=>{"NAME"=>"m1.small", "TEMPLATE"=>"m1.small.erb"},
>   "USER"=>"oneadmin",
>   "DATABASE"=>"/usr/local/one/var/econe.db",
>   "PORT"=>"4567",
>   "SERVER"=>"cloudtest3.xxx.xx",
>   "ONE_XMLRPC"=>"http://localhost:2633/RPC2",
>   "IMAGE_DIR"=>"/usr/local/one/images/",
>   "PASSWORD"=>"XXXXX"}>
> {"m1.small"=>{"NAME"=>"m1.small", "TEMPLATE"=>"m1.small.erb"}}
> == Sinatra/0.9.4 has taken the stage on 4567 for development with backup
> from Thin
>>> Thin web server (v1.2.4 codename Flaming Astroboy)
>>> Maximum connections set to 1024
>>> Listening on cloudtest3.redbee.nl:4567, CTRL+C to stop
>>> Stopping ...
>
> When I start econe-server only one line gets written to the logfile:
> ** Ruby version is not up-to-date; loading cgi_multipart_eof_fix
>
> Can you point me in the right direction?
>
> Thanks,
>
> Rogier
>
> On Sep 10, 2009, at 8:10 PM, Javier Fontan wrote:
>
>> Hello,
>>
>> Try to execure econe-server without EC2_URL environment set. If that
>> does not fix the problem give me the version of amazon_ec2 ruby
>> library you have installed and I'll try to reproduce it. I got no
>> errors in my tests.
>>
>> Bye
>>
>> On Wed, Sep 9, 2009 at 8:26 PM, sebastien goasguen <sebgoa at clemson.edu>
>> wrote:
>>>
>>> Hi,
>>>
>>> I did not get an answer to this but I found out that the EC2 gem hard
>>> codes valid EC2 hosts, see from EC2.rb:
>>>
>>> if ENV['EC2_URL']
>>>   EC2_URL = ENV['EC2_URL']
>>>   VALID_HOSTS = ['https://ec2.amazonaws.com',
>>> 'https://us-east-1.ec2.amazonaws.com',
>>> 'https://eu-west-1.ec2.amazonaws.com']
>>>   raise ArgumentError, "Invalid EC2_URL environment variable :
>>> #{EC2_URL}" unless VALID_HOSTS.include?(EC2_URL)
>>>   DEFAULT_HOST = URI.parse(EC2_URL).host
>>>  else
>>>   # default US host
>>>   DEFAULT_HOST = 'ec2.amazonaws.com'
>>>  end
>>>
>>>
>>> I hard coded my host in the there and I got the econe server to start
>>> without errors.
>>>
>>> But now I get erros trying upload an image:
>>>
>>> /home/oneadmin/one/lib/ruby/econe/EC2QueryClient.rb:152:in
>>> `http_post': server returned nothing (no headers, no data)
>>> (Curl::Err::GotNothingError)
>>>       from /home/oneadmin/one/lib/ruby/econe/EC2QueryClient.rb:152:in
>>> `upload_image'
>>>       from /home/oneadmin/one/bin/econe-upload:107
>>>
>>> Is this working for someone ?
>>>
>>> Cheers,
>>>
>>> -sebastien
>>>
>>>
>>> On Sun, Sep 6, 2009 at 10:33 PM, sebastien goasguen<runseb at gmail.com>
>>> wrote:
>>>>
>>>> Hi,
>>>>
>>>> I am trying to get the cloud interface running using ec2 query api
>>>> setup.
>>>>
>>>> I checked out the latest openenbual code from svn trunk.
>>>> I upgrade to ruby 1.8.6 (because 1.8.5 gave me errors).
>>>>
>>>> I now can run the econe server, but I get some errors see below:
>>>>
>>>> [oneadmin at lxbrl2302 var]$ econe-describe-images -H
>>>> Owner  ImageId                               Location
>>>>
>>>> ------------------------------------------------------------------------------
>>>> /home/oneadmin/one/bin/econe-describe-images:121: undefined method
>>>> `each' for nil:NilClass (NoMethodError)
>>>>
>>>> [oneadmin at lxbrl2302 var]$ econe-upload /images/cernvm120.img
>>>> /home/oneadmin/one/lib/ruby/econe/EC2QueryClient.rb:152:in
>>>> `http_post': server returned nothing (no headers, no data)
>>>> (Curl::Err::GotNothingError)
>>>>       from /home/oneadmin/one/lib/ruby/econe/EC2QueryClient.rb:152:in
>>>> `upload_image'
>>>>       from /home/oneadmin/one/bin/econe-upload:107
>>>>
>>>> [oneadmin at lxbrl2302 var]$ tail -n 20 econe.log
>>>>       from /usr/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:31:in
>>>> `gem_original_require'
>>>>       from /usr/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:31:in
>>>> `require'
>>>>       from /usr/lib/ruby/gems/1.8/gems/amazon-ec2-0.5.5/lib/AWS.rb:292
>>>>       from
>>>> /usr/lib/ruby/gems/1.8/gems/amazon-ec2-0.5.5/lib/AWS.rb:292:in
>>>> `each'
>>>>       from /usr/lib/ruby/gems/1.8/gems/amazon-ec2-0.5.5/lib/AWS.rb:292
>>>>       from /usr/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:36:in
>>>> `gem_original_require'
>>>>       from /usr/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:36:in
>>>> `require'
>>>>       from /home/oneadmin/one/lib/ruby/econe/eco.rb:19
>>>> /usr/lib/ruby/gems/1.8/gems/amazon-ec2-0.5.5/lib/AWS/EC2.rb:12:
>>>> Invalid EC2_URL environment variable : http://lxbrl2302.cern.ch:4567
>>>> (ArgumentError)
>>>>       from /usr/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:31:in
>>>> `gem_original_require'
>>>>       from /usr/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:31:in
>>>> `require'
>>>>       from /usr/lib/ruby/gems/1.8/gems/amazon-ec2-0.5.5/lib/AWS.rb:292
>>>>       from
>>>> /usr/lib/ruby/gems/1.8/gems/amazon-ec2-0.5.5/lib/AWS.rb:292:in
>>>> `each'
>>>>       from /usr/lib/ruby/gems/1.8/gems/amazon-ec2-0.5.5/lib/AWS.rb:292
>>>>       from /usr/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:36:in
>>>> `gem_original_require'
>>>>       from /usr/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:36:in
>>>> `require'
>>>>       from /home/oneadmin/one/lib/ruby/econe/eco.rb:19
>>>> 128.142.240.27 - - [06/Sep/2009 21:05:27] "POST / HTTP/1.1" 200 138
>>>> 0.0758
>>>> 128.142.240.27 - - [06/Sep/2009 22:12:00] "POST / HTTP/1.1" 401 12
>>>> 0.0571
>>>> 128.142.240.27 - - [06/Sep/2009 22:14:11] "POST / HTTP/1.1" 200 138
>>>> 0.0674
>>>>
>>>> Any thoughts ? Especially on the EC2 env variable argument error ?
>>>>
>>>> -sebastien
>>>>
>>>> --
>>>> ---
>>>> Sebastien Goasguen
>>>> School of Computing
>>>> Clemson University
>>>> 864-656-6753
>>>> http://runseb.googlepages.com
>>>>
>>>
>>>
>>>
>>> --
>>> ---
>>> Sebastien Goasguen
>>> School of Computing
>>> Clemson University
>>> 864-553-4753
>>> http://runseb.googlepages.com
>>> _______________________________________________
>>> Users mailing list
>>> Users at lists.opennebula.org
>>> http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
>>>
>>
>>
>>
>> --
>> Javier Fontan, Grid & Virtualization Technology Engineer/Researcher
>> DSA Research Group: http://dsa-research.org
>> Globus GridWay Metascheduler: http://www.GridWay.org
>> OpenNebula Virtual Infrastructure Engine: http://www.OpenNebula.org
>> _______________________________________________
>> Users mailing list
>> Users at lists.opennebula.org
>> http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
>>
>
> _______________________________________________
> Users mailing list
> Users at lists.opennebula.org
> http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
>



-- 
---
Sebastien Goasguen
School of Computing
Clemson University
864-553-4734
http://runseb.googlepages.com



More information about the Users mailing list