[one-users] econe-server problems with 3.2.1

Daniel Molina dmolina at opennebula.org
Wed Feb 8 03:17:04 PST 2012


On 8 February 2012 08:57, Ulrich Schwickerath
<ulrich.schwickerath at cern.ch> wrote:
> Hi,  Ruben,
>
> I confirm I get the same timing when I do NOT use the SSL proxy:
>
> (...)
>
> r> <td>rack.url_scheme</td> <td class="code"><div>http</div></td> </tr> <tr>
> <td>rack.version</td> <td class="code"><div>[1, 0]</div></td> </tr> <tr>
> <td>sinatra.error</td> <td class="code"><div>#<NoMethodError: undefined
> method `[]' for nil:NilClass></div></td> </tr> </table> <div
> class="clear"></div> </div> <!-- /RACK ENV --> <p id="explanation">You're
> seeing this error because you haveenabled the <code>show_exceptions</code>
> setting.</p> </div> <!-- /WRAP --> </body></html>
>
> real    1m8.893s
> user    0m0.263s
> sys     0m0.051s
> [lsfadmin at lxadm10 private]$ euca-describe-images
>
> IMAGE   ami-00000023    glExecWN_slc5_x86_64_kvm        lsfadmin
>  available       private         i386    machine
> IMAGE   ami-00000024    glExecWN_slc6_x86_64_kvm        lsfadmin
>  available       private         i386    machine
> [lsfadmin at lxadm10 private]$ echo $EC2_URL
> http://oneadmin02.cern.ch:4567
>
> I have something else which is strange: there are 2 VMs in my list which do
> not have a "state" defined. I cannot delete them either:
>
>  $ onevm list | grep -v runn
>    ID USER     GROUP    NAME         STAT CPU     MEM        HOSTNAME
>  TIME
>  22976 lsfadmin batch    LXBATCH             0      0K lxbst0541.cern. 02
> 14:12:07
>  23467 lsfadmin batch    LXBATCH             0      0K lxbst0511.cern. 00
> 04:33:07
> $ onevm delete 22976
> $ onevm delete 23467
> $ onevm list | grep -v runn
>    ID USER     GROUP    NAME         STAT CPU     MEM        HOSTNAME
>  TIME
>  22976 lsfadmin batch    LXBATCH             0      0K lxbst0541.cern. 02
> 14:12:23
>  23467 lsfadmin batch    LXBATCH             0      0K lxbst0511.cern. 00
> 04:33:23
>
> Now I wonder if that might be related... I suppose I will need to
> micky-mouse in my mysql ddb to get rid of those?
>

Would you mind to send the output of
* onevm show 22976 -x
* SELECT * FROM vm_pool WHERE oid=22976;

Maybe that is the root of the problem.

I have just written this patch which improves the describe_instances
performance, it is not thoroughly tested but if it works I will
prepare a commit and will upload it to the master branch:
https://gist.github.com/aee5654cbe0b44bbbd51

Cheers.



> Thanks a lot for your support!
>
> Cheers,
> Ulrich
>
>
>
> On 02/07/2012 10:50 PM, Ruben S. Montero wrote:
>>
>> Hi Ulrich
>>
>> Those in the log are not error messages but log messages. If you take
>> a look they log a HTTP 200 return code (SUCCESS). process in 0.8 secs.
>>
>> Could you confirm the times accessing directly the econe-server... We
>> believe this is a configuration issue, as we can not reproduce this.
>> Please also *do not* revert the patches from Daniel
>>
>> Thanks
>>
>> Ruben
>>
>> On Mon, Feb 6, 2012 at 5:43 PM, Ulrich Schwickerath
>> <ulrich.schwickerath at cern.ch>  wrote:
>>>
>>> Hi,
>>>
>>> sure. I've changed
>>> #:server: localhost
>>> :server: oneadmin02.cern.ch
>>> :port: 4567
>>>
>>> #SSL Proxy
>>> #:ssl_server: https://oneadmin02.cern.ch:8443/
>>>
>>> in /etc/one/econe.conf and restarted the server. Then I changed
>>> export EC2_URL=http://oneadmin02.cern.ch:4567
>>>
>>> Access works:
>>> $ euca-describe-images
>>> IMAGE   ami-00000023    glExecWN_slc5_x86_64_kvm        lsfadmin
>>>  available       private         i386    machine
>>> IMAGE   ami-00000024    glExecWN_slc6_x86_64_kvm        lsfadmin
>>>  available       private         i386    machine
>>>
>>> which gives
>>> [root at oneadmin02 ~]# cat  /var/log/one/econe-server.log
>>> --------------------------------------
>>>         Server configuration
>>> --------------------------------------
>>> {:template_location=>"/etc/one/ec2query_templates",
>>>  :views=>"/usr/lib/one/ruby/cloud/econe/views",
>>>  :instance_types=>
>>>  {:"batchslc5.small"=>{:template=>"batchslc5.small.erb"},
>>>   :"m1.small"=>{:template=>"m1.small.erb"},
>>>   :"batchslc5.medium"=>{:template=>"batchslc5.medium.erb"},
>>>   :"m1.medium"=>{:template=>"m1.medium.erb"},
>>>   :"batchslc5.large"=>{:template=>"batchslc5.large.erb"},
>>>   :"m1.large"=>{:template=>"m1.large.erb"},
>>>   :"batchslc6.small"=>{:template=>"batchslc6.small.erb"},
>>>   :"m1.xlarge"=>{:template=>"m1.xlarge.erb"},
>>>   :"batchslc6.medium"=>{:template=>"batchslc6.medium.erb"},
>>>   :"m1.huge"=>{:template=>"m1.huge.erb"},
>>>   :"batchslc6.large"=>{:template=>"batchslc6.large.erb"}},
>>>  :auth=>"ec2",
>>>  :one_xmlrpc=>"http://localhost:2633/RPC2",
>>>  :core_auth=>"cipher",
>>>  :server=>"oneadmin02.cern.ch",
>>>  :port=>4567}
>>> 137.138.5.252 - - [06/Feb/2012 17:35:30] "POST / HTTP/1.1" 200 742 0.8725
>>> 137.138.5.252 - - [06/Feb/2012 17:35:30] "POST / HTTP/1.1" 200 742 0.7949
>>>
>>> NoMethodError - undefined method `[]' for nil:NilClass:
>>>  /usr/lib/one/ruby/cloud/econe/EC2QueryServer.rb:216:in `render_state'
>>>  (erb):20:in `describe_instances'
>>>  /usr/lib/one/ruby/OpenNebula/XMLUtils.rb:326:in `call'
>>>  /usr/lib/one/ruby/OpenNebula/XMLUtils.rb:326:in `each_element'
>>>
>>>  /usr/lib/ruby/gems/1.8/gems/nokogiri-1.4.3.1/lib/nokogiri/xml/node_set.rb:239:in
>>> `each'
>>>
>>>  /usr/lib/ruby/gems/1.8/gems/nokogiri-1.4.3.1/lib/nokogiri/xml/node_set.rb:238:in
>>> `upto'
>>>
>>>  /usr/lib/ruby/gems/1.8/gems/nokogiri-1.4.3.1/lib/nokogiri/xml/node_set.rb:238:in
>>> `each'
>>>  /usr/lib/one/ruby/OpenNebula/XMLUtils.rb:324:in `each_element'
>>>  /usr/lib/one/ruby/OpenNebula/Pool.rb:100:in `each'
>>>  (erb):14:in `describe_instances'
>>>  /usr/lib/one/ruby/cloud/econe/EC2QueryServer.rb:181:in
>>> `describe_instances'
>>>  /usr/lib/one/ruby/cloud/econe/econe-server.rb:176:in `do_http_request'
>>>  /usr/lib/one/ruby/cloud/econe/econe-server.rb:158:in `POST /'
>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:1151:in
>>> `call'
>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:1151:in
>>> `compile!'
>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:724:in
>>> `instance_eval'
>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:724:in
>>> `route_eval'
>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:708:in
>>> `route!'
>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:758:in
>>> `process_route'
>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:755:in
>>> `catch'
>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:755:in
>>> `process_route'
>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:707:in
>>> `route!'
>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:706:in
>>> `each'
>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:706:in
>>> `route!'
>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:843:in
>>> `dispatch!'
>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:644:in
>>> `call!'
>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:808:in
>>> `instance_eval'
>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:808:in
>>> `invoke'
>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:808:in
>>> `catch'
>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:808:in
>>> `invoke'
>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:644:in
>>> `call!'
>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:629:in
>>> `call'
>>>  /usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/head.rb:9:in `call'
>>>  /usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/commonlogger.rb:18:in
>>> `call'
>>>
>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/showexceptions.rb:21:in
>>> `call'
>>>  /usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/methodoverride.rb:24:in
>>> `call'
>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:1272:in
>>> `call'
>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:1303:in
>>> `synchronize'
>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:1272:in
>>> `call'
>>>  /usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/content_length.rb:13:in
>>> `call'
>>>  /usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/chunked.rb:15:in `call'
>>>  /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/connection.rb:84:in
>>> `pre_process'
>>>  /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/connection.rb:82:in
>>> `catch'
>>>  /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/connection.rb:82:in
>>> `pre_process'
>>>  /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/connection.rb:57:in
>>> `process'
>>>  /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/connection.rb:42:in
>>> `receive_data'
>>>
>>>  /usr/lib/ruby/gems/1.8/gems/eventmachine-0.12.10/lib/eventmachine.rb:256:in
>>> `run_machine'
>>>
>>>  /usr/lib/ruby/gems/1.8/gems/eventmachine-0.12.10/lib/eventmachine.rb:256:in
>>> `run'
>>>  /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/backends/base.rb:61:in
>>> `start'
>>>  /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/server.rb:159:in `start'
>>>  /usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/handler/thin.rb:14:in
>>> `run'
>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:1234:in
>>> `run!'
>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/main.rb:25
>>>  /usr/lib/one/ruby/cloud/econe/econe-server.rb:165
>>>
>>> Weird. These errors are actually new. I didn't have them right after the
>>> upgrade last week when I was mentioning the long response times.
>>>
>>> One thing that might give a clue: I have a cron job which queries the
>>> system
>>> and counts the number of running VMs. If not all leases are full,
>>> some new batch VMs are started. This  "sometimes" seems to work, however,
>>> if
>>> it does not or if it takes too long to respond, there are concurrent
>>> queries
>>> to the system (from up to 3 different client machines).
>>>
>>>  From the output above I don't think the SSL proxy is causing the
>>> problem.
>>> Could it be that one of my gems is too old or buggy ?
>>>
>>> Thanks for your help!
>>> Ulrich
>>>
>>>
>>>
>>>
>>> On 02/06/2012 04:33 PM, Ruben S. Montero wrote:
>>>>
>>>> Hi
>>>>
>>>> Could you try interacting directly with the server (i.e. without the
>>>> proxy part?). We are not able to reproduce this.. The server makes a
>>>> call equivalent to a onevm list and returns the output, in our
>>>> installation with ~500 VMs we are seeing a 1s overhead because of the
>>>> HTTP process. But the overall response time is<    2s for the EC2
>>>> interface and<1s from the CLI.
>>>>
>>>> Cheers
>>>>
>>>> Ruben
>>>>
>>>> On Mon, Feb 6, 2012 at 11:42 AM, Ulrich Schwickerath
>>>> <ulrich.schwickerath at cern.ch>    wrote:
>>>>>
>>>>> Hi, all,
>>>>>
>>>>> we are still experiencing problems after the upgrade to ONE3.2.1. The
>>>>> EC2
>>>>> access is very very slow and unstable. This morning, I noticed a lot of
>>>>> blocked requests to econe, and error message in the econe-server log
>>>>> files:
>>>>>
>>>>>
>>>>> NoMethodError - undefined method `[]' for nil:NilClass:
>>>>>  /usr/lib/one/ruby/cloud/econe/EC2QueryServer.rb:216:in `render_state'
>>>>>  (erb):20:in `describe_instances'
>>>>>  /usr/lib/one/ruby/OpenNebula/XMLUtils.rb:326:in `call'
>>>>>  /usr/lib/one/ruby/OpenNebula/XMLUtils.rb:326:in `each_element'
>>>>>
>>>>>
>>>>>  /usr/lib/ruby/gems/1.8/gems/nokogiri-1.4.3.1/lib/nokogiri/xml/node_set.rb:239:in
>>>>> `each'
>>>>>
>>>>>
>>>>>  /usr/lib/ruby/gems/1.8/gems/nokogiri-1.4.3.1/lib/nokogiri/xml/node_set.rb:238:in
>>>>> `upto'
>>>>>
>>>>>
>>>>>  /usr/lib/ruby/gems/1.8/gems/nokogiri-1.4.3.1/lib/nokogiri/xml/node_set.rb:238:in
>>>>> `each'
>>>>>  /usr/lib/one/ruby/OpenNebula/XMLUtils.rb:324:in `each_element'
>>>>>  /usr/lib/one/ruby/OpenNebula/Pool.rb:100:in `each'
>>>>>  (erb):14:in `describe_instances'
>>>>>  /usr/lib/one/ruby/cloud/econe/EC2QueryServer.rb:181:in
>>>>> `describe_instances'
>>>>>  /usr/lib/one/ruby/cloud/econe/econe-server.rb:176:in `do_http_request'
>>>>>  /usr/lib/one/ruby/cloud/econe/econe-server.rb:158:in `POST /'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:1151:in
>>>>> `call'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:1151:in
>>>>> `compile!'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:724:in
>>>>> `instance_eval'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:724:in
>>>>> `route_eval'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:708:in
>>>>> `route!'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:758:in
>>>>> `process_route'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:755:in
>>>>> `catch'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:755:in
>>>>> `process_route'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:707:in
>>>>> `route!'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:706:in
>>>>> `each'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:706:in
>>>>> `route!'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:843:in
>>>>> `dispatch!'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:644:in
>>>>> `call!'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:808:in
>>>>> `instance_eval'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:808:in
>>>>> `invoke'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:808:in
>>>>> `catch'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:808:in
>>>>> `invoke'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:644:in
>>>>> `call!'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:629:in
>>>>> `call'
>>>>>  /usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/head.rb:9:in `call'
>>>>>  /usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/commonlogger.rb:18:in
>>>>> `call'
>>>>>
>>>>>
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/showexceptions.rb:21:in
>>>>> `call'
>>>>>
>>>>>  /usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/methodoverride.rb:24:in
>>>>> `call'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:1272:in
>>>>> `call'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:1303:in
>>>>> `synchronize'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:1272:in
>>>>> `call'
>>>>>
>>>>>  /usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/content_length.rb:13:in
>>>>> `call'
>>>>>  /usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/chunked.rb:15:in
>>>>> `call'
>>>>>  /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/connection.rb:84:in
>>>>> `pre_process'
>>>>>  /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/connection.rb:82:in
>>>>> `catch'
>>>>>  /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/connection.rb:82:in
>>>>> `pre_process'
>>>>>  /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/connection.rb:57:in
>>>>> `process'
>>>>>  /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/connection.rb:42:in
>>>>> `receive_data'
>>>>>
>>>>>
>>>>>  /usr/lib/ruby/gems/1.8/gems/eventmachine-0.12.10/lib/eventmachine.rb:256:in
>>>>> `run_machine'
>>>>>
>>>>>
>>>>>  /usr/lib/ruby/gems/1.8/gems/eventmachine-0.12.10/lib/eventmachine.rb:256:in
>>>>> `run'
>>>>>  /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/backends/base.rb:61:in
>>>>> `start'
>>>>>  /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/server.rb:159:in
>>>>> `start'
>>>>>  /usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/handler/thin.rb:14:in
>>>>> `run'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:1234:in
>>>>> `run!'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/main.rb:25
>>>>>  /usr/lib/one/ruby/cloud/econe/econe-server.rb:165
>>>>> NoMethodError - undefined method `[]' for nil:NilClass:
>>>>>  /usr/lib/one/ruby/cloud/econe/EC2QueryServer.rb:216:in `render_state'
>>>>>  (erb):20:in `describe_instances'
>>>>>  /usr/lib/one/ruby/OpenNebula/XMLUtils.rb:326:in `call'
>>>>>  /usr/lib/one/ruby/OpenNebula/XMLUtils.rb:326:in `each_element'
>>>>>
>>>>>
>>>>>  /usr/lib/ruby/gems/1.8/gems/nokogiri-1.4.3.1/lib/nokogiri/xml/node_set.rb:239:in
>>>>> `each'
>>>>>
>>>>>
>>>>>  /usr/lib/ruby/gems/1.8/gems/nokogiri-1.4.3.1/lib/nokogiri/xml/node_set.rb:238:in
>>>>> `upto'
>>>>>
>>>>>
>>>>>  /usr/lib/ruby/gems/1.8/gems/nokogiri-1.4.3.1/lib/nokogiri/xml/node_set.rb:238:in
>>>>> `each'
>>>>>  /usr/lib/one/ruby/OpenNebula/XMLUtils.rb:324:in `each_element'
>>>>>  /usr/lib/one/ruby/OpenNebula/Pool.rb:100:in `each'
>>>>>  (erb):14:in `describe_instances'
>>>>>  /usr/lib/one/ruby/cloud/econe/EC2QueryServer.rb:181:in
>>>>> `describe_instances'
>>>>>  /usr/lib/one/ruby/cloud/econe/econe-server.rb:176:in `do_http_request'
>>>>>  /usr/lib/one/ruby/cloud/econe/econe-server.rb:158:in `POST /'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:1151:in
>>>>> `call'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:1151:in
>>>>> `compile!'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:724:in
>>>>> `instance_eval'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:724:in
>>>>> `route_eval'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:708:in
>>>>> `route!'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:758:in
>>>>> `process_route'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:755:in
>>>>> `catch'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:755:in
>>>>> `process_route'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:707:in
>>>>> `route!'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:706:in
>>>>> `each'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:706:in
>>>>> `route!'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:843:in
>>>>> `dispatch!'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:644:in
>>>>> `call!'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:808:in
>>>>> `instance_eval'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:808:in
>>>>> `invoke'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:808:in
>>>>> `catch'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:808:in
>>>>> `invoke'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:644:in
>>>>> `call!'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:629:in
>>>>> `call'
>>>>>  /usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/head.rb:9:in `call'
>>>>>  /usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/commonlogger.rb:18:in
>>>>> `call'
>>>>>
>>>>>
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/showexceptions.rb:21:in
>>>>> `call'
>>>>>
>>>>>  /usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/methodoverride.rb:24:in
>>>>> `call'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:1272:in
>>>>> `call'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:1303:in
>>>>> `synchronize'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:1272:in
>>>>> `call'
>>>>>
>>>>>  /usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/content_length.rb:13:in
>>>>> `call'
>>>>>  /usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/chunked.rb:15:in
>>>>> `call'
>>>>>  /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/connection.rb:84:in
>>>>> `pre_process'
>>>>>  /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/connection.rb:82:in
>>>>> `catch'
>>>>>  /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/connection.rb:82:in
>>>>> `pre_process'
>>>>>  /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/connection.rb:57:in
>>>>> `process'
>>>>>  /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/connection.rb:42:in
>>>>> `receive_data'
>>>>>
>>>>>
>>>>>  /usr/lib/ruby/gems/1.8/gems/eventmachine-0.12.10/lib/eventmachine.rb:256:in
>>>>> `run_machine'
>>>>>
>>>>>
>>>>>  /usr/lib/ruby/gems/1.8/gems/eventmachine-0.12.10/lib/eventmachine.rb:256:in
>>>>> `run'
>>>>>  /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/backends/base.rb:61:in
>>>>> `start'
>>>>>  /usr/lib/ruby/gems/1.8/gems/thin-1.2.8/lib/thin/server.rb:159:in
>>>>> `start'
>>>>>  /usr/lib/ruby/gems/1.8/gems/rack-1.1.0/lib/rack/handler/thin.rb:14:in
>>>>> `run'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/base.rb:1234:in
>>>>> `run!'
>>>>>  /usr/lib/ruby/gems/1.8/gems/sinatra-1.2.6/lib/sinatra/main.rb:25
>>>>>  /usr/lib/one/ruby/cloud/econe/econe-server.rb:165
>>>>>
>>>>> What I mean with slow is that to get a list of O(400) virtual machines
>>>>> the
>>>>> system needs O(5-10) minutes while local queries with onevm list take
>>>>> ~2
>>>>> seconds.
>>>>>
>>>>> We are currently bitten badly by this problem because we use this to
>>>>> refill
>>>>> our virtual batch farm. Is there a downgrade path ?
>>>>>
>>>>> Any idea ?
>>>>>
>>>>> Thanks,
>>>>> Ulrich
>>>>>
>>>>> --
>>>>> --------------------------------------
>>>>> Dr. Ulrich Schwickerath
>>>>> CERN IT/PES-PS
>>>>> 1211 Geneva 23
>>>>> e-mail: ulrich.schwickerath at cern.ch
>>>>> phone:   +41 22 767 9576
>>>>> mobile:  +41 76 487 5602
>>>>>
>>>>> _______________________________________________
>>>>> Users mailing list
>>>>> Users at lists.opennebula.org
>>>>> http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
>>>>
>>>>
>>>>
>>>
>>> --
>>> --------------------------------------
>>> Dr. Ulrich Schwickerath
>>> CERN IT/PES-PS
>>> 1211 Geneva 23
>>> e-mail: ulrich.schwickerath at cern.ch
>>> phone:   +41 22 767 9576
>>> mobile:  +41 76 487 5602
>>>
>>
>>
>
>
> --
> --------------------------------------
> Dr. Ulrich Schwickerath
> CERN IT/PES-PS
> 1211 Geneva 23
> e-mail: ulrich.schwickerath at cern.ch
> phone:   +41 22 767 9576
> mobile:  +41 76 487 5602
>
> _______________________________________________
> Users mailing list
> Users at lists.opennebula.org
> http://lists.opennebula.org/listinfo.cgi/users-opennebula.org



-- 
Daniel Molina
Project Engineer
OpenNebula - The Open Source Toolkit for Data Center Virtualization
www.OpenNebula.org | dmolina at opennebula.org | @OpenNebula



More information about the Users mailing list