[one-users] Can no longer create new virtual machines

[Gerry O'Brien]

Hello,

     We still run a version of OpenNebula 3.8.3 (we are planning a 
migration to 4.2 soon). The 3.8.3 front end has been running 
successfully for months but was rebooted recently. Since then all 
existing machines continue to run but no new machines can be created 
using either the sunstone or occi servers and remain in PENDING state. 
All logging indicates success (see below for machine ID 4709), but no 
4709 directory gets created in the /datastores/0 directory. It does not 
seem to be a permissions issue as the oneadmin user can create 
directories using shell commands on the front end and on the hosts.  All 
remote ssh are working. Also, users can create virtual disks using the 
self-service interface.

     We have stopped all services, fscked the databases, rebooted, and 
restarted all services.

     We cannot find any failing libvirt/kvm commands.

     Is there any place where we can find more logging when a machines 
is in a PENDING state.

         Regards,
             Gerry




Tue Aug 27 19:14:02 2013 [ReM][D]: Req:480 UID:2 VirtualMachineAllocate 
result SUCCESS, 4790
Tue Aug 27 19:14:02 2013 [ReM][D]: Req:8816 UID:2 VirtualMachineInfo 
invoked, 4790
Tue Aug 27 19:14:02 2013 [ReM][D]: Req:8816 UID:2 VirtualMachineInfo 
result SUCCESS, "<VM><ID>4790</ID><UI..."
Tue Aug 27 19:14:02 2013 [ReM][D]: Req:6624 UID:2 VirtualMachineInfo 
invoked, 4790
Tue Aug 27 19:14:02 2013 [ReM][D]: Req:6624 UID:2 VirtualMachineInfo 
result SUCCESS, "<VM><ID>4790</ID><UI..."

-- 
Gerry O'Brien

Systems Manager
School of Computer Science and Statistics
Trinity College Dublin
Dublin 2
IRELAND

00 353 1 896 1341