[one-users] VM's are going to pending state though enough resources

Carlos Martín Sánchez cmartins at fdi.ucm.es
Mon Aug 2 03:38:11 PDT 2010


Hi Bathina,

Your VM template is requesting 1 physical CPU for exclusive use, and your
host has only 4 available: TCPU is the total percentage of CPU reported by
the host.

That's why your VMs stay in pending state, because the scheduler sees that
your host doesn't have enough CPU resources for the next ones.

Try commenting the "CPU = 1" line in the template. Please note that the CPU
is the physical host's CPU requested, and is different from the number of
Virtual CPUs the guest OS will see. Take a look at the VM template
documentation [1].

Regards,
Carlos

[1] http://www.opennebula.org/documentation:rel1.4:template

Carlos Martín, Cloud Technology Engineer/Researcher
DSA Research Group: web http://dsa-research.org and blog
http://blog.dsa-research.org
OpenNebula Open Source Toolkit for Cloud Computing:
http://www.OpenNebula.org


2010/7/30 bathina nageswararao <nag_bathina at yahoo.com>

> Hi Carlos,
>
>
> Please find the below details to resolve the VM pending state.
>
>
>
> oneadmin at onefrontend:~$ onehost list
>
>   ID NAME                      RVM   TCPU   FCPU   ACPU    TMEM    FMEM
> STAT
>    0 192.168.138.241             0    400    400    400 8189640 7408148
> on
>
>
> oneadmin at onefrontend:~$ onevm list
>   ID     USER     NAME STAT CPU     MEM        HOSTNAME        TIME
>
>
>
> Template file details
>
> oneadmin at onefrontend:~/one-template$ cat ttylinux.one
> NAME   = ttylinux1
> CPU    = 1
> MEMORY = 128
>
> DISK   = [
>   source   = "/srv/cloud/one/one-template/ttylinux.img",
>   target   = "hda",
>   readonly = "no" ]
>
> NIC    = [ NETWORK = "Small network" ]
>
> FEATURES=[ acpi="no" ]
>
> #CONTEXT = [
> #    hostname    = "$NAME",
> #    ip_public   = "PUBLIC_IP",
> #    files      = "/path/to/init.sh /path/to/id_dsa.pub",
> #    target      = "hdc",
> #    root_pubkey = "id_dsa.pub",
> #    username    = "opennebula",
> #    user_pubkey = "id_dsa.pub"
> #]
> # --- VNC server ---
>
> GRAPHICS = [
>   type    = "vnc",
>   listen  = "0.0.0.0",
>   passwd = "passwd",
>   port    = "501"]
>
>
> oneadmin at onefrontend:~/one-template$ onevm list
>   ID     USER     NAME STAT CPU     MEM        HOSTNAME        TIME
>   54 oneadmin ttylinux runn   0  131072 192.168.138.241 00 00:07:51
>   55 oneadmin ttylinux runn   0  131072 192.168.138.241 00 00:07:24
>   56 oneadmin ttylinux runn   0  131072 192.168.138.241 00 00:06:08
>   57 oneadmin ttylinux runn   0  131072 192.168.138.241 00 00:05:00
>   58 oneadmin ttylinux pend   0       0                 00 00:03:31
>   59 oneadmin ttylinux pend   0       0                 00 00:01:51
>
>
> oneadmin at onefrontend:~/one-template$ onehost list
>
>   ID NAME                      RVM   TCPU   FCPU   ACPU    TMEM    FMEM
> STAT
>    0 192.168.138.241             4    400    394    394 8189640 7343376
> on
>
>
> oneadmin at onefrontend:~/var$ onehost show 0
> HOST 0 INFORMATION
> ID                    : 0
> NAME                  : 192.168.138.241
> STATE                 : MONITORED
> IM_MAD                : im_kvm
> VM_MAD                : vmm_kvm
> TM_MAD                : tm_nfs
>
> HOST SHARES
> MAX MEM               : 8189640
> USED MEM (REAL)       : 1016876
> USED MEM (ALLOCATED)  : 524288
> MAX CPU               : 400
> USED CPU (REAL)       : 10
> USED CPU (ALLOCATED)  : 400
> RUNNING VMS           : 4
>
> MONITORING INFORMATION
> ARCH=x86_64
> CPUSPEED=2499
> FREECPU=389.2
> FREEMEMORY=7343080
> HOSTNAME=onenode1
> HYPERVISOR=kvm
> MODELNAME=Intel(R) Xeon(R) CPU           X3323  @ 2.50GHz
> NETRX=0
> NETTX=0
> TOTALCPU=400
> TOTALMEMORY=8189640
> USEDCPU=10.8
> USEDMEMORY=1016876
>
> oneadmin at onefrontend:~/var$ cat sched.log
>
> Fri Jul 30 19:31:01 2010 [SCHED][I]: Dispatching virtual machine 56 to HID:
> 0
>   93177 Fri Jul 30 19:31:31 2010 [HOST][D]: Discovered Hosts (enabled): 0
>   93178 Fri Jul 30 19:31:31 2010 [VM][D]: Pending virtual machines :
>   93179 Fri Jul 30 19:31:31 2010 [SCHED][I]: Select hosts
>   93180         PRI     HID
>   93181         -------------------
>   93182
>   93183 Fri Jul 30 19:32:01 2010 [HOST][D]: Discovered Hosts (enabled): 0
>   93184 Fri Jul 30 19:32:01 2010 [VM][D]: Pending virtual machines : 57
>   93185 Fri Jul 30 19:32:01 2010 [RANK][W]: No rank defined for VM
>   93186 Fri Jul 30 19:32:01 2010 [SCHED][I]: Select hosts
>   93187         PRI     HID
>   93188         -------------------
>   93189 Virtual Machine: 57
>   93190         0       0
>   93191
>   93192
>   93193 Fri Jul 30 19:32:01 2010 [SCHED][I]: Dispatching virtual machine 57
> to HID: 0
>   93194 Fri Jul 30 19:32:31 2010 [HOST][D]: Discovered Hosts (enabled): 0
>   93195 Fri Jul 30 19:32:31 2010 [VM][D]: Pending virtual machines :
>   93196 Fri Jul 30 19:32:31 2010 [SCHED][I]: Select hosts
>   93197         PRI     HID
>   93198         -------------------
>   93199
>   93200 Fri Jul 30 19:33:01 2010 [HOST][D]: Discovered Hosts (enabled): 0
>   93201 Fri Jul 30 19:33:01 2010 [VM][D]: Pending virtual machines :
>   93202 Fri Jul 30 19:33:01 2010 [SCHED][I]: Select hosts
>   93203         PRI     HID
>   93204         -------------------
>   93205
>   93206 Fri Jul 30 19:33:31 2010 [HOST][D]: Discovered Hosts (enabled): 0
>   93207 Fri Jul 30 19:33:31 2010 [VM][D]: Pending virtual machines : 58
>   93208 Fri Jul 30 19:33:31 2010 [RANK][W]: No rank defined for VM
>   93209 Fri Jul 30 19:33:31 2010 [SCHED][I]: Select hosts
>   93210         PRI     HID
>   93211         -------------------
>   93212 Virtual Machine: 58
>   93213
>   93214
>   93215 Fri Jul 30 19:34:01 2010 [HOST][D]: Discovered Hosts (enabled): 0
>   93216 Fri Jul 30 19:34:01 2010 [VM][D]: Pending virtual machines : 58
>   93217 Fri Jul 30 19:34:01 2010 [RANK][W]: No rank defined for VM
>   93218 Fri Jul 30 19:34:01 2010 [SCHED][I]: Select hosts
>   93219         PRI     HID
>   93220         -------------------
>   93221 Virtual Machine: 58
>   93222
>   93223
>   93224 Fri Jul 30 19:34:31 2010 [HOST][D]: Discovered Hosts (enabled): 0
>   93225 Fri Jul 30 19:34:31 2010 [VM][D]: Pending virtual machines : 58
>   93226 Fri Jul 30 19:34:31 2010 [RANK][W]: No rank defined for VM
>   93227 Fri Jul 30 19:34:31 2010 [SCHED][I]: Select hosts
>   93228         PRI     HID
>   93229         -------------------
>   93230 Virtual Machine: 58
>   93231
>   93232
>   93233 Fri Jul 30 19:35:01 2010 [HOST][D]: Discovered Hosts (enabled): 0
>   93234 Fri Jul 30 19:35:01 2010 [VM][D]: Pending virtual machines : 58
>   93235 Fri Jul 30 19:35:01 2010 [RANK][W]: No rank defined for VM
>   93236 Fri Jul 30 19:35:01 2010 [SCHED][I]: Select hosts
>   93237         PRI     HID
>   93238         -------------------
>   93239 Virtual Machine: 58
>   93240
>   93241
>   93242 Fri Jul 30 19:35:31 2010 [HOST][D]: Discovered Hosts (enabled): 0
>   93243 Fri Jul 30 19:35:31 2010 [VM][D]: Pending virtual machines : 58 59
>   93244 Fri Jul 30 19:35:31 2010 [RANK][W]: No rank defined for VM
>   93245 Fri Jul 30 19:35:31 2010 [RANK][W]: No rank defined for VM
>   93246 Fri Jul 30 19:35:31 2010 [SCHED][I]: Select hosts
>   93247         PRI     HID
>   93248         -------------------
>   93249 Virtual Machine: 58
>    93250
>   93251 Virtual Machine: 59
>   93252
>   93253
>   93254 Fri Jul 30 19:36:01 2010 [HOST][D]: Discovered Hosts (enabled): 0
>   93255 Fri Jul 30 19:36:01 2010 [VM][D]: Pending virtual machines : 58 59
>   93256 Fri Jul 30 19:36:01 2010 [RANK][W]: No rank defined for VM
>   93257 Fri Jul 30 19:36:01 2010 [RANK][W]: No rank defined for VM
>   93258 Fri Jul 30 19:36:01 2010 [SCHED][I]: Select hosts
>   93259         PRI     HID
>   93260         -------------------
>   93261 Virtual Machine: 58
>   93262
>   93263 Virtual Machine: 59
>   93264
>   93265
>   93266 Fri Jul 30 19:36:31 2010 [HOST][D]: Discovered Hosts (enabled): 0
>   93267 Fri Jul 30 19:36:31 2010 [VM][D]: Pending virtual machines : 58 59
>   93268 Fri Jul 30 19:36:31 2010 [RANK][W]: No rank defined for VM
>   93269 Fri Jul 30 19:36:31 2010 [RANK][W]: No rank defined for VM
>   93270 Fri Jul 30 19:36:31 2010 [SCHED][I]: Select hosts
>   93271         PRI     HID
>   93272         -------------------
>   93273 Virtual Machine: 58
>
>
>
>
>
>
> Please find the oned log
>
>
> Fri Jul 30 19:31:01 2010 [DiM][D]: Deploying VM 56
> Fri Jul 30 19:31:01 2010 [ReM][D]: VirtualMachinePoolInfo method invoked
> Fri Jul 30 19:31:01 2010 [VMM][D]: Message received: POLL SUCCESS 54
> STATE=a USEDMEMORY=131072
>
> Fri Jul 30 19:31:02 2010 [TM][D]: Message received: LOG - 56 tm_clone.sh:
> onefrontend:/srv/cloud/one/one-template/ttylinux.img 192.168.138.241:
> /srv/cloud/one/var//56/images/disk.0
>
> Fri Jul 30 19:31:02 2010 [TM][D]: Message received: LOG - 56 tm_clone.sh:
> DST: /srv/cloud/one/var//56/images/disk.0
>
> Fri Jul 30 19:31:02 2010 [TM][D]: Message received: LOG - 56 tm_clone.sh:
> Creating directory /srv/cloud/one/var//56/images
>
> Fri Jul 30 19:31:02 2010 [TM][D]: Message received: LOG - 56 tm_clone.sh:
> Executed "mkdir -p /srv/cloud/one/var//56/images".
>
> Fri Jul 30 19:31:02 2010 [TM][D]: Message received: LOG - 56 tm_clone.sh:
> Executed "chmod a+w /srv/cloud/one/var//56/images".
>
> Fri Jul 30 19:31:02 2010 [TM][D]: Message received: LOG - 56 tm_clone.sh:
> Cloning /srv/cloud/one/one-template/ttylinux.img
>
> Fri Jul 30 19:31:02 2010 [TM][D]: Message received: LOG - 56 tm_clone.sh:
> Executed "cp /srv/cloud/one/one-template/ttylinux.img
> /srv/cloud/one/var//56/images/disk.0".
>
> Fri Jul 30 19:31:02 2010 [TM][D]: Message received: LOG - 56 tm_clone.sh:
> Executed "chmod a+w /srv/cloud/one/var//56/images/disk.0".
>
> Fri Jul 30 19:31:02 2010 [TM][D]: Message received: TRANSFER SUCCESS 56 -
>
> Fri Jul 30 19:31:03 2010 [VMM][D]: Message received: DEPLOY SUCCESS 56
> one-56
>
> Fri Jul 30 19:31:31 2010 [VMM][I]: Monitoring VM 55.
> Fri Jul 30 19:31:31 2010 [VMM][I]: Monitoring VM 56.
> Fri Jul 30 19:31:31 2010 [VMM][D]: Message received: POLL SUCCESS 55
> STATE=a USEDMEMORY=131072
>
> Fri Jul 30 19:31:31 2010 [VMM][D]: Message received: POLL SUCCESS 56
> STATE=a USEDMEMORY=131072
>
> Fri Jul 30 19:31:34 2010 [InM][I]: Monitoring host 192.168.138.241 (0)
> Fri Jul 30 19:31:38 2010 [InM][D]: Host 0 successfully monitored.
> Fri Jul 30 19:31:55 2010 [ReM][D]: VirtualMachineAllocate invoked
> Fri Jul 30 19:31:55 2010 [DiM][D]: Allocating a new VM
> Fri Jul 30 19:31:58 2010 [ReM][D]: VirtualMachinePoolInfo method invoked
> Fri Jul 30 19:32:01 2010 [VMM][I]: Monitoring VM 54.
> Fri Jul 30 19:32:01 2010 [ReM][D]: VirtualMachineDeploy invoked
> Fri Jul 30 19:32:01 2010 [DiM][D]: Deploying VM 57
> Fri Jul 30 19:32:01 2010 [VMM][D]: Message received: POLL SUCCESS 54
> STATE=a USEDMEMORY=131072
>
> Fri Jul 30 19:32:02 2010 [TM][D]: Message received: LOG - 57 tm_clone.sh:
> onefrontend:/srv/cloud/one/one-template/ttylinux.img 192.168.138.241:
> /srv/cloud/one/var//57/images/disk.0
>
> Fri Jul 30 19:32:02 2010 [TM][D]: Message received: LOG - 57 tm_clone.sh:
> DST: /srv/cloud/one/var//57/images/disk.0
>
> Fri Jul 30 19:32:02 2010 [TM][D]: Message received: LOG - 57 tm_clone.sh:
> Creating directory /srv/cloud/one/var//57/images
>
> Fri Jul 30 19:32:02 2010 [TM][D]: Message received: LOG - 57 tm_clone.sh:
> Executed "mkdir -p /srv/cloud/one/var//57/images".
>
> Fri Jul 30 19:32:02 2010 [TM][D]: Message received: LOG - 57 tm_clone.sh:
> Executed "chmod a+w /srv/cloud/one/var//57/images".
>
> Fri Jul 30 19:32:02 2010 [TM][D]: Message received: LOG - 57 tm_clone.sh:
> Cloning /srv/cloud/one/one-template/ttylinux.img
>
> Fri Jul 30 19:32:02 2010 [TM][D]: Message received: LOG - 57 tm_clone.sh:
> Executed "cp /srv/cloud/one/one-template/ttylinux.img
> /srv/cloud/one/var//57/images/disk.0".
>
> Fri Jul 30 19:32:02 2010 [TM][D]: Message received: LOG - 57 tm_clone.sh:
> Executed "chmod a+w /srv/cloud/one/var//57/images/disk.0".
>
> Fri Jul 30 19:32:02 2010 [TM][D]: Message received: TRANSFER SUCCESS 57 -
>
> Fri Jul 30 19:32:02 2010 [VMM][D]: Message received: DEPLOY SUCCESS 57
> one-57
>
> Fri Jul 30 19:32:19 2010 [ReM][D]: VirtualMachinePoolInfo method invoked
> Fri Jul 30 19:32:22 2010 [ReM][D]: VirtualMachinePoolInfo method invoked
> Fri Jul 30 19:32:29 2010 [ReM][D]: VirtualMachinePoolInfo method invoked
> Fri Jul 30 19:32:31 2010 [VMM][I]: Monitoring VM 55.
> Fri Jul 30 19:32:31 2010 [VMM][I]: Monitoring VM 56.
> Fri Jul 30 19:32:31 2010 [VMM][I]: Monitoring VM 57.
> Fri Jul 30 19:32:31 2010 [VMM][D]: Message received: POLL SUCCESS 55
> STATE=a USEDMEMORY=131072
>
> Fri Jul 30 19:32:31 2010 [VMM][D]: Message received: POLL SUCCESS 56
> STATE=a USEDMEMORY=131072
>
> Fri Jul 30 19:32:31 2010 [VMM][D]: Message received: POLL SUCCESS 57
> STATE=a USEDMEMORY=131072
>
> Fri Jul 30 19:32:31 2010 [ReM][D]: VirtualMachinePoolInfo method invoked
> Fri Jul 30 19:33:01 2010 [VMM][I]: Monitoring VM 54.
> Fri Jul 30 19:33:01 2010 [VMM][D]: Message received: POLL SUCCESS 54
> STATE=a USEDMEMORY=131072
>
> Fri Jul 30 19:33:04 2010 [InM][I]: Monitoring host 192.168.138.241 (0)
> Fri Jul 30 19:33:08 2010 [ReM][D]: VirtualMachinePoolInfo method invoked
> Fri Jul 30 19:33:08 2010 [InM][D]: Host 0 successfully monitored.
> Fri Jul 30 19:33:24 2010 [ReM][D]: VirtualMachineAllocate invoked
> Fri Jul 30 19:33:24 2010 [DiM][D]: Allocating a new VM
> Fri Jul 30 19:33:27 2010 [ReM][D]: VirtualMachinePoolInfo method invoked
> Fri Jul 30 19:33:31 2010 [VMM][I]: Monitoring VM 55.
> Fri Jul 30 19:33:31 2010 [VMM][I]: Monitoring VM 56.
> Fri Jul 30 19:33:31 2010 [VMM][I]: Monitoring VM 57.
> Fri Jul 30 19:33:31 2010 [VMM][D]: Message received: POLL SUCCESS 55
> STATE=a USEDMEMORY=131072
>
> Fri Jul 30 19:33:31 2010 [VMM][D]: Message received: POLL SUCCESS 56
> STATE=a USEDMEMORY=131072
>
> Fri Jul 30 19:33:31 2010 [VMM][D]: Message received: POLL SUCCESS 57
> STATE=a USEDMEMORY=131072
>
> Fri Jul 30 19:33:54 2010 [ReM][D]: VirtualMachinePoolInfo method invoked
> Fri Jul 30 19:33:55 2010 [ReM][D]: VirtualMachinePoolInfo method invoked
> Fri Jul 30 19:34:01 2010 [VMM][I]: Monitoring VM 54.
> Fri Jul 30 19:34:01 2010 [VMM][D]: Message received: POLL SUCCESS 54
> STATE=a USEDMEMORY=131072
>
> Fri Jul 30 19:34:31 2010 [VMM][I]: Monitoring VM 55.
> Fri Jul 30 19:34:31 2010 [VMM][I]: Monitoring VM 56.
> Fri Jul 30 19:34:31 2010 [VMM][I]: Monitoring VM 57.
> Fri Jul 30 19:34:31 2010 [VMM][D]: Message received: POLL SUCCESS 55
> STATE=a USEDMEMORY=131072
>
> Fri Jul 30 19:34:31 2010 [VMM][D]: Message received: POLL SUCCESS 56
> STATE=a USEDMEMORY=131072
>
> Fri Jul 30 19:34:31 2010 [VMM][D]: Message received: POLL SUCCESS 57
> STATE=a USEDMEMORY=131072
>
> Fri Jul 30 19:34:34 2010 [InM][I]: Monitoring host 192.168.138.241 (0)
> Fri Jul 30 19:34:38 2010 [InM][D]: Host 0 successfully monitored.
> Fri Jul 30 19:35:01 2010 [VMM][I]: Monitoring VM 54.
> Fri Jul 30 19:35:01 2010 [VMM][D]: Message received: POLL SUCCESS 54
> STATE=a USEDMEMORY=131072
>
> Fri Jul 30 19:35:04 2010 [ReM][D]: VirtualMachineAllocate invoked
> Fri Jul 30 19:35:04 2010 [DiM][D]: Allocating a new VM
> Fri Jul 30 19:35:10 2010 [ReM][D]: VirtualMachinePoolInfo method invoked
> Fri Jul 30 19:35:31 2010 [VMM][I]: Monitoring VM 55.
> Fri Jul 30 19:35:31 2010 [VMM][I]: Monitoring VM 56.
> Fri Jul 30 19:35:31 2010 [VMM][I]: Monitoring VM 57.
> Fri Jul 30 19:35:31 2010 [VMM][D]: Message received: POLL SUCCESS 57
> STATE=a USEDMEMORY=131072
>
> Fri Jul 30 19:35:31 2010 [VMM][D]: Message received: POLL SUCCESS 55
> STATE=a USEDMEMORY=131072
>
> Fri Jul 30 19:35:31 2010 [VMM][D]: Message received: POLL SUCCESS 56
> STATE=a USEDMEMORY=131072
>
>
> Thanks & Regards,
> Nagesh.
>
>
>
>
> --- On *Fri, 7/30/10, Carlos Martín Sánchez <cmartins at fdi.ucm.es>* wrote:
>
>
> From: Carlos Martín Sánchez <cmartins at fdi.ucm.es>
> Subject: Re: [one-users] VM's are going to pending state though enough
> resources
> To: "bathina nageswararao" <nag_bathina at yahoo.com>
> Cc: users at lists.opennebula.org
> Date: Friday, July 30, 2010, 3:38 PM
>
>
> Hi Bathina,
>
> The only hint I can give you is that the VM may be requesting more
> resources than the ones available in your host. Or maybe you are using the
> REQUIREMENTS field making your host non-suitable to deploy the VM.
>
> Please provide more information, like the VM template, the logs (oned.log
> and shed.log), the extended information of your host ($ onehost show 0) if
> you need more specific help.
>
> Regards,
> Carlos.
>
> Carlos Martín, Cloud Technology Engineer/Researcher
> DSA Research Group: web http://dsa-research.org and blog
> http://blog.dsa-research.org
> OpenNebula Open Source Toolkit for Cloud Computing:
> http://www.OpenNebula.org
>
>
> On 30 July 2010 07:12, bathina nageswararao <nag_bathina at yahoo.com<http://mc/compose?to=nag_bathina@yahoo.com>
> > wrote:
>
> Hi,
>
> VM's are going to pending state though enough resources.
>
> Any one please provide me the solution.
>
> oneadmin at onefrontend:~$ onehost list
>   ID NAME                      RVM   TCPU   FCPU   ACPU    TMEM    FMEM
> STAT
>    0 192.168.138.241             4    400    388    388 8189640 6013732
> on
>
> Regards,
> Nagesh.
>
> _______________________________________________
> Users mailing list
> Users at lists.opennebula.org<http://mc/compose?to=Users@lists.opennebula.org>
> http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
>
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.opennebula.org/pipermail/users-opennebula.org/attachments/20100802/a4559860/attachment-0002.htm>


More information about the Users mailing list