[one-users] " Datastore 0 filtered out. It does not fulfill SCHED_DS_REQUIREMENTS." error after upgrade from 4.2 to 4.4

Gerry O'Brien gerry at scss.tcd.ie
Tue Jan 7 11:27:31 PST 2014


Hi,

     We have just upgraded from 4.2 to 4.4 and now can lo longer create 
VMs. They remain in PENDING state. The error is is "Datastore 0 filtered 
out. It does not fulfill SCHED_DS_REQUIREMENTS." (see output from 
sched.log and onevm list below).

     We have not changed our file system structures. We are running 
Debian 7 where /datastores is an NFS mount with links from /var/lib/one 
(see output from df, ls -la /datastores and ls -la /var/lib/one below).

     Another possible related error  in oned.log is "error: columns hid, 
last_mon_time are not unique" (see full message below). Also, the web 
interface to sunstone server hangs with blue circles when the hosts 
infrastructure page is refreshed.

     Please give us some advice on this as soon as possible or we will 
have to try and roll-back to 4.2.

             Regards,
                 Gerry





XXX.scss.tcd.ie:/ZFSpool/datastores        22937651712 554636928 
22383014784   3% /datastores

$ ls -la /datastores/
total 64
drwxr-xr-x  8 oneadmin oneadmin    8 Oct  4 13:41 .
drwxr-xr-x 35 root     root     4096 Oct  4 14:21 ..
drwxr-xr-x 37 oneadmin oneadmin   37 Jan  7 18:29 0
drwxr-xr-x  2 oneadmin oneadmin   74 Dec 17 18:12 1
drwxr-xr-x  2 oneadmin oneadmin    2 Sep 18 15:34 100
drwxr-xr-x  2 oneadmin oneadmin    8 Oct 22 15:59 101
drwxr-xr-x  2 oneadmin oneadmin    2 Aug 23 16:28 2
drwxr-xr-x  2 oneadmin oneadmin    2 Dec 12 16:52 .isofiles


$ls -la /var/lib/one
total 1112592
drwxr-xr-x   10 oneadmin oneadmin      4096 Jan  7 19:03 .
drwxr-xr-x   47 root     root          4096 Dec  3 16:39 ..
-rw-------    1 oneadmin oneadmin      9799 Jan  7 17:42 .bash_history
-rw-r--r--    1 oneadmin oneadmin       720 Sep  5 17:45 .bashrc
-rw-r--r--    1 oneadmin oneadmin      2018 Jan  7 18:17 config
lrwxrwxrwx    1 oneadmin oneadmin        12 Sep 10 15:44 datastores -> 
/datastores/
drwxr-xr-x    5 oneadmin oneadmin      4096 Aug 12 16:35 datastores.ORIGINAL
drwxr-xr-x    2 oneadmin oneadmin      4096 Oct  3 17:20 images
drwx------    2 oneadmin oneadmin      4096 Aug 12 16:20 .one
-rw-r--r--    1 oneadmin oneadmin 284791808 Jan  7 19:03 one.db
-rw-r--r--    1 oneadmin oneadmin 284791808 Jan  7 18:15 one.db.BACKUP
-rw-r--r--    1 oneadmin oneadmin 284791808 Jan  7 18:17 one.db.bck
-rw-r--r--    1 oneadmin oneadmin 284791808 Jan  7 18:12 one.db.OLD
drwxr-xr-x    9 oneadmin oneadmin      4096 Jan  7 18:17 remotes
drwxr-xr-x    2 oneadmin oneadmin      4096 Jan  7 16:01 scripts
drwx------    2 oneadmin oneadmin      4096 Nov  5 10:33 .ssh
drwxr-xr-x    2 oneadmin oneadmin      4096 Jan  7 18:17 sunstone_vnc_tokens
-rw-------    1 oneadmin oneadmin      5240 Jan  7 18:44 .viminfo
drwxr-xr-x 1661 oneadmin oneadmin     36864 Jan  7 18:48 vms





Tue Jan  7 18:56:29 2014 [VM][D]: Pending/rescheduling VM and capacity 
requirements:
       VM  CPU      Memory   System DS  Image DS
------------------------------------------------------------
     1656   10      524288        1703  DS 101: 0
     1657   10      524288           1  DS 1: 0
     1658   10      524288           1  DS 1: 0
Tue Jan  7 18:56:29 2014 [HOST][D]: Discovered Hosts (enabled):
  0 1 2 3 4 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 
34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 63 64 65 66 67 
68 69 70 71 72
Tue Jan  7 18:56:29 2014 [SCHED][D]: VM 1656: Datastore 0 filtered out. 
It does not fulfill SCHED_DS_REQUIREMENTS.
Tue Jan  7 18:56:29 2014 [SCHED][D]: VM 1657: Datastore 0 filtered out. 
It does not fulfill SCHED_DS_REQUIREMENTS.
Tue Jan  7 18:56:29 2014 [SCHED][D]: VM 1658: Datastore 0 filtered out. 
It does not fulfill SCHED_DS_REQUIREMENTS.
Tue Jan  7 18:56:29 2014 [SCHED][I]: Scheduling Results:




VIRTUAL MACHINE 1658 INFORMATION
ID                  : 1658
NAME                : upgradeTEST
USER                : oneadmin
GROUP               : oneadmin
STATE               : PENDING
LCM_STATE           : LCM_INIT
RESCHED             : No
START TIME          : 01/07 18:48:15
END TIME            : -
DEPLOY ID           : -

VIRTUAL MACHINE MONITORING
USED CPU            : 0
NET_RX              : 0K
USED MEMORY         : 0K
NET_TX              : 0K

PERMISSIONS
OWNER               : um-
GROUP               : ---
OTHER               : ---

VM DISKS
  ID TARGET IMAGE                               TYPE SAVE SAVE_AS
   0 hda    [VM] DebianWheezy [SCSSnebula Ver 0 file   NO       -

VM NICS
  ID NETWORK              VLAN BRIDGE       IP              MAC
   0 TeachingNET [routed]   no br62         10.62.0.12 02:00:0a:3e:00:0c
                                            fe80::400:aff:fe3e:c

USER TEMPLATE
SCHED_MESSAGE="Tue Jan  7 18:58:59 2014 : No system datastore meets 
SCHED_DS_REQUIREMENTS: CLUSTER_ID = 100 & !(PUBLIC_CLOUD = YES)"

VIRTUAL MACHINE TEMPLATE
AUTOMATIC_REQUIREMENTS="CLUSTER_ID = 100 & !(PUBLIC_CLOUD = YES)"
CONTEXT=[
   DISK_ID="1",
   ETH0_IP="10.62.0.12",
   ETH0_MAC="02:00:0a:3e:00:0c",
   NETWORK="YES",
   TARGET="hdb" ]
CPU="0.1"
FEATURES=[
   ACPI="yes" ]
GRAPHICS=[
   LISTEN="0.0.0.0",
   PORT="7558",
   TYPE="VNC" ]
MEMORY="512"
OS=[
   ARCH="x86_64",
   BOOT="hd" ]
TEMPLATE_ID="31"
VCPU="2"
VMID="1658"



Tue Jan  7 19:08:31 2014 [ONE][E]: SQL command was: INSERT INTO 
host_monitoring (hid, last_mon_time, body) VALUES 
(23,1389121710,'<HOST><ID>23</ID><NAME>host011.scss.tcd.ie</NAME><STATE>2</STATE><IM_MAD>kvm</IM_MAD><VM_MAD>kvm</VM_MAD><VN_MAD>dummy</VN_MAD><LAST_MON_TIME>1389121710</LAST_MON_TIME><CLUSTER_ID>100</CLUSTER_ID><CLUSTER>SCSSnebula</CLUSTER><HOST_SHARE><DISK_USAGE>0</DISK_USAGE><MEM_USAGE>3145728</MEM_USAGE><CPU_USAGE>100</CPU_USAGE><MAX_DISK>22400044</MAX_DISK><MAX_MEM>16468984</MAX_MEM><MAX_CPU>800</MAX_CPU><FREE_DISK>21858408</FREE_DISK><FREE_MEM>13014844</FREE_MEM><FREE_CPU>782</FREE_CPU><USED_DISK>532497</USED_DISK><USED_MEM>3454140</USED_MEM><USED_CPU>17</USED_CPU><RUNNING_VMS>1</RUNNING_VMS><DATASTORES></DATASTORES></HOST_SHARE><VMS><ID>1638</ID></VMS><TEMPLATE><ARCH><![CDATA[x86_64]]></ARCH><CPUSPEED><![CDATA[1995]]></CPUSPEED><HOSTNAME><![CDATA[host011]]></HOSTNAME><HYPERVISOR><![CDATA[kvm]]></HYPERVISOR><MODELNAME><![CDATA[Intel(R) 
Xeon(R) CPU           E5405  @ 
2.00GHz]]></MODELNAME><NETRX><![CDATA[227905691977]]></NETRX><NETTX><![CDATA[134902115400]]></NETTX><VERSION><![CDATA[4.4.0]]></VERSION></TEMPLATE></HOST>'), 
error: columns hid, last_mon_time are not unique




-- 
Gerry O'Brien

Systems Manager
School of Computer Science and Statistics
Trinity College Dublin
Dublin 2
IRELAND

00 353 1 896 1341



More information about the Users mailing list