[one-users] System volumes created with no space

Stefan Kooman stefan at bit.nl
Fri Apr 25 00:21:21 PDT 2014


Quoting Marius Rex (MariusRex at venda.com):
> 
> I am using Opennebula 4.5.80 on Centos6 with KVM.  
> 
> /var/lib/one is a NFS mount, and has over a terabyte of free space available.  I have it shared between my administrative host and my KVM servers, but I cannot launch a VM as there is never any space seen as available in the systems datastore.
> 
> [oneadmin$] onedatastore list
>   ID NAME                SIZE AVAIL CLUSTER      IMAGES TYPE DS       TM      
>    0 system                0M -     snowman           0 sys  -        shared
>    1 default             1.4T 100%  snowman           1 img  fs       shared
>    2 files               1.4T 100%  snowman           0 fil  fs       ssh
>   
> All volumes are actually located on the same NFS volume:
> 
> [oneadmin]$ df -h /var/lib/one
> Filesystem            Size  Used Avail Use% Mounted on
> snowman03.of-1.uk.venda.com:/tank/systems/one
>                       1.4T  946M  1.4T   1% /var/lib/one
> 
> Yet:
> 
> [oneadmin]$ onedatastore show 0
> DATASTORE 0 INFORMATION                                                         
> ID             : 0                   
> NAME           : system              
> USER           : oneadmin            
> GROUP          : oneadmin            
> CLUSTER        : snowman             
> TYPE           : SYSTEM              
> DS_MAD         : -                   
> TM_MAD         : shared              
> BASE PATH      : /var/lib/one//datastores/0
> DISK_TYPE      : FILE                
> 
> DATASTORE CAPACITY                                                              
> TOTAL:         : 0M                  
> FREE:          : 0M                  
> USED:          : 0M                  
> LIMIT:         : -                   
> 
> PERMISSIONS                                                                     
> OWNER          : um-                 
> GROUP          : u--                 
> OTHER          : ---                 
> 
> DATASTORE TEMPLATE                                                              
> BASE_PATH="/var/lib/one//datastores/"
> SHARED="YES"
> TM_MAD="shared"
> TYPE="SYSTEM_DS"
> 
> IMAGES         
> [oneadmin]$ onedatastore show 1
> DATASTORE 1 INFORMATION                                                         
> ID             : 1                   
> NAME           : default             
> USER           : oneadmin            
> GROUP          : oneadmin            
> CLUSTER        : snowman             
> TYPE           : IMAGE               
> DS_MAD         : fs                  
> TM_MAD         : shared              
> BASE PATH      : /var/lib/one//datastores/1
> DISK_TYPE      : FILE                
> 
> DATASTORE CAPACITY                                                              
> TOTAL:         : 1.4T                
> FREE:          : 1.4T                
> USED:          : 945M                
> LIMIT:         : -                   
> 
> PERMISSIONS                                                                     
> OWNER          : um-                 
> GROUP          : u--                 
> OTHER          : ---                 
> 
> DATASTORE TEMPLATE                                                              
> BASE_PATH="/var/lib/one//datastores/"
> CLONE_TARGET="SYSTEM"
> DISK_TYPE="FILE"
> DS_MAD="fs"
> LN_TARGET="NONE"
> TM_MAD="shared"
> TYPE="IMAGE_DS"
> 
> IMAGES         
> 5 
> 
> 
> So I tried creating a new systems datastore on separate NFS mount as a test:
> 
> [oneadmin]$ cat template.ds 
> NAME    = systems_nfs
> TM_MAD  = shared  
> TYPE    = SYSTEM_DS
> BASE_PATH = /mnt/systems/one
> 
> [oneadmin]$ onedatastore create template.ds -c snowman
> 
> And I get another system volume with no space:
> 
> [oneadmin at snow-opennebula01 ~]$ onedatastore show 102
> DATASTORE 102 INFORMATION                                                       
> ID             : 102                 
> NAME           : systems_nfs         
> USER           : oneadmin            
> GROUP          : oneadmin            
> CLUSTER        : snowman             
> TYPE           : SYSTEM              
> DS_MAD         : -                   
> TM_MAD         : shared              
> BASE PATH      : /mnt/systems/one/102
> DISK_TYPE      : FILE                
> 
> DATASTORE CAPACITY                                                              
> TOTAL:         : 0M                  
> FREE:          : 0M                  
> USED:          : 0M                  
> LIMIT:         : -                   
> 
> PERMISSIONS                                                                     
> OWNER          : um-                 
> GROUP          : u--                 
> OTHER          : ---                 
> 
> DATASTORE TEMPLATE                                                              
> BASE_PATH="/mnt/systems/one/"
> SHARED="YES"
> TM_MAD="shared"
> TYPE="SYSTEM_DS"
> 
> IMAGES         
> 
> [oneadmin]$ df -h /mnt/systems/one
> Filesystem            Size  Used Avail Use% Mounted on
> snowman03.of-1.uk.venda.com:/tank/systems
>                       1.4T  945M  1.4T   1% /mnt/systems
> 
> 
> I am not sure what I am doing wrong.

Hmm. I see the same over here:

oneadmin at template-vm:~$ onedatastore list
  ID NAME                SIZE AVAIL CLUSTER      IMAGES TYPE DS       TM      
 100 dummy1_ds_sys         0M -     -                 0 sys  -        shared
 101 dummy1_ds_ima       7.9G 44%   BITED_zone01      1 img  fs       shared
 102 dummy2_ds_ima       7.9G 44%   -                 0 img  fs       shared
 103 dummy2_ds_sys         0M -     -                 0 sys  -        shared
 104 dummy3_ds_sys         0M -     -                 0 sys  -        shared

onedatastore show 104
DATASTORE 104 INFORMATION                                                       
ID             : 104                 
NAME           : dummy3_ds_system    
USER           : oneadmin            
GROUP          : oneadmin            
CLUSTER        : -                   
TYPE           : SYSTEM              
DS_MAD         : -                   
TM_MAD         : shared              
BASE PATH      : /var/lib/one//datastores/104
DISK_TYPE      : FILE                

DATASTORE CAPACITY                                                              
TOTAL:         : 0M                  
FREE:          : 0M                  
USED:          : 0M                  
LIMIT:         : -                   

PERMISSIONS                                                                     
OWNER          : um-                 
GROUP          : u--                 
OTHER          : ---                 

DATASTORE TEMPLATE                                                              
BASE_PATH="/var/lib/one//datastores/"
SHARED="YES"
TM_MAD="shared"
TYPE="SYSTEM_DS"

IMAGES         

These datastores are on a ONE 4.5.85 test vm with only local storage. So
it does not seem to matter if it's on nfs or not. One reason for having
incorrect DATASTORE CAPACITY is that it's not monitored. I've checked
oned.log and all image/file datastores are checked except for system
datatores. DATASTORE_CAPACITY_CHECK is enabled. On this VM this proably
is because there's no real host added (only dummy's). IM probes are
copied to the host and executed in the host. Do you have enabled and
healthy hypervisors (onehost list)? Can you check oned.log if those
system datastores get monitored?

Gr. Stefan


-- 
| BIT BV  http://www.bit.nl/        Kamer van Koophandel 09090351
| GPG: 0xD14839C6                   +31 318 648 688 / info at bit.nl



More information about the Users mailing list