Using Disk Storage from Internal Clients

Disk Storage Servers (GPFS Servers)

Disk storage servers, including CIFS/NFS servers, are intended to provide disk space to batch servers, work servers, grid servers, and research group hosts in KEK.
Research group hosts should access the disk space with NFS ver.4, while user authentication is managed by LDAP.
Client nodes can also access with NFS v4, though allowed only for particular cases due to security reasons.

gpfs_20160823_en.jpg


Disk Storage Space

This section describes the disk spaces provided by GPFS servers.
In the new system, as it used to be in the previous system, do not use the df command instead the gquota command to check the disk space assigned to and used by each group. Also, it is possible to check the capacity and used space of the home domain with hquota. See Notice of the GPFS usage for more information.

File System Domain
(File System Name)
Work group
/Sub group
DirectoryQuota size
Home domain(gpfs_home)Acc/home/acc100GB/user
Atlas/home/atlas
Bess/home/bess
Central/home/ce
CMB/home/cmb
Had/home/had
ILC/home/ilc
MLF/home/mlf
PS/home/ps
T2K/home/t2k
Theory/home/th
Belle/home/belle250GB/user
Belle2/home/belle2100GB/user
File System Domain
(File System Name)
Work group
/Sub group
DirectoryQuota size
Group domain(gpfs_group)Acc/group/acc1 TB
Atlas/group/atlas2 TB
Bess/group/bess5 TB
Centralce_ce/group/ce---
ce_cc/group/ce/cc1 TB
ce_ccs/group/ce/ccs1 TB
ce_ccx/group/ce/cex1 TB
ce_rad/group/ce/rad1 TB
ce_geant4/group/ce/geant41 TB
ce_pf/group/ce/pf500 GB
ce_kagra/group/ce/kagra1 TB
ce_sbrc/group/ce/sbrc1 TB
CMB/group/cmb280 TB
Hadhad_had/group/had---
had_koto/group/had/koto2.4 PB
had_g-2/group/had/g-26 TB
had_high-p/group/had/high-p5 TB
had_trek/group/had/trek30 TB
had_sks/group/had/sks30 TB
had_knucl/group/had/knucl30 TB
had_muon/group/had/muon100 TB
had_staff/group/had/staff10 TB
ILC/group/ilc160 TB
MLFmlf_mlf/group/mlf---
mlf_mlf/group/mlf70 TB
mlf_deeme/group/mlf/deeme1 TB
PFCS/group/pfcs3 TB
PS/group/ps1 TB
T2K/group/t2k300 TB
Theory/group/th10 TB
tmp/group/tmp1 TB
Belle/group/belle800 TB
/group/belle/users1 TB/users
Belle2/group/belle2500 TB
/group/belle2/dataprod1.5 PB
File System Domain
(File System Name)
Work group
/Sub group
DirectoryQuota size
Library domain(sw)---/sw---


CIFS/NFS Servers

Server List

CIFS servers are made up of 2 servers to form redundancy.
Use a delegate host name to access disk storage via CIFS service.

Delegate host name of CIFS serversmbgw.cc.kek.jp

Note that passwords for CIFS (samba) servers and work servers are not synced.

Below are the paths for accessing CIFS.

DomainWorkgroupPath on disksWindows access pathMacOSX access address
HomeAcc/home/acc/username\\smbgw.cc.kek.jp\h_accsmb://smbgw.cc.kek.jp/h_acc
Atlas/home/atlas/username\\smbgw.cc.kek.jp\h_atlassmb://smbgw.cc.kek.jp/h_atlas
Bess/home/bess/username\\smbgw.cc.kek.jp\h_besssmb://smbgw.cc.kek.jp/h_bess
Central/home/ce/username\\smbgw.cc.kek.jp\h_cesmb://smbgw.cc.kek.jp/h_ce
CMB/home/cmb/username\\smbgw.cc.kek.jp\h_cmbsmb://smbgw.cc.kek.jp/h_cmb
Had/home/had/username\\smbgw.cc.kek.jp\h_hadsmb://smbgw.cc.kek.jp/h_had
ILC/home/ilc/username\\smbgw.cc.kek.jp\h_ilcsmb://smbgw.cc.kek.jp/h_ilc
MLF/home/mlf/username\\smbgw.cc.kek.jp\h_mlfsmb://smbgw.cc.kek.jp/h_mlf
PS/home/ps/username\\smbgw.cc.kek.jp\h_pssmb://smbgw.cc.kek.jp/h_ps
T2K/home/t2k/username\\smbgw.cc.kek.jp\h_t2ksmb://smbgw.cc.kek.jp/h_t2k
Theory/home/th/username\\smbgw.cc.kek.jp\h_thsmb://smbgw.cc.kek.jp/h_th
Belle/home/belle/username\\smbgw.cc.kek.jp\h_bellesmb://smbgw.cc.kek.jp/h_belle
Belle2/home/belle2/username\\smbgw.cc.kek.jp\h_belle2smb://smbgw.cc.kek.jp/h_belle2
GroupsAcc/group/acc\\smbgw.cc.kek.jp\g_accsmb://smbgw.cc.kek.jp/g_acc
Atlas/group/atlas\\smbgw.cc.kek.jp\g_atlassmb://smbgw.cc.kek.jp/g_atlas
Bess/group/bess\\smbgw.cc.kek.jp\g_besssmb://smbgw.cc.kek.jp/g_bess
Central/group/ce\\smbgw.cc.kek.jp\g_cesmb://smbgw.cc.kek.jp/g_ce
CMB/group/cmb\\smbgw.cc.kek.jp\g_cmbsmb://smbgw.cc.kek.jp/g_cmb
Had/group/had\\smbgw.cc.kek.jp\g_hadsmb://smbgw.cc.kek.jp/g_had
ILC/group/ilc\\smbgw.cc.kek.jp\g_ilcsmb://smbgw.cc.kek.jp/g_ilc
MLF/group/mlf\\smbgw.cc.kek.jp\g_mlfsmb://smbgw.cc.kek.jp/g_mlf
PFCS/group/pfcs\\smbgw.cc.kek.jp\g_pfcssmb://smbgw.cc.kek.jp/g_pfcs
PS/group/ps\\smbgw.cc.kek.jp\g_pssmb://smbgw.cc.kek.jp/g_ps
T2K/group/t2k\\smbgw.cc.kek.jp\g_t2ksmb://smbgw.cc.kek.jp/g_t2k
Theory/group/th\\smbgw.cc.kek.jp\g_thsmb://smbgw.cc.kek.jp/g_th
Belle/group/belle\\smbgw.cc.kek.jp\g_bellesmb://smbgw.cc.kek.jp/g_belle
Belle2/group/belle2\\smbgw.cc.kek.jp\g_belle2smb://smbgw.cc.kek.jp/g_belle2

Access instructions (from Windows) are described below.

  • Start Explorer and search for computers connected to the network.
  • Input "smbgw.cc.kek.jp" as a computer name, and search.
  • Select and double-click the computer found as a result of the search.
  • Input the ID and password given after application, to log in.
  • Refer to the table above, and access the Group/Home domain.

Changing CIFS Password

You can change your password with the WEB interface.

https://smbgw.cc.kek.jp/smbpasswd/index.html

Access the web page and enter information as follows.

User nameuser name on Data Analysis System
Old Passwordgiven password for CIFS access
New Passwordany string (*1)
Confirm New Passwordre-type your new password

(*1): The rules to follow to create a new password are listed below.

  • at least 9 characters long
  • must include at least one alphabetical character
  • must contain at least one symbol
  • must contain at least one digit


Data from the home domain of the previous system

This part explains where the data from the old system is stored.
The data saved from the old system is mounted on /old as read-only. You can copy any old data you need to your home directory.

Below are the paths to access the saved data.
Location of the saved data(/old/"workgroup name"/"User name")

Workgroup
/Subgroup
Current pathFormer path on the
Common Computation System
Acc/old/acc/home/acc
Atlas/old/atlas/home/atlas
Bess/old/bess/home/bess
Central/old/ce/home/ce
CMB/old/cmb/home/cmb
Had/old/had/home/had
ILC/old/ilc/home/ilc
MLF/old/mlf/home/mlf
PS/old/ps/home/ps
T2K/old/t2k/home/t2k
Theory/old/th/home/th
Belle/old/belle/home/belle
Belle2/old/belle2/home/belle2


Data from the group domain of the previous system

This part explains where the data from the old system is stored.
The data saved from the old system is stored in the same directory.
Regarding /group/belle/users directory, The data saved from the old system is /group/belle/users_old. You can copy any old data you need to your group directory.

Below are the paths to access the saved data.

Workgroup
/Subgroup
Current pathFormer path on the
Common Computation System
Belle/group/belle/users_old/group/belle/users


Data from the library domain of the previous system

This part explains where the data from the old system is stored.
The data saved from the old system is mounted on /sw/old as read-only.
Regarding /sw/share/etc directory, The data as of August 5, 2016 saved from the old system is a same directory.
Environmental setting files for new system are located under /sw/share/etc/skel.
Below are the paths to access the saved data.

Target DomainCurrent pathFormer path on the
Common Computation System
library domain/sw/old/sw
/sw/share/etc
(except for /sw/share/etc/skel)
/sw/share/etc


Notice of the GPFS usage

User application

  • CIFS requires an ID for the Data Analysis System. Application form is available here. Check “CIFS server” on the user account application form.
  • Only clients inside KEK are allowed to use the NFS /CIFS services.
  • It is not permitted to access from NAT environments.
  • A source host must be registered to the internal node database and DNS.
  • The system defines NFS client's IP addresses on servers. When there is a change in your IP address, please report it.
  • It is not allowed for NFS clients to access the NFS area with a root privilege.

Available Domains

This part deals with checking the size and usage status in the home domain or the group domain.
As already explained in the section "File System", the gquota command should be used to check the disk space assigned to and used by each group.
Also, to check the capacity and usage of the home domain dedicated to each user, use rquota command or hquota command.
To check of /group/belle/users/, use bquota command.

gquota command

<Syntax> : gquota [ -K | -M | -G ] {Directory}

 Directory :
       /group/ps | /group/mlf | /group/ilc | /group/acc | /group/atlas | /group/ce | /group/ce/cc | /group/ce/ccs |
       /group/ce/ccx | /group/ce/rad | /group/pfcs | /group/th | /group/bess | /group/sgr | /group/belle | /group/belle/users |
       /group/belle2 | /group/had | /group/had/koto | /group/had/g-2 | /group/had/trek | /group/had/sks |
       /group/t2k | /group/cmb
  $> gquota -M /group/ps
  Checking Quota Data...
                       Block Limits                                            |                        File Limits
  Filesystem     type            MB     quota       limit    in_doubt    grace |    files    quota    limit in_doubt    grace  Remarks
  /group/ps      FILESET     858233         0     1048576           0     none |   527893        0        0        0     none
  $> gquota -G /group/ps
  Checking Quota Data...
                       Block Limits                                            |                        File Limits
  Filesystem     type            GB     quota       limit    in_doubt    grace |    files    quota    limit in_doubt    grace  Remarks
  /group/ps      FILESET        838         0        1024           0     none |   527893        0        0        0     none
  $> gquota -K /group/belle/users
  Checking Quota Data...
                                       Block Limits                                                |                              File Limits
  Filesystem           type                KB         quota         limit      in_doubt      grace |      files      quota      limit   in_doubt      grace    Remarks
  /group/belle/users   USR                  0             0    1073741824             0       none |          1          0          0          0       none

rquota command

<Syntax> : rquota
  $> rquota
 
                       Block Limits                                            |                        File Limits
  Filesystem     type            KB     quota       limit    in_doubt    grace |    files    quota    limit in_doubt    grace  Remarks
  /home/ce       USR            416         0   104857600           0     none |       13        0        0        0     none

hquota command

<Syntax> : hquota [ -h | -g | -k ]
  $> hquota
  HOME directory usage: 0/100 GB (0%)
  $> hquota -k
  HOME directory usage: 1376K / 100GB (0%)
( Example of Belle users )

  $> hquota
  HOME directory usage: 33G / 250GB (13%)
  Your usage in /group/belle/users/: 43G / 1024GB (4%)

bquota command

<Syntax> : bquota
  $> bquota

                                       Block Limits                                 |                 File Limits
  Filesystem                     type        KB  quota       limit  in_doubt  grace | files  quota  limit  in_doubt  grace  Remarks
  /group/belle/users/[USERNAME]  USR   45412849      0  1073741824         0   none | 54739      0      0         0   none

Regarding gquota, the size unit can be specified as an option. It is also possible to indicate a specific domain and display only the information related to this domain.
Regarding hquota, the size unit can be specified as an option.
The output shows the following information:

  • Filesystem : specified domain
  • type : quota type (USR: user quota, FILESET: fileset quota)

≪Block Limits≫

  • KB(or MB/GB) : used disk size in KB(or MB/GB)
  • quota : soft limit
  • limit : hard limit
  • grace : grace period (unset. When the usage reached hard limit, "*" is displayed)

≪File Limits≫

  • files : number of files
  • quota : soft limit on files (unset)
  • limit : hard limit on files (unset)
  • grace : grace period on files (unset)

Last-modified: 2019-08-06 (火) 15:41:05 (0m)