Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Next revision Both sides next revision
storage_home_directories [2018/11/15 17:31]
ktm5j
storage_home_directories [2020/09/17 15:28]
pgh5a
Line 1: Line 1:
-====== Home Directories ​======+==== Home Directories ====
  
-All user home directories for the department are now stored on ZFS storage ​located ​in the "​003"​ server room in Rice Hall. ZFS is a widely used, industry-standard storage platform that offers modern features such as backups/​snapshots. User data is stored on a Nexsan E-Series storage appliance ​capable of scaling to petabytes ​in a single 42U server rack. The disk arrays ​in this device ​are connected to a SAN (storage area network) via 8Gb fiber-channel and served over NFS by servers ​running Solaris.+Your home directory in CS is served by a high performance network fileserver. ​ Any Linux/Unix server you log in to should have your home directory mounted, likewise with Windows desktops (mounted through the SAMBA server as K:/).  New home directories are located under ''​%%/​u%%''​ and are limited to 20G of space. 
 + 
 +After logging in to one of our Linux servers, your working directory will be your home directory 
 + 
 +<​code>​ 
 +[xyz1ab@portal01 ~]$ pwd 
 +/u/xyz1ab 
 +[xyz1ab@portal01 ~]$ df -h . 
 +Filesystem ​           Size  Used Avail Use% Mounted on 
 +corezfs01:/​u/​xyz1ab ​  ​20G ​ 5.2M   ​20G ​  1% /u/xyz1ab 
 +</​code>​ 
 + 
 +All user home directories for the department are served by ZFS servers ​located in Rice Hall. ZFS is a widely used, industry-standard storage platform that offers modern features such as backups/​snapshots. User data is stored on enterprise quality disk arrays ​capable of scaling to petabytes. The disk arrays are connected to a SAN (storage area network) via fiber-channel and served over NFS by ZFS servers.
  
 Home directories are quota limited in size, and should not be used for large data sets or project data. Users are encouraged to save large data sets or project data in a project directory (see Project Directories). Home directories are quota limited in size, and should not be used for large data sets or project data. Users are encouraged to save large data sets or project data in a project directory (see Project Directories).
  
-===== ZFS Partitions =====+=== ZFS Filesystems ​===
  
-There are four servers serving ZFS partitions:+There are several Linux servers serving ZFS filesystems:
  
-^Server^Partitions^ +^Server^Filesystems^
-|zfs1.cs.virginia.edu|/​zf1-zf6,​ /​zf20-zf25| +
-|zfs2.cs.virginia.edu|/​zf7-zf12,​ /if1-if6| +
-|zfs3.cs.virginia.edu|/​zf13-zf19,​ /af1-af5, /af11-af12, /​af25-af26| +
-|corezfs01.cs.virginia.edu|/​u,​ /p|+
  
-===== Home Directory Access =====+|corezfs01.cs.virginia.edu|/​u|user home directories| 
 +|corezfs02.cs.virginia.edu|/​p|project directories| 
 +|corezfs04.cs.virginia.edu|/​zf1-zf6,​ /zf20-zf25 /zf7-zf12, /if1-if15, /zf13-zf19, /af1-af5, /af11-af12, /​af25-af26|legacy home directories (formerly on Solaris/​ZFS)|
  
-^NFS|CS filesystems are exported via NFS to department-managed ​Unix systems - Linux and Solaris ​interactive and compute nodes. Filesystems are mounted consistently across all nodes so the paths are identical no matter what node you are working on. If you have root on your own desktop or laptop, we do not export NFS to your machine, you'll need to use SMBFS/CIFS.|+=== Home Directory Access === 
 + 
 +^NFS|CS filesystems are exported via NFS to department-managed Linux interactive and compute nodes. Filesystems are mounted consistently across all nodes so the paths are identical no matter what node you are working on. If you have root on your own desktop or laptop, we do not export NFS to your machine, you'll need to use our SAMBA server (samba.cs.virginia.edu) using the SMB protocol.|
 ^Samba/​CIFS|Users logging into their "​CSDOM"​ Windows account will automatically find their home directory mounted as their "​K:​\"​ drive.\\ ​ Anyone can mount their home directory using Samba on their personal computers. Windows, Linux and Mac OS all have clients that will allow you to mount your CS department home directory over Samba.| ^Samba/​CIFS|Users logging into their "​CSDOM"​ Windows account will automatically find their home directory mounted as their "​K:​\"​ drive.\\ ​ Anyone can mount their home directory using Samba on their personal computers. Windows, Linux and Mac OS all have clients that will allow you to mount your CS department home directory over Samba.|
 ^SCP/​SFTP|For truly remote access, we recommend using an SCP/SFTP client: the openssh package available on almost all *nix based systems - Solaris, Mac OS-X and the Linuxes. For Windows platform users, openssh is part of the cygwin packages, and ITS also provides SecureFX at ITS Software Central. For these connections,​ you should use the hostname ''​%%portal.cs.virginia.edu%%''​ to access the files; direct access to all file servers is restricted to Samba and NFS services.| ^SCP/​SFTP|For truly remote access, we recommend using an SCP/SFTP client: the openssh package available on almost all *nix based systems - Solaris, Mac OS-X and the Linuxes. For Windows platform users, openssh is part of the cygwin packages, and ITS also provides SecureFX at ITS Software Central. For these connections,​ you should use the hostname ''​%%portal.cs.virginia.edu%%''​ to access the files; direct access to all file servers is restricted to Samba and NFS services.|
  
-===== SCP/​SFTP ​=====+=== Secure Copy (SCP)/Secure File Transfer Protocol (SFTP===
  
-You can use ''​%%scp%%''​ or ''​%%sftp%%''​ to access our filesystems through any given CS Linux server. ​ We recommend that you use the host ''​%%portal.cs.virginia.edu%%''​ for these connections.+You can use ''​%%scp%%''​ or ''​%%sftp%%''​ to access our filesystems through any CS Linux server. ​ We recommend that you use the host ''​%%portal.cs.virginia.edu%%''​ for these connections.
  
-===== Samba =====+=== SAMBA (access Linux directories from Mac/​Windows) ​===
  
-We have a new central Samba server ''​%%samba.cs.virginia.edu%%''​ that everyone can use to connect to their home directory. ​ To connect to your home directory, use the following network share:+We have a SAMBA server ''​%%samba.cs.virginia.edu%%''​ that everyone can use to connect to their home directory. ​ To connect to your home directory, use the following network share:
  
 <​code>​\\samba.cs.virginia.edu\userid</​code>​ <​code>​\\samba.cs.virginia.edu\userid</​code>​
Line 35: Line 47:
 <​code>​CSDOM\userid</​code>​ <​code>​CSDOM\userid</​code>​
  
-===== Available ​Samba Shares ​=====+=== Available ​SAMBA Shares ===
  
 In addition to home directories (described above), there are additional network storage volumes that are now available to mount via Samba. In addition to home directories (described above), there are additional network storage volumes that are now available to mount via Samba.
Line 45: Line 57:
 |''​%%/​u/​username%%''​|''​%%\\samba.cs.virginia.edu\username%%''​|Home Directories| |''​%%/​u/​username%%''​|''​%%\\samba.cs.virginia.edu\username%%''​|Home Directories|
  
-===== Mounting on Linux/Mac OS =====+=== Mounting ​Filesystems ​on Linux/Mac OS ===
  
-==== GUI Programs ​====+=== Graphical ​Programs ===
  
 Graphical file managers under Linux and Mac OS (e.g. Nautilus, Finder, Caja, etc.) allow you to enter your network path using the following formatting Graphical file managers under Linux and Mac OS (e.g. Nautilus, Finder, Caja, etc.) allow you to enter your network path using the following formatting
  
-<​code>​smb://​samba.cs.virginia.edu/​ktm5j     or     ​smb://​ktm5j@samba.cs.virginia.edu/​ktm5j</​code>​+<​code>​smb://​samba.cs.virginia.edu/​abc1de ​    or     ​smb://​abc1de@samba.cs.virginia.edu/​abc1de</​code>​
  
 You may be required to specify a user name in this path. If you are not asked for a username and password, try adding your username like in the second example. If you are asked for a domain or workgroup, use ''​%%CSDOM%%''​. You may be required to specify a user name in this path. If you are not asked for a username and password, try adding your username like in the second example. If you are asked for a domain or workgroup, use ''​%%CSDOM%%''​.
  
-==== CLI Mount ====+=== Command Line Mount ===
  
 You can mount your directory from the command line. First, make sure that you have the cifs-utils package installed. You can mount your directory from the command line. First, make sure that you have the cifs-utils package installed.
Line 69: Line 81:
 And then run the following command to mount your home directory And then run the following command to mount your home directory
  
-<​code>​sudo mount -t cifs -o username=ktm5j //samba/ktm5j /​mnt/</​code>​+<​code>​sudo mount -t cifs -o username=abc1de ​//samba/abc1de ​/​mnt/</​code>​ 
 + 
 +=== My home directory is empty! === 
 + 
 +We use the linux “automounter” service autofs to mount network filesystems on Linux systems. Because of the way autofs works, when you first look in /u it appears to be empty: 
 + 
 +<​code>​ 
 +[abc1de@portal01]$ ls /​af1/​abc1de 
 +[abc1de@portal01]$ ​                      <​-- no output 
 +</​code>​  
 + 
 +However once you attempt to access a directory, autofs quickly mounts the filesystem and now it will appear under /p 
 + 
 +<​code>​ 
 +[abc1de@portal01]$ cd /​af1/​abc1de 
 +[abc1de@portal01]$ ls /​af1/​abc1de 
 +file1  file2  file3... 
 +[abc1de@portal01]$ ls /af1 
 +abc1de ​                                  <​-- /af1/abc1de will stay mounted while the directory is being used 
 +</​code>​ 
  • storage_home_directories.txt
  • Last modified: 2020/10/20 19:34
  • by pgh5a