Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
storage_home_directories [2020/07/29 13:10]
pgh5a [GUI Programs]
storage_home_directories [2021/05/11 12:45] (current)
pgh5a
Line 1: Line 1:
-====== Home Directories ​======+==== Home Directories ====
  
-Your home directory in CS is a network ​storage volume that is associated with your account.  Any Linux/Unix server you log in to should ​have your home directory mounted, likewise with Windows desktops (mounted through the SAMBA server as K:/).  New home directories are now located under ''​%%/​u%%''​ and are limited to 20G of space.+Your home directory in CS is served by high performance ​network ​fileserver.  Any Linux server you log in to will have your home directory mounted, likewise with Windows desktops (mounted through the SAMBA server as K:/).  New home directories are located under ''​%%/​u%%''​ and are limited to 20G of space.
  
 After logging in to one of our Linux servers, your working directory will be your home directory After logging in to one of our Linux servers, your working directory will be your home directory
Line 15: Line 15:
 All user home directories for the department are served by ZFS servers located in Rice Hall. ZFS is a widely used, industry-standard storage platform that offers modern features such as backups/​snapshots. User data is stored on enterprise quality disk arrays capable of scaling to petabytes. The disk arrays are connected to a SAN (storage area network) via fiber-channel and served over NFS by ZFS servers. All user home directories for the department are served by ZFS servers located in Rice Hall. ZFS is a widely used, industry-standard storage platform that offers modern features such as backups/​snapshots. User data is stored on enterprise quality disk arrays capable of scaling to petabytes. The disk arrays are connected to a SAN (storage area network) via fiber-channel and served over NFS by ZFS servers.
  
-Home directories are quota limited in size, and should not be used for large data sets or project data. Users are encouraged to save large data sets or project data in a project directory (see Project Directories).+Home directories are quota limited in size, and should not be used for large data sets or project data. Users are encouraged to save large data sets or project data in a project directory (see [[project_directories|Project Directories]]).
  
-===== ZFS Filesystems ​=====+Upon separation from UVA CS, your account will be closed one month after that separation, and your home directory will be removed. No backup will be provided, so it is important for you to save any files you wish to take with you onto other storage.  
 + 
 +=== ZFS Filesystems ===
  
 There are several Linux servers serving ZFS filesystems:​ There are several Linux servers serving ZFS filesystems:​
Line 27: Line 29:
 |corezfs04.cs.virginia.edu|/​zf1-zf6,​ /zf20-zf25 /zf7-zf12, /if1-if15, /zf13-zf19, /af1-af5, /af11-af12, /​af25-af26|legacy home directories (formerly on Solaris/​ZFS)| |corezfs04.cs.virginia.edu|/​zf1-zf6,​ /zf20-zf25 /zf7-zf12, /if1-if15, /zf13-zf19, /af1-af5, /af11-af12, /​af25-af26|legacy home directories (formerly on Solaris/​ZFS)|
  
-===== Home Directory Access ​=====+=== Home Directory Access ===
  
 ^NFS|CS filesystems are exported via NFS to department-managed Linux interactive and compute nodes. Filesystems are mounted consistently across all nodes so the paths are identical no matter what node you are working on. If you have root on your own desktop or laptop, we do not export NFS to your machine, you'll need to use our SAMBA server (samba.cs.virginia.edu) using the SMB protocol.| ^NFS|CS filesystems are exported via NFS to department-managed Linux interactive and compute nodes. Filesystems are mounted consistently across all nodes so the paths are identical no matter what node you are working on. If you have root on your own desktop or laptop, we do not export NFS to your machine, you'll need to use our SAMBA server (samba.cs.virginia.edu) using the SMB protocol.|
Line 33: Line 35:
 ^SCP/​SFTP|For truly remote access, we recommend using an SCP/SFTP client: the openssh package available on almost all *nix based systems - Solaris, Mac OS-X and the Linuxes. For Windows platform users, openssh is part of the cygwin packages, and ITS also provides SecureFX at ITS Software Central. For these connections,​ you should use the hostname ''​%%portal.cs.virginia.edu%%''​ to access the files; direct access to all file servers is restricted to Samba and NFS services.| ^SCP/​SFTP|For truly remote access, we recommend using an SCP/SFTP client: the openssh package available on almost all *nix based systems - Solaris, Mac OS-X and the Linuxes. For Windows platform users, openssh is part of the cygwin packages, and ITS also provides SecureFX at ITS Software Central. For these connections,​ you should use the hostname ''​%%portal.cs.virginia.edu%%''​ to access the files; direct access to all file servers is restricted to Samba and NFS services.|
  
-===== SCP/​SFTP ​=====+=== Secure Copy (SCP)/Secure File Transfer Protocol (SFTP===
  
-You can use ''​%%scp%%''​ or ''​%%sftp%%''​ to access our filesystems through any given CS Linux server. ​ We recommend that you use the host ''​%%portal.cs.virginia.edu%%''​ for these connections.+You can use ''​%%scp%%''​ or ''​%%sftp%%''​ to access our filesystems through any CS Linux server. ​ We recommend that you use the host ''​%%portal.cs.virginia.edu%%''​ for these connections.
  
-===== Samba =====+=== SAMBA (access Linux directories from Mac/​Windows) ​===
  
-We have a new central Samba server ''​%%samba.cs.virginia.edu%%''​ that everyone can use to connect to their home directory. ​ To connect to your home directory, use the following network share:+We have a SAMBA server ''​%%samba.cs.virginia.edu%%''​ that everyone can use to connect to their home directory. ​ To connect to your home directory, use the following network share:
  
 <​code>​\\samba.cs.virginia.edu\userid</​code>​ <​code>​\\samba.cs.virginia.edu\userid</​code>​
  
-When asked to authenticate please format your usename ​like this:+When asked to authenticate please format your username ​like this:
  
 <​code>​CSDOM\userid</​code>​ <​code>​CSDOM\userid</​code>​
  
-===== Available Samba Shares =====+For example: <​code>​CSDOM\abc1de</​code>​
  
-In addition to home directories (described above), there are additional network storage volumes that are now available to mount via Samba.+=== Accessing your CS directories via SAMBA === 
 + 
 +SAMBA allows users on Mac or PCs to access their home or project directories via the SAMBA protocol. 
 + 
 +In addition to home directories (described above), there are additional network storage volumes that are available to mount via Samba.
  
 ^Share^Share Path^Desc^ ^Share^Share Path^Desc^
Line 57: Line 63:
 |''​%%/​u/​username%%''​|''​%%\\samba.cs.virginia.edu\username%%''​|Home Directories| |''​%%/​u/​username%%''​|''​%%\\samba.cs.virginia.edu\username%%''​|Home Directories|
  
-===== Mounting on Linux/Mac OS =====+=== Mounting ​Filesystems ​on Linux/Mac OS ===
  
-==== GUI Programs ​====+=== Graphical ​Programs ===
  
 Graphical file managers under Linux and Mac OS (e.g. Nautilus, Finder, Caja, etc.) allow you to enter your network path using the following formatting Graphical file managers under Linux and Mac OS (e.g. Nautilus, Finder, Caja, etc.) allow you to enter your network path using the following formatting
  
 <​code>​smb://​samba.cs.virginia.edu/​abc1de ​    ​or ​    ​smb://​abc1de@samba.cs.virginia.edu/​abc1de</​code>​ <​code>​smb://​samba.cs.virginia.edu/​abc1de ​    ​or ​    ​smb://​abc1de@samba.cs.virginia.edu/​abc1de</​code>​
 +
 +You would select "​Connect to Server"​ at the end of the Go menu on a Mac Finder window, and type in the string above.
  
 You may be required to specify a user name in this path. If you are not asked for a username and password, try adding your username like in the second example. If you are asked for a domain or workgroup, use ''​%%CSDOM%%''​. You may be required to specify a user name in this path. If you are not asked for a username and password, try adding your username like in the second example. If you are asked for a domain or workgroup, use ''​%%CSDOM%%''​.
  
-==== CLI Mount ====+=== Command Line Mount ===
  
 You can mount your directory from the command line. First, make sure that you have the cifs-utils package installed. You can mount your directory from the command line. First, make sure that you have the cifs-utils package installed.
Line 81: Line 89:
 And then run the following command to mount your home directory And then run the following command to mount your home directory
  
-<​code>​sudo mount -t cifs -o username=ktm5j //samba/ktm5j /​mnt/</​code>​+<​code>​sudo mount -t cifs -o username=abc1de ​//samba/abc1de ​/​mnt/</​code>​ 
 + 
 +=== My directory is empty! === 
 + 
 +We use the linux “automounter” service //autofs// to mount network filesystems on Linux systems. Because of the way autofs works, if you try to get a list of files, the directory appears to be empty: 
 + 
 +<​code>​ 
 +[abc1de@portal01]$ ls /u/abc1de 
 +[abc1de@portal01]$ ​                      <​-- no output 
 +</​code>​  
 + 
 +However once you '​cd'​ into that directory, autofs quickly mounts the filesystem and its files are listed 
 + 
 +<​code>​ 
 +[abc1de@portal01]$ cd /u/abc1de 
 +[abc1de@portal01]$ ls /u/abc1de 
 +file1  file2  file3... 
 +[abc1de@portal01]$ ls /u 
 +abc1de ​                                  <​-- /u/abc1de will stay mounted while the directory is being used 
 +</​code>​ 
  • storage_home_directories.1596028257.txt.gz
  • Last modified: 2020/07/29 13:10
  • by pgh5a