Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
storage_home_directories [2021/02/18 15:19]
pgh5a
storage_home_directories [2022/04/18 19:26] (current)
Line 1: Line 1:
 ==== Home Directories ==== ==== Home Directories ====
  
-Your home directory in CS is served by a high performance network fileserver. ​ Any Linux server you log in to will have your home directory mounted, likewise with Windows desktops (mounted through the SAMBA server as K:/).  New home directories are located under ''​%%/​u%%''​ and are limited ​to 20G of space.+Your home directory in CS is served by a high performance network fileserver. ​ Any Linux server you log in to will have your home directory mounted, likewise with Windows desktops (mounted through the SAMBA server as K:/).  New home directories are located under ''​%%/​u%%''​ and are limited ​in size.
  
 After logging in to one of our Linux servers, your working directory will be your home directory After logging in to one of our Linux servers, your working directory will be your home directory
Line 10: Line 10:
 [xyz1ab@portal01 ~]$ df -h . [xyz1ab@portal01 ~]$ df -h .
 Filesystem ​           Size  Used Avail Use% Mounted on Filesystem ​           Size  Used Avail Use% Mounted on
-corezfs01:/​u/​xyz1ab ​  20G  ​5.2M ​  20G   1% /u/xyz1ab+corezfs01:/​u/​xyz1ab ​  100G  ​5.2M ​ ​100G ​  1% /u/xyz1ab
 </​code>​ </​code>​
  
-All user home directories for the department are served by ZFS servers located in Rice Hall. ZFS is a widely used, industry-standard storage platform that offers modern features such as backups/​snapshots. User data is stored on enterprise quality disk arrays capable of scaling to petabytes. The disk arrays are connected to a SAN (storage area network) via fiber-channel and served over NFS by ZFS servers. +Home directories are quota limited in size, and should not be used for large data sets or project data. Users must save large data sets or project data in a project directory (see [[project_directories|Project Directories]]).
- +
-Home directories are quota limited in size, and should not be used for large data sets or project data. Users are encouraged to save large data sets or project data in a project directory (see Project Directories).+
  
 Upon separation from UVA CS, your account will be closed one month after that separation, and your home directory will be removed. No backup will be provided, so it is important for you to save any files you wish to take with you onto other storage. ​ Upon separation from UVA CS, your account will be closed one month after that separation, and your home directory will be removed. No backup will be provided, so it is important for you to save any files you wish to take with you onto other storage. ​
  
-=== ZFS Filesystems === 
- 
-There are several Linux servers serving ZFS filesystems:​ 
- 
-^Server^Filesystems^ 
- 
-|corezfs01.cs.virginia.edu|/​u|user home directories| 
-|corezfs02.cs.virginia.edu|/​p|project directories| 
-|corezfs04.cs.virginia.edu|/​zf1-zf6,​ /zf20-zf25 /zf7-zf12, /if1-if15, /zf13-zf19, /af1-af5, /af11-af12, /​af25-af26|legacy home directories (formerly on Solaris/​ZFS)| 
  
 === Home Directory Access === === Home Directory Access ===
  
-^NFS|CS filesystems are exported via NFS to department-managed Linux interactive and compute nodes. Filesystems are mounted consistently across all nodes so the paths are identical no matter what node you are working on. If you have root on your own desktop or laptop, we do not export NFS to your machine, you'll need to use our SAMBA server (samba.cs.virginia.edu) using the SMB protocol.|+^NFS|CS filesystems are exported via NFS to department-managed Linux interactive and compute nodes. Filesystems are mounted consistently across all nodes so the paths are identical no matter what node you are working on. If you have root on your own desktop or laptop, we do not export NFS to your machine, you'll need to use our SAMBA server (//samba.cs.virginia.edu//) using the SMB protocol.|
 ^Samba/​CIFS|Users logging into their "​CSDOM"​ Windows account will automatically find their home directory mounted as their "​K:​\"​ drive.\\ ​ Anyone can mount their home directory using Samba on their personal computers. Windows, Linux and Mac OS all have clients that will allow you to mount your CS department home directory over Samba.| ^Samba/​CIFS|Users logging into their "​CSDOM"​ Windows account will automatically find their home directory mounted as their "​K:​\"​ drive.\\ ​ Anyone can mount their home directory using Samba on their personal computers. Windows, Linux and Mac OS all have clients that will allow you to mount your CS department home directory over Samba.|
-^SCP/​SFTP|For ​truly remote access, we recommend using an SCP/SFTP client: the openssh package available on almost all *nix based systems - Solaris, ​Mac OS-X and the Linuxes. For Windows ​platform ​users, openssh is part of the cygwin packages, and ITS also provides SecureFX at ITS Software Central. For these connections,​ you should use the hostname ''​%%portal.cs.virginia.edu%%''​ to access the files; direct access to all file servers is restricted to Samba and NFS services.|+^SCP/​SFTP|For remote access, we recommend using an SCP/SFTP client: the //openssh// package ​is available on Mac OSX and Linux. For Windows users, openssh is part of the cygwin packages, and ITS also provides SecureFX at ITS Software Central. For these connections,​ you should use the hostname ''​%%portal.cs.virginia.edu%%''​ to access the files; direct access to all file servers is restricted to Samba and NFS services.|
  
 === Secure Copy (SCP)/​Secure File Transfer Protocol (SFTP) === === Secure Copy (SCP)/​Secure File Transfer Protocol (SFTP) ===
  
-You can use ''​%%scp%%''​ or ''​%%sftp%%''​ to access ​our filesystems ​through any CS Linux server We recommend that you use the host ''​%%portal.cs.virginia.edu%%''​ for these connections.+You can use ''​%%scp%%''​ or ''​%%sftp%%''​ to copy files to/​from ​our filesystems. ​Use the host ''​%%sftp.cs.virginia.edu%%''​ for these connections.
  
-=== SAMBA (access ​Linux directories from Mac/Windows===+=== Using SAMBA to access ​home or project ​directories from Mac/Windows ===
  
-We have a SAMBA server ''​%%samba.cs.virginia.edu%%''​ that everyone can use to connect to their home directory. ​ To connect to your home directory, use the following network share:+We have a SAMBA server ''​%%samba.cs.virginia.edu%%''​ that everyone can use to connect to their home directory. ​From off Grounds, you need to create a UVA VPN connection first to use SAMBA. 
 + 
 +To connect to your home directory, use the following network share:
  
 <​code>​\\samba.cs.virginia.edu\userid</​code>​ <​code>​\\samba.cs.virginia.edu\userid</​code>​
Line 51: Line 42:
 For example: <​code>​CSDOM\abc1de</​code>​ For example: <​code>​CSDOM\abc1de</​code>​
  
-=== Accessing your CS directories via SAMBA ===+== Using SAMBA on Windows ​==
  
-SAMBA allows users on Mac or PCs to access their home or project directories via the SAMBA protocol+SAMBA allows users on PCs to access their home or project directories via the SAMBA protocol.
- +
-In addition to home directories (described above), there are additional network storage volumes that are available to mount via Samba.+
  
 ^Share^Share Path^Desc^ ^Share^Share Path^Desc^
-|''​%%/​bigtemp%%''​|''​%%\\samba.cs.virginia.edu\bigtemp%%''​|[[storage_bigtemp|/​bigtemp temporary data space]]| 
-|''​%%/​sw%%''​|''​%%\\samba.cs.virginia.edu\sw%%''​|Software Partition| 
-|''​%%/​p/​project_name%%''​|''​%%\\samba.cs.virginia.edu\p\project_name%%''​|[[project_directories|Project Directories]]| 
 |''​%%/​u/​username%%''​|''​%%\\samba.cs.virginia.edu\username%%''​|Home Directories| |''​%%/​u/​username%%''​|''​%%\\samba.cs.virginia.edu\username%%''​|Home Directories|
 +|''​%%/​p/​project_name%%''​|''​%%\\samba.cs.virginia.edu\p\project_name%%''​|[[project_directories|Project Directories]]|
 +|''​%%/​bigtemp%%''​|''​%%\\samba.cs.virginia.edu\bigtemp%%''​|[[storage_bigtemp|/​bigtemp temporary data space]]|
  
-=== Mounting Filesystems ​on Linux/Mac OS ===+== Using SAMBA on Mac or Linux ==
  
-=== Graphical ​Programs ===+Graphical ​file managers under the Mac or Linux OS (e.g. Nautilus, Finder, Caja, etc.) allow you to enter a network directory path using the following formatting:
  
-Graphical file managers under Linux and Mac OS (e.gNautilus, Finder, Caja, etc.) allow you to enter your network path using the following formatting+<​code>​smb://​samba.cs.virginia.edu/​username ​  <- home directory  
 +smb://​samba.cs.virginia.edu/​p/​project_name ​  <- project directory  
 +smb://​samba.cs.virginia.edu/​bigtemp ​  <- bigtemp directory </​code>​
  
-<​code>​smb://​samba.cs.virginia.edu/​abc1de ​    ​or ​    ​smb://​abc1de@samba.cs.virginia.edu/​abc1de</​code>​+On a Mac, you would select "​Connect to Server"​ at the end of the Go menu on a Finder window, and type in the string above
  
-You would select "​Connect ​to Server"​ at the end of the Go menu on Mac Finder window, and type in the string above.+You may be required ​to specify ​user name in this pathso if you are not asked for a username ​and password, try adding your username like so:
  
-You may be required to specify a user name in this pathIf you are not asked for a username ​and password, try adding your username ​like in the second example. If you are asked for a domain or workgroup, use ''​%%CSDOM%%''​. +<​code>​smb://​username@samba.cs.virginia.edu/​username ​  <- home directory  
- +smb://username@samba.cs.virginia.edu/​project_name ​  <- project directory  
-=== Command Line Mount === +smb://​username@samba.cs.virginia.edu/​bigtemp ​  <- bigtemp directory </​code>​ 
- +If you are asked for a domain or workgroup, use ''​%%CSDOM%%''​.
-You can mount your directory from the command line. First, make sure that you have the cifs-utils package installed. +
- +
-For Debian/apt based distributions:​ +
- +
-<​code>​sudo apt-get install cifs-utils</​code>​ +
- +
-For Red Hat/yum based distributions:​ +
- +
-<​code>​sudo yum install cifs-utils</​code>​ +
- +
-And then run the following command to mount your home directory +
- +
-<​code>​sudo mount -t cifs -o username=abc1de //​samba/​abc1de /​mnt/</​code>​+
  
 === My directory is empty! === === My directory is empty! ===
  
 We use the linux “automounter” service //autofs// to mount network filesystems on Linux systems. Because of the way autofs works, if you try to get a list of files, the directory appears to be empty: We use the linux “automounter” service //autofs// to mount network filesystems on Linux systems. Because of the way autofs works, if you try to get a list of files, the directory appears to be empty:
 +
  
 <​code>​ <​code>​
  • storage_home_directories.txt
  • Last modified: 2022/04/18 19:26
  • (external edit)