UVA ✎ storage_home_directories [Computer Science Support Wiki]

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.
==== Home Directories ====

Your home directory in CS is served by a high performance network fileserver.  Any Linux/Unix server you log in to should have your home directory mounted, likewise with Windows desktops (mounted through the SAMBA server as K:/).  New home directories are located under ''%%/u%%'' and are limited to 20G of space.

After logging in to one of our Linux servers, your working directory will be your home directory

<code>
[xyz1ab@portal01 ~]$ pwd
/u/xyz1ab
[xyz1ab@portal01 ~]$ df -h .
Filesystem            Size  Used Avail Use% Mounted on
corezfs01:/u/xyz1ab   20G  5.2M   20G   1% /u/xyz1ab
</code>

All user home directories for the department are served by ZFS servers located in Rice Hall. ZFS is a widely used, industry-standard storage platform that offers modern features such as backups/snapshots. User data is stored on enterprise quality disk arrays capable of scaling to petabytes. The disk arrays are connected to a SAN (storage area network) via fiber-channel and served over NFS by ZFS servers.

Home directories are quota limited in size, and should not be used for large data sets or project data. Users are encouraged to save large data sets or project data in a project directory (see Project Directories).

=== ZFS Filesystems ===

There are several Linux servers serving ZFS filesystems:

^Server^Filesystems^

|corezfs01.cs.virginia.edu|/u|user home directories|
|corezfs02.cs.virginia.edu|/p|project directories|
|corezfs04.cs.virginia.edu|/zf1-zf6, /zf20-zf25 /zf7-zf12, /if1-if15, /zf13-zf19, /af1-af5, /af11-af12, /af25-af26|legacy home directories (formerly on Solaris/ZFS)|

=== Home Directory Access ===

^NFS|CS filesystems are exported via NFS to department-managed Linux interactive and compute nodes. Filesystems are mounted consistently across all nodes so the paths are identical no matter what node you are working on. If you have root on your own desktop or laptop, we do not export NFS to your machine, you'll need to use our SAMBA server (samba.cs.virginia.edu) using the SMB protocol.|
^Samba/CIFS|Users logging into their "CSDOM" Windows account will automatically find their home directory mounted as their "K:\" drive.\\  Anyone can mount their home directory using Samba on their personal computers. Windows, Linux and Mac OS all have clients that will allow you to mount your CS department home directory over Samba.|
^SCP/SFTP|For truly remote access, we recommend using an SCP/SFTP client: the openssh package available on almost all *nix based systems - Solaris, Mac OS-X and the Linuxes. For Windows platform users, openssh is part of the cygwin packages, and ITS also provides SecureFX at ITS Software Central. For these connections, you should use the hostname ''%%portal.cs.virginia.edu%%'' to access the files; direct access to all file servers is restricted to Samba and NFS services.|

=== Secure Copy (SCP)/Secure File Transfer Protocol (SFTP) ===

You can use ''%%scp%%'' or ''%%sftp%%'' to access our filesystems through any CS Linux server.  We recommend that you use the host ''%%portal.cs.virginia.edu%%'' for these connections.

=== SAMBA (access Linux directories from Mac/Windows) ===

We have a SAMBA server ''%%samba.cs.virginia.edu%%'' that everyone can use to connect to their home directory.  To connect to your home directory, use the following network share:

<code>\\samba.cs.virginia.edu\userid</code>

When asked to authenticate please format your usename like this:

<code>CSDOM\userid</code>

=== Available SAMBA Shares ===

In addition to home directories (described above), there are additional network storage volumes that are now available to mount via Samba.

^Share^Share Path^Desc^
|''%%/bigtemp%%''|''%%\\samba.cs.virginia.edu\bigtemp%%''|[[storage_bigtemp|/bigtemp temporary data space]]|
|''%%/sw%%''|''%%\\samba.cs.virginia.edu\sw%%''|Software Partition|
|''%%/p/project_name%%''|''%%\\samba.cs.virginia.edu\p\project_name%%''|[[project_directories|Project Directories]]|
|''%%/u/username%%''|''%%\\samba.cs.virginia.edu\username%%''|Home Directories|

=== Mounting Filesystems on Linux/Mac OS ===

=== Graphical Programs ===

Graphical file managers under Linux and Mac OS (e.g. Nautilus, Finder, Caja, etc.) allow you to enter your network path using the following formatting

<code>smb://samba.cs.virginia.edu/abc1de     or     smb://abc1de@samba.cs.virginia.edu/abc1de</code>

You may be required to specify a user name in this path. If you are not asked for a username and password, try adding your username like in the second example. If you are asked for a domain or workgroup, use ''%%CSDOM%%''.

=== Command Line Mount ===

You can mount your directory from the command line. First, make sure that you have the cifs-utils package installed.

For Debian/apt based distributions:

<code>sudo apt-get install cifs-utils</code>

For Red Hat/yum based distributions:

<code>sudo yum install cifs-utils</code>

And then run the following command to mount your home directory

<code>sudo mount -t cifs -o username=abc1de //samba/abc1de /mnt/</code>

=== My directory is empty! ===

We use the linux “automounter” service autofs to mount network filesystems on Linux systems. Because of the way autofs works, when you first look in /u it appears to be empty:

<code>
[abc1de@portal01]$ ls /af1/abc1de
[abc1de@portal01]$                       <-- no output
</code> 

However once you attempt to access a directory, autofs quickly mounts the filesystem and now it will appear under /p

<code>
[abc1de@portal01]$ cd /af1/abc1de
[abc1de@portal01]$ ls /af1/abc1de
file1  file2  file3...
[abc1de@portal01]$ ls /af1
abc1de                                   <-- /af1/abc1de will stay mounted while the directory is being used
</code>