GPU Servers

GPU Servers

Hardware

The SCF can help with access to several GPU resources:

The SCF operates one GPU available to all SCF users. You need to use the SLURM scheduling software to run any job making use of the GPU. You may want to use an interactive session to develop and test your GPU code. That same link also has information on monitoring GPU usage of your job.

General Access

GPU partition

We have one Titan Xp with 12 GB memory on one of our Linux servers (roo), available through the gpu partition. The GPUs formerly available in the high partition have been retired as of March 2023.

Savio

​Priority access for all department members to 8 fairly old (K80) GPUs on the campus Savio cluster is available through the SCF condo, and access to additional GPUs is available through the Savio faculty computing allowance. Please contact SCF staff for more information.

Research Groups

The SCF also operates the following GPUs. These GPUs are owned by individual faculty members, but anyone can run jobs on them. Note that if you are not a member of the lab group, your jobs will run on a preemptible basis, which means they can be cancelled at any time by a higher-priority jobs. These servers can be accessed by submitting to the jsteinhardt, yugroup, or yss partitions (details below) using the SLURM scheduling software.

Steinhardt lab group (jsteinhardt partition)

  • 8 GeForce RTX 2080 Ti, each with 11 GB memory (shadowfax).
  • 2 Quadro RTX 8000, each with 48 GB memory (smaug).
  • 8 A100, each with 40 GB memory (balrog).
  • 10 A100, each with 80 GB memory (saruman).
  • 8 A4000, each with 16 GB memory (sunstone and smokyquartz).
  • 8 A5000, each with 24 GB memory (rainbowquartz).

Steinhardt lab group remote cluster (lambda partition)

  • 8 A100, each with 80 GB memory (five machines at a remote co-location facility in Texas)

To use these machines, one must specifically connect to the remote cluster, which is accessed separately from the other SCF resources.

Yu lab group (yugroup partition)

  • 1 A100 with 40 GB memory (treebeard).
  • 1 GeForce GTX TITAN X with 12 GB memory (merry).
  • 1 Titan Xp with 12 GB memory (morgoth).
  • 1 Titan X (Pascal) with 12 GB memory (morgoth).

Song lab group (yss partition)

  • 4 A100, each with 80 GB memory (luthien).
  • 8 A100, each with 80 GB memory (beren).

Software

We provide the following software that will help you in making use of the GPU:

  • CUDA (version 12.2; other versions can be made available)
  • cuDNN (cuDNN 8.9.7 for CUDA 12.2; other versions can be made available)
  • PyTorch (version 2.2.1 for Python 3.12 and 2.0.0 for Python 3.11)
  • Tensorflow (version 2.16.1 for Python 3.12 and version 2.12.0 for Python 3.11)
  • Keras (version 2.16.1 for Python 3.12 and version 2.12.0 for Python 3.11)
  • Jax (version 0.4.25 for Python 3.12)
  • We can install additional or upgrade current software as needed. 

We use Linux environment modules to manage the use of GPU-based software, as discussed next. Note that you could insert any of these commands in your .bashrc (after the stanza involving ~skel/std.bashrc) so they are always in effect or invoke them as needed in a script (including a cluster submission script) or in a terminal session.

For software that uses the GPU (via CUDA) for back-end computations:

  • Tensorflow: For Python 3.11, invoke "module load tensorflow". For Python 3.12, simply import tensorflow in Python as with any standard Python package.
  • PyTorch: simply import torch in Python as with any standard Python package.

To use the software only on the CPU:

  • Tensorflow: simply import tensorflow in Python as with any standard Python package. Note that Tensorflow may not work on some of our old machines, but it should work on the cluster nodes as well as on gandalf and radagast among others.
  • PyTorch: simply import torch in Python as with any standard Python package.

To use program with CUDA and related packages directly, please see this tutorial for more details. You'll need to load CUDA as follows in order to be able to compile and run your code:

  • CUDA: to use CUDA directly in C or another language, invoke "module load cuda".
  • cuDNN: cuDNN is available on the GPU servers without needing to load any modules.

If you have questions or would like additional GPU-related software installed, please contact consult@stat.berkeley.edu.