{"id":75,"date":"2026-10-08T22:44:13","date_gmt":"2026-10-08T22:44:13","guid":{"rendered":"https:\/\/www.hep.wisc.edu\/cms-comp\/?page_id=75"},"modified":"2026-10-08T22:45:01","modified_gmt":"2026-10-08T22:45:01","slug":"gpus","status":"publish","type":"page","link":"https:\/\/www.hep.wisc.edu\/cms-comp\/userdoc\/gpus\/","title":{"rendered":"GPUs"},"content":{"rendered":"<h1 style=\"margin-top:var(--wp--preset--spacing--50);margin-bottom:var(--wp--preset--spacing--20)\" class=\"is-style-mini-bar wp-block-post-title\">GPUs<\/h1>\n\n\n<h1 class=\"wp-block-heading\">Analysis Facility GPUs<\/h1>\n\n\n\n<p class=\"wp-block-paragraph\">The <a href=\"https:\/\/www.hep.wisc.edu\/cms\/af\">Wisconsin Analysis Facility<\/a> provides an interactive jupyter notebook environment with access to local GPUs as well as GPUs in the Condor cluster. Currently, the GPUs availabe in this way are NVIDIA Tesla T4 GPUs with 16GB RAM.<\/p>\n\n\n\n<h1 class=\"wp-block-heading\">Large Memory Machine Learning Computer, cmsnn01.hep.wisc.edu<\/h1>\n\n\n\n<p class=\"wp-block-paragraph\">The computer cmsnn01.hep.wisc.edu is a Dell Pro Max with GB10, the NVIDIA GB10 Grace Blackwell GPU. It has 128GB unified memory, accessible to both the CPUs and GPU, making it suitable for testing and developing LLMs and other large models. Note that cmsnn01 has ARM cpus, unlike most other T2 computers, which are x86 architecure.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Access is via ssh from login.hep.wisc.edu. The computer does not support AFS access, so if your home directory is in AFS, you should contact <a href=\"mailto:help@hep.wisc.edu\">help@hep.wisc.edu<\/a> to have your home directory migrated to CEPH, which is accessible from cms01. (If you just want a peek, you can ssh to the computer and just not have access to your AFS home directory.)<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">One way to use LLMs on this computer is via <a href=\"https:\/\/ollama.com\">ollama<\/a>, which is installed and running.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">To list the installed models:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>$ ollama list\nNAME                                 ID              SIZE      MODIFIED      \nllama3:latest                        365c0bd3c000    4.7 GB    2 minutes ago    \nnemotron-3-super:120b-a12b-q4_K_M    95acc78b3ffd    86 GB     2 days ago       \n<\/code><\/pre>\n\n\n\n<p class=\"wp-block-paragraph\">To install a <a href=\"https:\/\/ollama.com\/search\">new model<\/a>:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>$ ollama pull llama3:latest\n<\/code><\/pre>\n\n\n\n<p class=\"wp-block-paragraph\">To start a chat session with a model:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>$ ollama run llama3:latest\n&gt;&gt;&gt; What is the Higgs Boson?\n<\/code><\/pre>\n\n\n\n<p class=\"wp-block-paragraph\">To programmatically call a model via python:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>import requests\nimport json\n\nurl = \"http:\/\/localhost:11434\/api\/chat\"\npayload = {\n    \"model\": \"nemotron-3-super:120b-a12b-q4_K_M\",\n    \"messages\": &#91;{\"role\": \"user\", \"content\": \"What is the Higgs Boson?\"}],\n    \"stream\": False\n}\n\nresponse = requests.post(url, json=payload)\nprint(response.json()&#91;'message']&#91;'content'])\n<\/code><\/pre>\n","protected":false},"excerpt":{"rendered":"<p>Analysis Facility GPUs The Wisconsin Analysis Facility provides an interactive jupyter notebook environment with access to local GPUs as well as GPUs in the Condor cluster. Currently, the GPUs availabe in this way are NVIDIA Tesla T4 GPUs with 16GB RAM. Large Memory Machine Learning Computer, cmsnn01.hep.wisc.edu The computer cmsnn01.hep.wisc.edu is a Dell Pro Max &hellip;<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":27,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_uw_migration_status":"in-progress","_uw_gutenberg_post_content_before_migration":"","_uw_seo_meta_title":"","_uw_seo_meta_description":"","_uw_seo_twitter_card_type":"summary_large_image","_uw_seo_meta_image":"","_uw_seo_meta_image_url":"","_uw_seo_meta_image_sizes":[],"_uw_seo_custom_meta_tags":[],"footnotes":""},"class_list":["post-75","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/www.hep.wisc.edu\/cms-comp\/wp-json\/wp\/v2\/pages\/75","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.hep.wisc.edu\/cms-comp\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.hep.wisc.edu\/cms-comp\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.hep.wisc.edu\/cms-comp\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.hep.wisc.edu\/cms-comp\/wp-json\/wp\/v2\/comments?post=75"}],"version-history":[{"count":1,"href":"https:\/\/www.hep.wisc.edu\/cms-comp\/wp-json\/wp\/v2\/pages\/75\/revisions"}],"predecessor-version":[{"id":76,"href":"https:\/\/www.hep.wisc.edu\/cms-comp\/wp-json\/wp\/v2\/pages\/75\/revisions\/76"}],"up":[{"embeddable":true,"href":"https:\/\/www.hep.wisc.edu\/cms-comp\/wp-json\/wp\/v2\/pages\/27"}],"wp:attachment":[{"href":"https:\/\/www.hep.wisc.edu\/cms-comp\/wp-json\/wp\/v2\/media?parent=75"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}