Recent posts

1 post tagged with "globus"

View All Tags

April 2025 Maintenance Update

Kristen Finch

Kristen Finch

HPC Staff Scientist

April maintenance included the latest OS patches and security enhancements for login and compute nodes, along with testing endpoint detection and response (EDR) software to strengthen cluster security. We would like to bring your attention to upcoming events featuring an AWS AI in Research Workshop (April 17), our annual Research Computing Club Hackathon (April 19), and the Kopah S3 Storage Launch Event "Data Storage Day" (May 5), showcasing campus-wide S3-compatible storage. Additionally, GPU in EDU (May 15) will provide insights into GPU workflows demonstrated by experts at Cambridge Computer and NVIDIA. Regular office hours are available for research computing support. Stay informed through training resources, event subscriptions, and the UW-IT Research Computing Events Calendar. The next maintenance is scheduled for Tuesday May 13, 2025 (AKA the 2nd Tuesday of the month).

Notable Updates, New Features#

  • Operating system - The login and compute node images were updated to address system patches and security updates in the Linux operating system (OS).
  • Security solutions testing - We tested endpoint detection and response (EDR) software as a potential solution for an enhanced cluster security posture. This testing is part of our ongoing efforts to maintain a secure computing environment in line with funding requirements (e.g., NIST-800, CMMC, HIPAA, NIH).
  • Globus - We’re excited to announce that Globus has been added to Hyak Klone and Kopah S3. Globus makes it easy to transfer large datasets reliably and securely between systems, whether across campus or around the world. With features like automated transfers, fault tolerance, and a simple web interface, it’s a powerful tool for streamlining data movement in research workflows.

Upcoming Training and Events#

Subscribe to event updates and bookmark our UW-IT Research Computing Events Calendar.

  • AWS AI in Research Workshop - UW-IT Research Computing and eScience Institute will host a workshop introducing how AWS enables AI in research on Thursday, April 17th from 12:00 - 4:00 p.m. in the eScience Institute. Whether you are developing your own models, building off existing models, or you need to implement generative AI, AWS has you covered. Bring your laptop and join us for a couple of engaging sessions followed by a hands-on lab building AI agents. Learn more.

  • RCC Hackathon - The Research Computing Club (RCC), in collaboration with UW-IT Research Computing and the eScience Institute, is excited to host an all-day HPC Hackathon on Saturday, April 19th from 10:00 a.m. – 6:00 p.m. in the eScience Institute. Learn more.

  • Discover Kopah: Your New S3-Compatible Campus Storage Solution at Data Storage Day! Join us on Monday, May 5 from 1:00 – 5:00 p.m. in the eScience Institute for the official Kopah S3 Storage Service Launch Event — your gateway to fast, scalable storage right on campus. Whether you're a researcher handling big data, an instructor managing course materials, or simply someone in need of reliable cloud-like storage, Kopah is designed for everyone. This event will feature live demos of S3-compatible tools like s3cmd, Globus, JuiceFS, Cyberduck, and boto3, and staff will be available to help you get started with Kopah S3. Learn more.

  • GPU in EDU Save the Date Thursday May 15th 10:00 a.m. - 4:00 p.m. – Join UW-IT Research Computing for a day learning about GPUs from the experts at NVIDIA and Cambridge Computer. This event will feature live demonstrations for building your GPU workflows, recommendations for incorporating GPUs into instruction, computing research at UW, and more! Registration link coming soon!

Spring Office Hours#

If you would like to request 1 on 1 help, please send an email to help@uw.edu with "Hyak Office Hour" in the subject line to coordinate a meeting.

Training Resources#

Opportunities#

External Training Opportunities#

  • Parallel Computing with MATLAB: Hands on workshop Coming Up April 16 1PM PDT - During this hands-on workshop, we will introduce parallel and distributed computing in MATLAB with a focus on speeding up application codes and offloading computers. By working through common scenarios and workflows using hands-on demos, you will gain a detailed understanding of the parallel constructs in MATLAB, their capabilities, and some of the common hurdles that you'll encounter when using them. SIGN UP! Highlights:

    • Multithreading vs multiprocessing
    • When to use parfor vs parfeval constructs
    • Creating data queues for data transfer
    • Leveraging NVIDIA GPUs
    • Parallelizing Simulink models
    • Working with large data

  • AI in Science Postdoc Workshop - Generative AI systems built upon large language models (LLMs) show great promise as tools that enable people to access information through natural conversation. Scientists can benefit from the breakthroughs these systems enable to create advanced tools that will help accelerate their research outcomes. Last week the UW Scientific Software Engineering Center (SSEC) offered a Generative AI / RAG training opportunity to the Schmidt AI in Science Postdoctoral Fellows. The online tutorial focused on how to utilize the underlying methods in Generative AI to advance scientific research, including the basics of LLMs followed by a demo of using LLMs and RAG for creating a question answering tool based on private data. Learn more.

  • Trainings from Texas A&M University - gain skills that are transferrable to Hyak (Linux, Slurm job scheduler, Open OnDemand, NVIDIA GPU).

    • ACES: Python for Data Science 04/11/25 - 10:00 AM - 04:00 PM CDT - This short course for experienced programmers introduces the Numpy, Pandas, and Matplotlib libraries commonly used to manage and display large datasets in Python. Exercises will be performed in the learner's web browser in Jupyter Notebooks running in the Open OnDemand portal of the ACES cluster. More information about this course at https://hprc.tamu.edu/training/aces_python4data.html.
    • ACES: Metagenomics 04/15/25 - 01:30 PM - 04:00 PM CDT - This short course introduces concepts of metagenomic analyses based on data generated by Next Generation Sequencing (NGS) technology using ACES cluster, a composable accelerator testbed at Texas A&M University. Students will learn to complete a metagenomics pipeline using QIIME2 software. Read more at https://hprc.tamu.edu/training/aces_metagenomics.html
    • ACES: Rust 04/22/25 - 10:00 AM - 12:30 PM CDT - This short course provides an introduction to Rust, a modern systems programming language known for its safety, speed, and concurrency, through hands-on coding exercises and practical examples using the ACES cluster, a composable accelerator testbed at Texas A&M University. Learn more at https://hprc.tamu.edu/training/aces_rust.html
    • ACES: GPU Programming (CUDA) 04/22/25 - 01:30 PM - 04:00 PM CDT - This short course covers basic topics in CUDA programming on NVIDIA GPUs. More information about this Short Course https://hprc.tamu.edu/training/intro_cuda.html Topics include:
      • CUDA architecture
      • basic language usage of CUDA C/C++
      • writing, executing CUDA code.
    • ACES: Python for HPC and Advanced Topics 04/25/25 - 10:00 AM - 04:00 PM CDT - This short course for experienced Python programmers will cover several topics relevant to Python workloads running on HPC systems, including environment and data handling. Exercises will be performed in the learner's web browser in Jupyter Notebooks running in the Open OnDemand portal of the ACES cluster. More information about this course at https://hprc.tamu.edu/training/aces_python4HPC.html.

  • Trainings from the National Energy Research Scientific Computing Center (NERSC) - gain skills that are transferrable to Hyak

    • NERSC N-Ways to GPU Programming Bootcamp - NERSC, in collaboration with the OpenACC Organization and NVIDIA, is hosting an N-Ways to GPU Programming Bootcamp for 3 days from Wednesday, April 30 to Friday, May 2. Beginner users in GPU programming are especially encouraged to attend. This is a virtual event. For detailed information, and how to apply, please refer to Open Hackathons's Bootcamp Events page. The application deadline is April 13, 2025.
    • Building GPU-Accelerated Differentiable Simulations with NVIDIA Warp Python 1- 4 pm (Pacific time), Wednesday, May 28, 2025 - LANL is hosting a Building GPU-Accelerated Differentiable Simulations with NVIDIA Warp Python training, presented by Eric Shi from Nvidia. Warp is a Python framework designed for authoring high-performance, GPU-accelerated code directly in Python. At its core, Warp uses a programming model where Python functions are just-in-time (JIT) compiled into efficient code that can run on both CPUs and NVIDIA GPUs, using C++/CUDA as an intermediate representation. This approach lets developers harness GPU performance while maintaining the simplicity and flexibility of Python. Learn more and register.
    • NERSC GPU Hackathon - NERSC, in conjunction with NVIDIA and the OpenACC organization, will be hosting an Open Hackathon from July 16th-18th with an opening day on July 9th as part of the annual Open Hackathon Series. The NERSC Open Hackathon will be hosted as a hybrid event. Days 0-1 (July 2 and 9) will be held virtually, and attendees will have the option to attend Days 2-4 (July 16 - 18) either in-person at NERSC or online. This hackathon is open to everyone looking to take their projects to the next level; however, priority acceptance will be given to NERSC collaborators. Please note the deadline to submit a proposal is 11:59 PM Pacific, May 28, 2025. So apply now! Please note acceptance is not confirmed until you have received a confirmation email. Learn more.
    • More opportunities from NERSC

Jobs#

  • The UW Echospace research group is seeking a student or an early career professional to help develop open-source scientific software for processing large-scale ocean sonar data to accelerate marine ecosystem research. APPLY!

  • Metascience & AI Postdoctoral Fellowship - The Sloan Foundation is awarding grants of up to $250k to support early career researchers in the social sciences and humanities who are interested in understanding the implications of AI for the science and research ecosystem. Applicants are required to have a faculty mentor based at the research organization where the grant is to be held. Feel free to reach out to eScience for support with identifying a potential UW mentor. Applications due April 10, 2025! Learn more.

  • The Center for Geospatial Intelligence at George Mason University is looking for a Postdoctoral Research Fellow in geospatial data science and machine learning to work on research projects related to large-scale urban simulations and geospatial machine learning. APPLY!

  • Yale Center for Research Computing is hiring an HPC System Administrator to join the center’s Engineering team to provide hardware and software administration for a growing number of high performance computing (HPC) clusters used in faculty research. This position will support the infrastructure behind all of the above, including hardware, system and resource-management software, networking, storage, monitoring and security measures. This is a highly-collaborative effort, so frequent interaction with other system administrators, research support staff, management, vendors and researchers is a regular part of the role. Learn more.

  • Job opening for a High Performance Computing (HPC) Research Computing Associate at Colby College in Maine. Learn more.

If you have any questions about using Hyak, please start a help request by emailing help@uw.edu with "Hyak" in the subject line.

Happy Computing,

Hyak Team