2018 LCI Intermediate Workshop

August 13–17, 2018
Yale Center for Research Computing

160 St. Ronan Street
New Haven, CT 06511

Lustre Hands-On

The environment for the lab uses NCSA’s Nebula OpenStack cluster. With OpenStack we were able to create your VMs in an automated fashion. To maximize your learning, your VMs are as close to a minimal install of CentOS as we could make them. OpenStack installs the ssh key you provided in the centos account. We do not care for the centos user account but you have to use it until you get ssh keys setup for the root account. Since the centos account exists you will use it for some Lustre testing once you have a working filesystem. In addition to having a centos account, the hostname and networking for your VMs get configured via the cloud-init package. The instructor will help you with your VMs if you lock yourself out or need a VM reset. Please be careful not to lock yourself out a VM and do not power the VMs off, as you’d have to bother the instructor to power it back on again.

Schedule

Monday, August 13 — Storage (part 1)

  • 8:00 am Breakfast
  • 8:30 am Welcome/Introductions – Andy Sherman, Yale (chair), Kiran Keshav, Yale, Erik Scott, Harris Corp. Presentation
  • 9:00 am Survey of Storage Hardware – JD Maloney, NCSA, Presentation
  • 9:30 am Survey of File Systems – JD Maloney, NCSA, Presentation
  • 10:00 am Tiered Storage – JD Maloney, NCSA, Presentation
  • 11:00 am Break
  • 11:30 am ZFS Concepts, Features, Administration – JD Maloney, NCSA, Presentation
  • 12:30 pm Lunch
  • 1:30 pm ZFS Hands-On – JD Maloney, NCSA, Tutorial
  • 2:30 pm GPFS Architecture, Configuration, Features, JD Maloney, NCSA, Presentation
  • 4:00 pm Break
  • 4:30 pm GPFS Architecture, Configuration, Features (continued), JD Maloney, NCSA
  • 5:30 pm Dinner on your own (recommendations provided)

Tuesday, August 14 — Storage (part 2)

  • 8:00 am Breakfast
  • 8:30 am GPFS Hands-On – JD Maloney, NCSA, Tutorial
  • 10:30 am Break
  • 11:00 am Lustre Architecture, Configuration, Features – Charles Wright, Yale University, Presentation
  • Noon Lunch
  • 1:00 pm Lustre Architecture, Configuration, Features (continued) – Charles Wright, Yale University
  • 3:00 pm Break
  • 3:30 pm Lustre Hands-On – Charles Wright, Yale University
  • 5:00 pm Dinner on your own (recommendations provided)

Wednesday, August 15 — Schedulers

  • 8:00 am Breakfast
  • 8:20 am Welcome/Open – Tyler Trafford, Yale University, Presentation
  • 8:30 am Workload Management Overview – Tyler Trafford, Yale University
  • 9:00 am Feature Set Survey – Tyler Trafford, Yale University
  • 9:30 am PBS/Torque/Moab/Maui/LSF/Open Source Tools – Tyler Trafford, Yale University
  • 10:00 am Slurm (include cloud, accounting) – Tyler Trafford, Yale University
  • 10:30 am Break
  • 11:00 am Limiting Resources: Cgroups, Containers, Processor Affinity – Tyler Trafford, Yale University
  • Noon Lunch
  • 1:00 pm Slurm Hands-On – Tyler Trafford, Yale University, Reference
  • 3:45 pm Break
  • 4:15 pm Networking
  • Vernard Martin, Turner Broadcasting System, Presentation
  • 6:00 pm Dinner on your own (recommendations provided)

Thursday, August 16 — Networking

  • 8:00 am Breakfast
  • 8:30 am Science DMZ – Vernard Martin, Turner Broadcasting System, Presentation
  • 10:30 am Break
  • 11:00 am Infiniband: Basics, Hardware, Subnet Managers, Topologies, Omni-Path – Vernard Martin, Turner Broadcasting System
  • Noon Lunch
  • 1:00 pm Infiniband: Basics, Hardware, Subnet Managers, Topologies, Omni-Path (continued) – Vernard Martin, Turner Broadcasting System
  • 3:30 pm Break
  • 4:00 pm OpenStack Lecture – Mike Lowe, Indiana University, Presentations
  • 6:00 pm Dinner on your own (recommendations provided)

Friday, August 17

  • 8:00 am Breakfast
  • 8:30 am OpenStack – Mike Lowe, Indiana University
  • 10:30 am Break
  • 11:00 am OpenStack Hands-On – Mike Lowe, Indiana University
  • Noon Panel Discussion – Erik Scott, Harris Corporation (chair)

The National Center for Supercomputing Applications (NCSA), located at the University of Illinois at Urbana-Champaign, provides computing, data, networking, and visualization resources and services that help scientists and engineers across the country better understand our world. Learn more at www.ncsa.illinois.edu.

Linux Clusters Institute (LCI)
1205 W. Clark St.
Urbana, IL 61801
Email: mierek@illinois.edu