Scientific applications are increasingly adopting Artificial Intelligence (AI) techniques to advance science. There are specialized hardware accelerators designed and built to run AI applications efficiently. With a wide diversity in the hardware architectures and software stacks of these systems, it is challenging to understand the differences between these accelerators, their capabilities, programming approaches, and how they perform, particularly for scientific applications.
In this tutorial, we will cover an overview of the AI accelerators landscape with a focus on SambaNova, Cerebras, Graphcore, Groq, and Habana systems along with architectural features and details of their software stacks. We will have hands-on exercises that will help attendees understand how to program these systems by learning how to refactor codes written in standard AI framework implementations and compile and run the models on these systems. The tutorial will enable the attendees with an understanding of the key capabilities of emerging AI accelerators and their performance implications for scientific applications.
| Date | Sunday, 12 November 2023 |
|---|---|
| Time | 8:30am - 12:00pm MST |
| Location | 203. Colorado Convention Center, Denver, CO |
| Time (MST) | Topic |
|---|---|
| 08.30 - 8.35 | Murali Emani(ANL) [Slides] |
| 08.35 - 8.50 | Claire Zhang Cerebras Systems [Slides] [Videos] |
| 08.50 - 9.05 | Petro Junior Milan (SambaNova Systems)[Slides] [Video] |
| 09.05 - 9.20 | Alex Tsyplikhin (Graphcore)[Slides] |
| 09.20 - 9.35 | Sanjif Shanmugavelu (Groq) [Slides] [Video] |
| 09.35 - 9.50 | Leon Tran (Intel Habana)[Slides] [Video] |
| 10.00 - 10.30 | Break |
| 10.30 - 12.00 | Hands session on the AI Testbed (ANL) |
- Request an ALCF Computer User Account if you do not currently have one
- If you have an ALCF Account that is currently inactive, submit an account reactivation request*.
- If you have an active ALCF account, click Join Project to submit a membership request. Specify the following in your request:
Project Name:
aitestbed_tutorial
Contact [email protected] M-F 9am to 5pm CT.
Reach out to us on slack channel #help-accounts on ALCF-AIAccelerator-tutorials Slack.
SC23 Tutorial allocation will stay active till end of November 2023.
To gain access to AI Testbeds at ALCF after tutorial allocation expires apply for Director’s Discretionary Allocation Program
The ALCF Director’s Discretionary program provides “start up” awards to researchers working to achieve computational readiness for for a major allocation award.
- SC23 Tutorial Webpage
- Github Tutorial Repository
- Overview of AI Testbeds at ALCF
- ALCF AI Testbed Documentation
- Director’s Discretionary Allocation Program
- Join Slack Workspace
Contributors: Siddhisanket (Sid) Raskar, Varuni Sastry, Bill Arnold, Murali Emani.
This research used resources of the Argonne Leadership Computing Facility, which is a DOE Office of Science User Facility supported under Contract DE-AC02-06CH11357.