Amazon FSx for Lustre
Prepare your environment for this section:
This will make the following changes to your lab environment:
- Create an IAM role for the Amazon FSx for Lustre CSI driver
- Create an Amazon Simple Storage Service (S3) bucket for use in the workshop
You can view the Terraform that applies these changes here.
Amazon FSx for Lustre is a fully managed service that provides high-performance, cost-effective, and scalable storage powered by Lustre, the world’s most popular high-performance file system. FSx for Lustre provides the fastest storage performance for GPU instances in the cloud with up to terabytes per second of throughput, millions of IOPS, sub-millisecond latencies, and virtually unlimited storage capacity. It delivers up to 34% better price performance compared to on-premises HDD file storage and up to 70% better price performance compared to other cloud-based Lustre storage.
The Amazon FSx for Lustre Container Storage Interface (CSI) driver provides a CSI interface that allows Amazon EKS clusters to manage the lifecycle of Amazon FSx for Lustre file systems.
In this lab, we will create an Amazon FSx for Lustre file system to provide persistent, shared storage for our EKS cluster. The FSx for Lustre file system uses an S3 bucket as the data repository, and a Data Repository Association (DRA) will be created between the the Lustre file system and the S3 bucket.
We will cover the following topics:
- Ephemeral Container Storage
- Introduction to FSx for Lustre
- FSx for Lustre with S3 DRA