Google and DDN have announced the general availability of Google Cloud Managed Lustre, a managed, high-performance parallel file system service, powered by DDN’s EXAScaler technology.
According to the announcement, Google Cloud Managed Lustre “delivers industry-leading performance of up to 1 TB/s read throughput with <1ms latency and can scale seamlessly from 18 TiB to 8 PiB+.”
Google says Managed Lustre provides “a POSIX-compliant, parallel file system that delivers consistently high throughput and low latency,” which is essential for:
- High-throughput inference
- Large-scale model training
- Checkpointing and restarting large models
- Data preprocessing and feature engineering
- Scientific simulations and research
Learn more at Google.
