HomeSC is the International Conference for
 High Performnance Computing, Networking, Storage and Analysis
scyourway

SC Conference - Activity Details



Lustre, ZFS, and End-to-End Data Integrity

Primary Session Leader:
Hua Huang  (Sun Microsystems)

Birds-of-a-Feather Session
Tuesday,  05:30PM - 07:00PM
Room E145-146
Abstract:
Lustre kDMU uses Solaris ZFS as a new storage backend to gradually replace ldiskfs. The goal is to take advantage of the many advanced features ZFS provides including capacity and performance enhancements coupled with a data integrity architecture and simplified administrative interface. In 2008, an LLNL engineer successfully ported kernel-resident ZFS for Redhat Linux. Since then, the Lustre group has leveraged LLNL's work and is building Lustre on ZFS/DMU within a production environment. The project is refereed to as Lustre kDMU since the DMU (Data Management Unit) is the core ZFS component being introduced into Linux. In this BOF session, we will present the architecture for Lustre/ZFS integration and will demonstrate the data and metadata functionalities as well as end-to-end data integrity through an interactive user session. We will explore the performance comparison between ZFS and ldiskfs based Lustre solutions.
   Sponsors    ACM    IEEE