Technical Computing
by John Lalande
Scott Nolin and I attended the Lustre Administrators and Developers Conference 2013 (LAD '13) in Paris last month (9/16 - 17).
Scott spoke about testing done here at SSEC on a next-generation distributed file system. SSEC has nearly 6 petabytes of storage, and that storage is increasingly pooled in large distributed file systems, where a single volume (e.g., /data) is stored across dozens of servers.
Scott Nolin presenting at the LAD '13 conference in Paris.
TC's proposed storage solution would use Lustre on ZFS. Lustre is the distributed file system, which pools servers connected by fast InfiBand into large storage volumes. ZFS is a file system developed by Sun Microsystems (now Oracle) that provides superior data integrity by performing end-to-end checksums and detecting & correcting data corruption on the fly.
Dell granted SSEC several thousand dollars worth of hardware to test this proposed solution, which we will soon put into production for the Data Center's newest satellite data archive.
You can see the slides from Scott's presentation here: http://www.eofs.eu/fileadmin/lad2013/slides/14_Scott_Nolin_lad2013-ssec-lustre-zfs.pdf
As always, if you have any questions or concerns, please drop us a note, or stop by and visit us in room 439.
john.lalande@ssec.wisc.edu / 608-263-2268
