Gfarm/BB——Gfarm File System for Node-Local Burst Buffer

查看全文 作　　者：Osamu [1]Tatebe;[1]Member;[1]ACM;Shukuko [2]Moriwake;Yoshihiro [3]Oyama 机构地区：[1]Center for Computational Sciences,University of Tsukuba,Ibaraki 3058577,Japan;[2]SURIGIKEN Co.,Ltd.,Tokyo 1000004,Japan;[3]Faculty of Engineering,Information and Systems,University of Tsukuba,Ibaraki 3058573,Japan 出　　处：《Journal of Computer Science & Technology》索引2020年第35卷第1期,共11页 基　　金：This work is partially supported by the JSPS KAKENHI Grant No.17H01748,JST CREST Grant No.JPMJCR1414;New Energy and Industrial Technology Development Organization(NEDO),and Fujitsu Laboratories. 摘　　要：Burst buffer has become a major component to meet the I/O performance requirement of HPC bursty traffic.This paper proposes Gfarm/BB that is a file system for a burst buffer efficiently exploiting node-local storage systems.Although node-local storages improve storage performance,they are only available during the job allocation.Gfarm/BB should have better access and metadata performance while it should be constructed on-demand before the job execution.To improve the read and write performance,it exploits the file descriptor passing and remote direct memory access(RDMA).It improves the metadata performance by omitting the persistency and the redundancy since it is a temporal file system.Using RDMA,writes and reads bandwidth are improved by 1.7x and 2.2x compared with IP over InfiniBand(IPoIB),respectively.It achieves 14700 operations per second in the directory creation performance,which is 13.4x faster than the fully persistent and redundant case.The construction of Gfarm/BB takes 0.31 seconds using 2 nodes.IOR benchmark and ARGOT-IO application I/O benchmark show the scalable performance improvement by exploiting the locality of node-local storages.Compared with BeeOND,Gfarm/BB shows 2.6x and 2.4x better performance in IOR write and read benchmarks,respectively,and it shows 2.5x better performance in ARGOT-IO. 关 键 词：BURST BUFFER node-local storage ON-DEMAND file system remote direct memory access