Performance Optimization of Storage Engine Based on Non-Volatile Memory


National Key Research and Development Program of China (2018YFB1004401), National Natural Science Foundation of China Youth Program (61502392), Beijing Natural Science Foundation-Haidian District Joint Fund for Original Innovation Project (L192027), Shaanxi Key Research and Development Program (2021ZDLGY03-02, 2021ZDLGY03-08), and Key Integration Program of National Natural Science Foundation of China (92152301)

Ethical statement:

  • Article
  • |
  • Figures
  • |
  • Metrics
  • |
  • Reference
  • |
  • Related
  • |
  • Cited by
  • |
  • Materials

    Non-volatile memory has a read/write speed that is comparable to dynamic random access memory and can be used to replace traditional storage devices to improve the performance of storage engines. However, existing storage engines typically use generic block interfaces to access devices, resulting in a long I/O software stack, increasing read/write latency at software layers, thereby limiting the performance benefits of non-volatile memory. To solve this problem, this paper proposes a new storage engine, named NVMStore, which is based on non-volatile memory and the Ceph big-data storage system platform. NVMStore accesses storage devices through memory mapping and optimizes data read/write processes according to byte-addressability and data persistence characteristics of non-volatile memory, thus reducing the data write amplification and software stack overhead. Experimental results on real non-volatile memory devices show that NVMStore can significantly improve the performance of Ceph when dealing with small block data read/ write workloads, compared with traditional storage engines using non-volatile memory.

    Cited by
Get Citation

WANG Haitao, LI Zhanhuai, ZHANG Xiao, ZHAO Xiaonan. Performance Optimization of Storage Engine Based on Non-Volatile Memory[J]. Journal of Integration Technology,2022,11(3):56-70

Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Received:
  • Revised:
  • Adopted:
  • Online: May 18,2022
  • Published: