基于非易失性存储器的存储引擎性能优化
基于非易失性存储器的存储引擎性能优化
作者:
作者单位:

作者简介:

通讯作者:

基金项目:

国家重点研发计划项目(2018YFB1004401);国家自然科学基金青年项目(61502392);北京市自然科学基金-海淀原始创新联合基金 项目(L192027);陕西省重点产业链项目(2021ZDLGY03-02, 2021ZDLGY03-08);国家自然科学基金重大集成项目(92152301)

伦理声明:



Performance Optimization of Storage Engine Based on Non-Volatile Memory
Author:
Ethical statement:

Affiliation:

Funding:

National Key Research and Development Program of China (2018YFB1004401), National Natural Science Foundation of China Youth Program (61502392), Beijing Natural Science Foundation-Haidian District Joint Fund for Original Innovation Project (L192027), Shaanxi Key Research and Development Program (2021ZDLGY03-02, 2021ZDLGY03-08), and Key Integration Program of National Natural Science Foundation of China (92152301)

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
    摘要:

    非易失性存储器具有接近内存的读写速度,可利用其替换传统的存储设备,从而提升存储引擎的性能。但是,传统的存储引擎通常使用通用块接口读写数据,导致了较长的 I/O 软件栈,增加了软件层的读写延迟,进而限制了非易失性存储器的性能优势。针对这一问题,该文以 Ceph 大数据存储系统为基础,研究设计了基于非易失性存储器的新型存储引擎 NVMStore,通过内存映射的方式访问存储设备,根据非易失性存储器的字节可寻址和数据持久化特性,优化数据读写流程,从而减小数据写放大以及软件栈的开销。实验结果表明,与使用非易失性存储器的传统存储引擎相比,NVMStore能够显著提升 Ceph 的小块数据读写性能。

    Abstract:

    Non-volatile memory has a read/write speed that is comparable to dynamic random access memory and can be used to replace traditional storage devices to improve the performance of storage engines. However, existing storage engines typically use generic block interfaces to access devices, resulting in a long I/O software stack, increasing read/write latency at software layers, thereby limiting the performance benefits of non-volatile memory. To solve this problem, this paper proposes a new storage engine, named NVMStore, which is based on non-volatile memory and the Ceph big-data storage system platform. NVMStore accesses storage devices through memory mapping and optimizes data read/write processes according to byte-addressability and data persistence characteristics of non-volatile memory, thus reducing the data write amplification and software stack overhead. Experimental results on real non-volatile memory devices show that NVMStore can significantly improve the performance of Ceph when dealing with small block data read/ write workloads, compared with traditional storage engines using non-volatile memory.

    参考文献
    相似文献
    引证文献
引用本文

引文格式
王海涛,李战怀,张晓,赵晓南.基于非易失性存储器的存储引擎性能优化 [J].集成技术,2022,11(3):56-70

Citing format
WANG Haitao, LI Zhanhuai, ZHANG Xiao, ZHAO Xiaonan. Performance Optimization of Storage Engine Based on Non-Volatile Memory[J]. Journal of Integration Technology,2022,11(3):56-70

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
历史
  • 收稿日期:
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2022-05-18
  • 出版日期: