Exploring Level-Wise Interpolation to Improve Lossy Compression Ratio for AMR Applications

Abstract

Adaptive Mesh Refinement (AMR) is widely adopted in High-Performance Computing (HPC) systems. However, none of existing AMR storage solutions has considered the high similarities among the adjacent AMR levels, which leads to a lower storage efficiency. In this paper, we propose level-wise data interpolation techniques to further reduce the storage of AMR applications. In particular, it generates finer level data based on coarser levels. Then, the differences (deltas) between the interpolated data and original data are stored to achieve a higher compression ratio for lossy compressors. We firstly use median absolute deviation and standard deviation to decide which interpolations are adopted. After that, we evaluate the effectiveness of level-wise interpolation with ZFP and SZ lossy compressors. The experimental results show that the compression ratio of deltas are improved up to 3*compared to directly compressing the finer level data.

Publication
In The International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery, Pages 259-266