Maximizing Performance Through Memory-Hierarchy Driven Data Layout Transformations

Published in MCHPC 2022: Workshop on Memory Centric High Performance Computing at SC22, 2022

Citation: Incoming... Check back later

You can download a copy of the workshop paper here.


Computations on structured grids using standard multidimensional array layouts can incur substantial data movement costs through the memory hierarchy. This presentation explores the benefits of using a framework (Bricks) to separate the complexity of data layout and optimized communication from the functional representation. To that end, we provide three novel contributions and evaluate them on several kernels taken from GENE, a phase-space fusion tokamak simulation code. We extend Bricks to support 6-dimensional arrays and kernels that operate on complex data types, and integrate Bricks with cuFFT. We demonstrate how to optimize Bricks for data reuse, spatial locality, and GPU hardware utilization achieving up to a 2.67Ă— speedup on a single A100 GPU. We conclude with insights on how to rearchitect memory subsystems.


This work was presented at MCHPC 2022 in Dallas, Texas at the annual Supercomputing conference in November of 2022. See more on the presentation here.


Incoming… Check back later