Analyzing Data Locality on GPU Caches using Static Profiling of Workloadsopen access
- Authors
- Kim, Jieun; Eom, Hyeonsang; Kim, Yoonhee
- Issue Date
- Aug-2023
- Publisher
- Institute of Electrical and Electronics Engineers Inc.
- Keywords
- Codes; Correlation; Data locality; Estimation; GPGPU workload analysis; GPU cache; GPU profiling; Graphics processing units; Instruction sets; Memory management; Message systems; PTX code
- Citation
- IEEE Access, v.11, pp 95939 - 95947
- Pages
- 9
- Journal Title
- IEEE Access
- Volume
- 11
- Start Page
- 95939
- End Page
- 95947
- URI
- https://scholarworks.sookmyung.ac.kr/handle/2020.sw.sookmyung/159033
- DOI
- 10.1109/ACCESS.2023.3307315
- ISSN
- 2169-3536
2169-3536
- Abstract
- The diversity of workloads drives studies to use GPU more effectively to overcome the limited memory of GPUs. Precisely, it is essential to understand and utilize data locality of workloads to utilize the memory and cache efficiently, which is relatively smaller than CPU’s. It is important to understand GPU memory hierarchy to efficiently use with multi-thread environment. Although there have been previous approaches to analyzing data locality on GPUs, these approaches focused on global memory and L2 cache levels with profiling at thread block levels. The data locality study in warp level in GPU has not been studied much. Especially, the concept of coalescing has been defined but the method of measuring the degree of coalescing has not been discussed. In this paper, we analyze data locality in L1 cache levels, which is the smallest but fastest in cache level to analyze the impact of data locality. To achieve this analysis, we profile data locality in warp level, which is smallest segment in GPU thread groups. We define the degree of coalescing besides static profiling of data locality and provide the estimation of refined locality from profiling of L1 cache data access patterns. As a proof-of-concept, the estimation using the proposed method are evaluated with the performance comparison to diverse real-world GPU benchmarks such as Rodina and Polybench. The locality metrics with coalescing on experiments showed meaningful correlation with cache utilization for performance enhancement. Author
- Files in This Item
-
Go to Link
- Appears in
Collections - 공과대학 > 소프트웨어학부 > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.