CaLRS: A Critical-Aware Shared LLC Request Scheduling Algorithm on GPGPU

Autor: Jianliang Ma, Jinglei Meng, Tianzhou Chen, Minghui Wu
Jazyk: angličtina
Rok vydání: 2015
Předmět:
Zdroj: The Scientific World Journal, Vol 2015 (2015)
Druh dokumentu: article
ISSN: 2356-6140
1537-744X
DOI: 10.1155/2015/848416
Popis: Ultra high thread-level parallelism in modern GPUs usually introduces numerous memory requests simultaneously. So there are always plenty of memory requests waiting at each bank of the shared LLC (L2 in this paper) and global memory. For global memory, various schedulers have already been developed to adjust the request sequence. But we find few work has ever focused on the service sequence on the shared LLC. We measured that a big number of GPU applications always queue at LLC bank for services, which provide opportunity to optimize the service order on LLC. Through adjusting the GPU memory request service order, we can improve the schedulability of SM. So we proposed a critical-aware shared LLC request scheduling algorithm (CaLRS) in this paper. The priority representative of memory request is critical for CaLRS. We use the number of memory requests that originate from the same warp but have not been serviced when they arrive at the shared LLC bank to represent the criticality of each warp. Experiments show that the proposed scheme can boost the SM schedulability effectively by promoting the scheduling priority of the memory requests with high criticality and improves the performance of GPU indirectly.
Databáze: Directory of Open Access Journals