Adaptive and transparent cache bypassing for GPUs

A. Li, G.-J. van den Braak, A. Kumar, H. Corporaal

Onderzoeksoutput: Hoofdstuk in Boek/Rapport/CongresprocedureConferentiebijdrageAcademicpeer review

42 Citaten (Scopus)

Samenvatting

In the last decade, GPUs have emerged to be widely adopted for general-purpose applications. To capture on-chip locality for these applications, modern GPUs have integrated multilevel cache hierarchy, in an attempt to reduce the amount and latency of the massive and sometimes irregular memory accesses. However, inferior performance is frequently attained due to serious congestion in the caches results from the huge amount of concurrent threads. In this paper, we propose a novel compile-time framework for adaptive and transparent cache bypassing on GPUs. It uses a simple yet effective approach to control the bypass degree to match the size of applications' runtime footprints. We validate the design on seven GPU platforms that cover all existing GPU generations using 16 applications from widely used GPU benchmarks. Experiments show that our design can significantly mitigate the negative impact due to small cache sizes and improve the overall performance. We analyze the performance across different platforms and applications. We also propose some optimization guidelines on how to efficiently use the GPU caches.

Originele taal-2Engels
TitelProceedings of SC 2015: The International Conference for High Performance Computing, Networking, Storage and Analysis
Plaats van productieNew York
UitgeverijAssociation for Computing Machinery, Inc
Aantal pagina's12
ISBN van elektronische versie978-1-4503-3723-6
DOI's
StatusGepubliceerd - 15 nov 2015
Evenement27th International Conference for High Performance Computing, Networking, Storage and Analysis (SC 2015), November 15-20, 2015, Austin, Texas, United States - Austin, Verenigde Staten van Amerika
Duur: 15 nov 201520 nov 2015

Congres

Congres27th International Conference for High Performance Computing, Networking, Storage and Analysis (SC 2015), November 15-20, 2015, Austin, Texas, United States
Land/RegioVerenigde Staten van Amerika
StadAustin
Periode15/11/1520/11/15

Vingerafdruk

Duik in de onderzoeksthema's van 'Adaptive and transparent cache bypassing for GPUs'. Samen vormen ze een unieke vingerafdruk.

Citeer dit