Performance Modeling of Atomic Additions on GPU Scratchpad Memory
| Autor: | José Ignacio Benavides Benítez, José María González-Linares, Nicolás Guil Mata, Juan Gómez-Luna |
|---|---|
| Rok vydání: | 2013 |
| Předmět: |
Record locking
Computer science Parallel computing Thread (computing) Replication (computing) Lock (computer science) Instruction set Concurrency control CUDA Computational Theory and Mathematics Shared memory Hardware and Architecture Signal Processing Atomic operations Throughput (business) Scratchpad memory |
| Zdroj: | IEEE Transactions on Parallel and Distributed Systems. 24:2273-2282 |
| ISSN: | 1045-9219 |
| DOI: | 10.1109/tpds.2012.319 |
| Popis: | GPU application implementations using scatter approaches will fall into write contention due to atomic updates of output elements, if these result from more than one input element. Colliding threads will be serialized, seriously harming performance. Dealing with these issues requires a proper understanding of the behavior of the scratchpad or shared memory under conflicting accesses caused by concurrent threads. Thus, this paper presents an exhaustive microbenchmark-based analysis of atomic additions in shared memory that quantifies the impact of access conflicts on latency and throughput. This analysis has led us to discover the lock mechanism that enables atomic updates to shared memory and to propose a performance model to estimate the latency penalties due to collisions by position or bank conflicts. Then, we have derived experiments from this model that show us the way to optimize applications using atomic operations. Position and bank conflicts can be diminished by replication and padding, respectively. The benefits of such techniques are illustrated with the optimization of two widely used voting processes: the centroid updating step in k-means clustering, and histogram calculation. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|