Backend
Easy Multi-Precision Acceleration via Vectorization
arXiv cs.DC0 views
arXiv:2611.05558v1 Announce Type: cross Abstract: High level programming languages and accelerators are powerful enablers for a wide range of applications. Accelerators offer significant performance via diverse numeric precision and increased memory bandwidth and capacity. These enable new algorithms to be explored. Construction of these algorithms can be enabled by the ready accessibility of these performance features in high-level languages. Achieving scalable vertical (within a compute node), precision (over various numeric precisions), and temporal (over different generations of hardware) performance while retaining productivity requires effective abstractions. Vectorized coding that expresses operations as high-level matrix mathematics has historically been an important method for achieving portable performance. This paper examines the performance availability across a wide range of precisions and hardware using simple vectorized coding techniques applied to several example programs that highlight bandwidth, real and complex matrix multiplication, and 2D convolution. The systems evaluated span nearly a decade of computing hardware, enabling direct comparison of performance gains over this period. This work demonstrates that near hardware peak performance is readily accessible from high-level programming environments. In particular for memory bandwidth, real and complex matrix multiplication in double/single/half precision, and 2D convolutions using the Fast Fourier Transform (FFT). Furthermore, algorithms that trade decreased compute intensity for increased memory intensity have significant potential.
Source:https://arxiv.org/abs/2611.05558PreviousUnlocking Turing Tensor Cores: A Measured Throughput Account of From-Scratch Pre-training on a Single 22G RTX 2080 TiNextRESHPart: Feedback-Reshaped Spectral Embedding for Hypergraph Partitioning
Related posts
GTI-mSEMP Framework : A Proposed Framework to Simulate Malware Propagation with Inclusion of Attacker-Defender Strategy
0arXiv cs.NI
When Does Risk-Controlled Throughput Forecasting Actually Control Risk? A Reproduction Study on LEO Satellite Link
0arXiv cs.NI
Mobility-Aware Mobile Edge Computing for Energy-Balanced Data Collection in IoT-Enabled Underwater Sensor Networks
0arXiv cs.NI
Coexistence-Aware Antenna Tilt and Resource Allocation for Cellular-Connected UAV Corridors
0arXiv cs.NI
StarWorld: A Cross-Layer World Model for Starlink Prediction and Streaming
0arXiv cs.NI
The Confidence Score: a New Measure on Kernels
0arXiv eess.SP