Vectorizing Sparse Coiteration for Two-finger Loop Structure (Extended Abstract)
Sparse tensor compilers struggle to vectorize the data-dependent $\texttt{scf.while}$ co-iteration loops inherent to compressed format intersections. Because standard heuristics assume masked gather operations will negate SIMD throughput gains without high data reuse, existing vectorization efforts largely avoid pure sparse-sparse co-iteration. We challenge this assumption by proposing a novel MLIR optimization pass featuring a dual-path execution model. By natively operating on compressed hierarchies, our pass prepends a predicated, vectorized $\textit{fast lane}$ governed by dynamic runtime bounds checking, retaining the original scalar loop as a $\textit{slow lane}$ epilogue. Contrary to the assumption that such techniques require high-arithmetic-intensity workloads$-$high-order tensor contractions$-$to be profitable, our empirical evaluation demonstrates massive speedups on foundational, low-intensity kernels (SpGEMM, SpMV, MTTKRP). This proves that modern SIMD throughput can effectively overcome indirect memory latencies, unlocking generalized vectorization for dynamic sparse computations.
Tue 16 JunDisplayed time zone: Mountain Time (US & Canada) change
15:50 - 17:30 | |||
15:50 20mTalk | Vectorizing Sparse Coiteration for Two-finger Loop Structure (Extended Abstract) ARRAY | ||
16:10 25mTalk | Leveraging AI Ecosystem for Portable and Sustainable GPU Kernels in HPC ARRAY Yanbo Zhao North Carolina State University, Zhaonan Meng North Carolina State University, Sai Krishna Teja Varma Manthena North Carolina State University, Xu Liu North Carolina State University, Ajay Panyala Pacific Northwest National Laboratory, Jiajia Li North Carolina State University DOI | ||
16:35 20mTalk | Lazy Arithmetic using Systolic Arrays for Closing the Verification Gap on Embedded Systems ARRAY | ||
16:55 20mTalk | Towards a Linear-Algebraic Hypervisor ARRAY Pre-print | ||
17:15 5mResearch preview | Semantics as a Tool of Thought: Provenance-Aware Dimensional Checking in a Reactive Array IR ARRAY Christopher Buck None | ||
17:20 10mLive Q&A | Mini Panel ARRAY | ||