Poseidon: Profile-Guided Numerical Rewriting at Full-Application Scale
Floating-point numbers are finite-precision approximations to real numbers and are ubiquitous in computer applications in nearly every field. Selecting the right floating-point representation that balances performance and numerical accuracy is a difficult task, one that has become even more critical as hardware trends toward high-performance, low-precision operations. Although a plethora of numerical techniques, including algebraic rewriting and mixed-precision tuning, can help navigate the tradeoff between performance and accuracy, applying complex numerical optimizations to real-world code is still a challenging engineering task that requires mathematical expertise and application-specific numerical context. We present Poseidon, a modular and extensible framework that fully automates floating-point optimizations for real-world applications within a production compiler. Within a production compiler, Poseidon auto-extracts symbolic expressions from pre-optimized IR, derives their numerical context from a small surrogate profile, and composes candidates from diverse techniques (e.g., Herbie’s e-graph-based algebraic rewrites and ADAPT-style precision tuning) via a shared dynamic-programming solver. On a quaternion differentiator, Poseidon composes algebraic rewriting with precision tuning for a $1.46\times$ speedup at relative error of $10^{-7}$. On DOE’s proxy application LULESH, Poseidon recovers optimal FP64 accuracy without substantially reducing performance.
Mon 15 JunDisplayed time zone: Mountain Time (US & Canada) change
15:50 - 17:30 | |||
15:50 25mTalk | Relational E-matching in an SMT solver EGRAPHS Amar Shah Carnegie Mellon University, Marijn Heule Carnegie Mellon University, Bryan Parno Carnegie Mellon University, Max Willsey University of California at Berkeley | ||
16:15 25mTalk | E-Stitch: Top-Down Library Learning for E-Graphs EGRAPHS Kavi Gupta MIT, Maddy Bowers Massachusetts Institute of Technology, Armando Solar-Lezama Massachusetts Institute of Technology File Attached | ||
16:40 25mTalk | Optimizing Optimizations, Declaratively: Optimizing the Higher-Order Functions in Mathematical Optimization with egglog EGRAPHS Hiromi Ishii JIJ Pre-print File Attached | ||
17:05 25mTalk | Poseidon: Profile-Guided Numerical Rewriting at Full-Application Scale EGRAPHS Siyuan Brant Qian University of Illinois at Urbana-Champaign, Vimarsh Sathia University of Illinois Urbana Champaign, Ivan Ivanov Institute of Science Tokyo, Jan Hueckelheim Argonne National Laboratory, Paul Hovland Argonne National Laboratory, William S. Moses University of Illinois Urbana-Champaign | ||