Bridging the Memory Hotness Gap in Edge Systems with Hotness-Segregated Object Allocation
This program is tentative and subject to change.
Kernel operations in resource-constrained edge systems, such as memory swapping and deduplication, use the access frequency (hotness) of memory pages to guide page placement and reclamation. However, these operations suffer from page-hotness skew: a page may contain a mix of highly accessed and infrequently accessed objects, which causes inaccurate page-level classification, wasted DRAM capacity, and expensive I/O.
We attribute this skewness to a cross-layer mismatch: the kernel manages memory at page granularity, whereas user-level allocators place objects without considering access hotness.
To bridge this gap, we present HotMalloc, a memory allocator that reduces this skewness through object-granularity hotness-segregated allocation.
HotMalloc uses profile-guided optimization to analyze object access patterns offline and synthesizes an application-specific allocator.
At runtime, HotMalloc identifies object hotness from offset-encoded call-site contexts and co-locates objects with similar hotness on the same pages without adding per-access overhead.
Additionally, HotMalloc exposes simple interfaces to inform the kernel of page hotness.
Evaluation on memory swapping and deduplication shows that HotMalloc significantly reduces skewness and improves hotness-aware kernel operations by 4.6% to 42.1%.
This program is tentative and subject to change.
Tue 16 JunDisplayed time zone: Mountain Time (US & Canada) change
15:30 - 17:00 | |||
15:30 22mTalk | LoopHint: A Compiler-Assisted Loop Branch Predictor for Embedded DSPs LCTES Yuanyang Xiang Institute of Automation, Chinese Academy of Sciences, Chen Xu , xiaoruozhou Institute of Automation, Chinese Academy of Sciences, Zhiwei Zhang Institute of Automation, Chinese Academy of Sciences DOI | ||
15:52 22mTalk | MemSpec: Memory-Aware Runtime for Adaptive Draft Scheduling in Speculative Decoding on Edge Devices LCTES Eunjeong Kim Kyungpook National University, Yeong Jun Jeon Kyungpook National University, Myeonggyun Han Kyungpook National University DOI | ||
16:15 22mTalk | Bridging the Memory Hotness Gap in Edge Systems with Hotness-Segregated Object Allocation LCTES Ruizhe Huang Peking University, Jiahua Wang Peking University, Qihang Xu Peking University, Peng Jiang Southeast University, Zhida An Peking University, Ding Li Peking University, Yao Guo Peking University, Xiangqun Chen Peking University, Yuxin Ren Huawei Technologies, Ning Jia Huawei Technologies DOI | ||
16:37 22mTalk | On the Origins of Indirect Jumps in Embedded Software LCTES Ariane Nicolas Univ Rennes, Inria, CNRS, IRISA, Ronan Lashermes Rambus, Isabelle Puaut Université de Rennes - Inria - CNRS - IRISA, Erven Rohou Université de Rennes - Inria - CNRS - IRISA DOI | ||