Open
【openEuler-26.09】轻量级显存管理基础设施 FaMem #10313
guber1Add on  1 hour ago
guber1
1 hour ago Create

【特性描述】

issue 用于将 FaMem 合入openEuler-26.09 创新分支,提供轻量级显存管理基础设施。
FaMem 为每 NPU 建立稳定虚拟地址 Arena 承载权重与 KV Cache,由 HBM Server 管理物理页与租约,suspend 释放物理 HBM、resume 由 Copier 逐层恢复并与推理流水重叠,降低模型切换时延,支持多实例 HBM 时分复用。

【涉及仓库】

openEuler-26.09

【交付个人/团队】

NPU连接池团队

likedislike
openeuler-ci-botopeneuler-ci-botCollaborators
1 hour ago Assign wkfxxx、zeng_zhaorong、sanglipeng、guber1、oekernel、hanjunguo as responsible person
openeuler-ci-botopeneuler-ci-botCollaborators
1 hour ago Added label: sig/Kernel
openeuler-ci-bot
openeuler-ci-botCollaborators
1 hour ago Comments:

Welcome To openEuler Community

Hey @guber1 , thanks for your contribution to the community.

Bot Usage Manual

I'm the Bot here serving you. You can find the instructions on how to interact with me at Here . That means you can comment below every pull request or issue to trigger Bot Commands. You can self-configure the PR merge rules for this repository. For more details, please refer to Here.

Contact Guide

If you have any questions, please contact the SIG: Kernel ,
and any of the maintainers: @hanjunguo, @oekernel, @sanglipeng, @wkfxxx, @zeng_zhaorong ,
and any of the committers: @AlphaLan2025, @CTC-XiboWang, @Frank_Sae, @GoGo_phytium, @GongLei-, @LiuYongQiang0816, @SuperSix173, @Tankll2021, @TrueAI, @YiweiZ, @allen-shi, @alvin-ling, @baratta, @bibo_mao, @caixu-blue, @chen-jun-hw, @chenjiesong, @chenjunxin1992, @chenke2026, @chenxiaosonggitcode, @chiqijun, @chizl, @chriszjh, @duanqiangwen, @eaglew-forge, @eingesch, @fangfeng123, @fanghaiqinghw, @gang_he, @gaojuxin09, @gcw_EzAoulpf, @gouhao2022, @guohaocs2c, @guzitao, @hanjunguo, @hanliyang, @hellotcc, @henryze, @hewanhan, @hjx_gitff, @hongwu-wang, @howard_lu, @htforge, @hu-chunzhi, @hunan4222, @huzhitao, @hygmm, @jackknight, @jerry_lilijun, @jiayi0118, @junlong-zheng, @juntianlinux, @kailiu42, @kaitiandu, @kazero00, @kevinzhu1, @kile2009, @klmengkd, @koishimind, @kongzizaixian, @kunlun_spurs, @kylin-mayukun, @leap-io, @leap-zjke, @leoliu-oc, @li-huisong, @linan888, @linyuexie1, @linyunsheng, @liulongfang, @liyihang0226, @lostway1, @lujialin2, @mao-hongbo, @markyuan4ta21, @mawupeng, @mingqian218472, @mingrui-liu, @mufengyan, @nebulamatrix_rdma, @peterpangogogo, @pigalsofine, @qich, @raoxu-deepin, @robinorg, @rock_hw, @sageDriver, @sanglipeng, @shu-shengming, @shuaijiakun, @sinat_17738335, @siyanteng, @sming56_admin, @stavewu, @stkid, @sun_nanyong, @wangboe2022, @wanghang73, @wenzhiwei11, @whoisxxx, @wkfxxx, @woqidaideshi, @wsoydl, @xingmz1, @xukuohai, @yeweihua999, @ygn-ndwd-official, @yonghu_4dc5, @young-sun, @yubo-liu1, @yuehaibing_planb, @yuzenghui1, @zhang-changzhong, @zhangguodong11, @zhangyi089, @zhujianwei001, @zichengqu, @zouyipeng, @zqiao216 .

likedislike
Gguber1
1 hour ago Modify description of issue
Gguber1
1 hour ago Change title to "【openEuler-26.09】NPU 显存虚拟化与时分复用基础设施 hbm_server", originally titled "【openEuler-26.09】NPU 显存虚拟化与时分复用基础设施".
Gguber1
1 hour ago Change title to "【openEuler-26.09】NPU 显存虚拟化与时分复用基础设施 FaMem", originally titled "【openEuler-26.09】NPU 显存虚拟化与时分复用基础设施 hbm_server".
Gguber1
1 hour ago Change title to "【openEuler-26.09】轻量级NPU显存管理基础设施 FaMem", originally titled "【openEuler-26.09】NPU 显存虚拟化与时分复用基础设施 FaMem".
Gguber1
1 hour ago Modify description of issue
Gguber1
1 hour ago Change title to "【openEuler-26.09】轻量级显存管理基础设施 FaMem", originally titled "【openEuler-26.09】轻量级NPU显存管理基础设施 FaMem".
Gguber1
59 minutes ago Modify description of issue
Oopeneuler-infra-botCollaborators
7 minutes ago Associated pull request