main

GGitHub[PROTON] Intra kernel profiling (#7258)

bf0f56dc创建于 2025年8月1日历史提交

文件	最后提交记录	最后更新时间
Analysis	[AMD] Support ExtractSliceOp for AxisInfo (#7094) This commit updates AxisInfo to support backend callbacks to enable recognizing backend ops. One can use ExtractSliceOp to slice tensors of pointers to refine tt.load or tt.store. The TritonAMDGPUConvertToBufferOpsBase will fail to perform negativity analysis due to the presence of ExtractSliceOp which after rewrites is going to slice tensors of offsets. This PR addresses the issue.	1 年前
Dialect	[PIPELINER] Reintroduce epilogue peeling (#6962) Reintroduce "[PIPELINE] Peel single epilogue iteration after loop expansion #6893" Fixed the issue that was exposing IMA by using poison values as buffer indices used by speculatively executed async copy.	1 年前
Instrumentation	Audit file-private C++ functions to ensure correct linkage (#6237) ### Summary I’ve gone through the C++ sources and updated functions that were file-local but not declared static or placed in anonymous namespaces. These can lead to symbol visibility issues when linking multiple translation units together. This patch: * Marks helper functions in bin/triton-tensor-layout.cpp as static. * Marks internal variables and helpers in lib/Instrumentation/PrintLoadStoreMemSpaces.cpp as static. * Adds static to a number of internal free functions and templates in third_party/f2reduce/f2reduce.cpp. * Corrects linkage for a handful of AMD GPU transforms and stream utilities that were file-local. * Makes file-local helpers in third_party/nvidia/lib/NVGPUToLLVM/NVGPUToLLVMPass.cpp static. * Ensures initProton in third_party/proton/csrc/Proton.cpp is static. * Tidies up similar file-local helpers in test code. I initially made some functions static that were already declared in headers; that’s been reverted so things compile cleanly. All C++ unit tests and lit tests pass, and pre-commit run --from-ref origin/main --to-ref HEAD shows no outstanding issues. ### New contributor declaration - [x] I am not making a trivial change, such as fixing a typo in a comment. - [x] I have written a PR description following these [rules](https://cbea.ms/git-commit/#why-not-how). - [x] I have run pre-commit run --from-ref origin/main --to-ref HEAD. - [x] This PR does not need a test because this is a refactor that only adjusts linkage of file-local functions. - [x] I have not added any lit tests. All tests (make test-nogpu) pass: Testing Time: 1.07s Total Discovered Tests: 131 Passed: 131 (100.00%) 100% tests passed, 0 tests failed out of 207 Total Test time (real) = 1.48 sec	1 年前
Proton	[PROTON] Intra kernel profiling (#7258) ### Instrumentation & Runtime - Introduce a dedicated instrumentation mode - proton.start(..., mode="instrumentation", ...) - Introduce both high- and low- level scope APIs - For Gluon DSL: pl.scope, pl.enter_scope, and pl.exit_scope. Profiling API for Triton DSL is disabled by default. - For TTGIR: proton.record start and proton.record end - Inject profiling buffers for each triton kernel at codegen time and pass them to the proton runtime so kernels can push data directly from the device to the host ### Proton Dialect & Lowering - Add Proton → ProtonGPU → LLVM pipelines, including passes for shared-memory allocation, profile scratch allocation, and a few optimizations for reduced overhead or improved accuracy. ### Tracing - proton.start(..., data="trace", ...) is supported for both fine- and coarse-grained events. --------- Co-authored-by: Yuanwei Fang <fywkevin@gmail.com> Co-authored-by: Yuanwei Fang <fywkevin@fb.com> Co-authored-by: Corbin Robeck <corbin.robeck@amd.com> Co-authored-by: peterbell10 <peterbell10@openai.com> Co-authored-by: Corbin Robeck <corbin.robeck@gmail.com> Co-authored-by: Corbin Robeck <robeck@meta.com> Co-authored-by: robeck <robeck@devgpu284.prn2.facebook.com> Co-authored-by: Srivatsan Ramesh <srivatsan-ramesh@users.noreply.github.com> Co-authored-by: Shawn Zhong <github@shawnzhong.com> Co-authored-by: Shawn Zhong <shawnzhong@fb.com> Co-authored-by: 鐘天楽 <a844379248@icloud.com>	1 年前
CMakeLists.txt	[PROTON] Intra kernel profiling (#7258) ### Instrumentation & Runtime - Introduce a dedicated instrumentation mode - proton.start(..., mode="instrumentation", ...) - Introduce both high- and low- level scope APIs - For Gluon DSL: pl.scope, pl.enter_scope, and pl.exit_scope. Profiling API for Triton DSL is disabled by default. - For TTGIR: proton.record start and proton.record end - Inject profiling buffers for each triton kernel at codegen time and pass them to the proton runtime so kernels can push data directly from the device to the host ### Proton Dialect & Lowering - Add Proton → ProtonGPU → LLVM pipelines, including passes for shared-memory allocation, profile scratch allocation, and a few optimizations for reduced overhead or improved accuracy. ### Tracing - proton.start(..., data="trace", ...) is supported for both fine- and coarse-grained events. --------- Co-authored-by: Yuanwei Fang <fywkevin@gmail.com> Co-authored-by: Yuanwei Fang <fywkevin@fb.com> Co-authored-by: Corbin Robeck <corbin.robeck@amd.com> Co-authored-by: peterbell10 <peterbell10@openai.com> Co-authored-by: Corbin Robeck <corbin.robeck@gmail.com> Co-authored-by: Corbin Robeck <robeck@meta.com> Co-authored-by: robeck <robeck@devgpu284.prn2.facebook.com> Co-authored-by: Srivatsan Ramesh <srivatsan-ramesh@users.noreply.github.com> Co-authored-by: Shawn Zhong <github@shawnzhong.com> Co-authored-by: Shawn Zhong <shawnzhong@fb.com> Co-authored-by: 鐘天楽 <a844379248@icloud.com>	1 年前