Checklist

• 1. I have searched the existing issues (https://gitcode.com/mindspore/hyper-parallel/issues)
• 2. I have read the relevant documentation.
• 3. I have created a minimal reproduction case that clearly demonstrates the issue, including a complete code example and the error message with full traceback and error logs.

🐛 Describe the bug

不同transformers代码许多model shape定义、函数接口不一致，导致不兼容。例如 Qwen3VL模型：

1. 专家参数定义不一致
   
   
2. router的返回参数数量、含义不同

涉及代码：

1. hyper_parallel/integration/llamafactory/expert_parallel/models/qwen3_vl_moe.py
2. hyper_parallel/integration/llamafactory/utils.py

Expected behavior

兼容4.57.x版本transformers

Additional context

Environment info

transformers 4.57.3

Thanks for contributing 🎉!