HCCL Code Examples

This directory provides sample code for using the HCCL interface to implement collective communication in different scenarios.

Point-to-Point Communication

• HcclSend and HcclRecv (Basic Send and Receive)
• HcclBatchSendRecv (Ring Communication)

Collective Communication

• AllReduce
• Broadcast
• AllGather
• ReduceScatter
• Reduce
• AlltoAll
• AlltoAllV
• AlltoAllVC
• Scatter

AI Frameworks

• PyTorch
• TensorFlow

Custom Point-to-Point Communication Operator

• Custom Send and Recv Operator (Based on AICPU Communication Engine)

Custom Collective Communication Operator

• Custom AllGather Operator