| Files | Last commit | Last update |
|---|---|---|
| 20 days ago | ||
| 20 days ago | ||
| 20 days ago | ||
| 14 days ago | ||
| 20 days ago | ||
| 5 months ago | ||
| 20 days ago | ||
| 14 days ago |
AddMatMatElements
English | 简体中文
Product Support Status
| Product | Supported |
|---|---|
| Ascend 950PR&950DT products | √ |
| Atlas A3 products | √ |
| Atlas A2 products | √ |
| Atlas 200I/500 A2 inference products | √ |
| Atlas inference products | √ |
| Atlas training products | √ |
Function Description
-
Operator function: multiplies the input tensors
aandbelement-wise, and then computes the weighted sum of the product and the input tensorcby usingalphaandbeta. The result is written to the output tensor. -
Computation formula:
outi=ci×β+α×ai×biout_i = c_i \times \beta + \alpha \times a_i \times b_i
-
The output shape is fixed to
c.shape.aandbare broadcast toc.shaperespectively according to the tail-alignment rule. Expanding the shape ofcthrough unified broadcasting is not supported. -
alphaandbetaare tensors with the shape of(1,), not attributes.
Parameter Description
| Parameter Name | Input/Output | Description | Data Type | Data Format |
|---|---|---|---|---|
| c | Input | The anchor of the output shape. It participates in the accumulation after being scaled by beta. The rank ranges from 1 to 8. | FLOAT16, FLOAT | ND |
| a | Input | Participates in the element-wise multiplication. The rank ranges from 0 to the rank of c, and the shape must be able to be broadcast to c.shape. A rank of 0 indicates a scalar tensor. | Same as c | ND |
| b | Input | Participates in the element-wise multiplication. The rank ranges from 0 to the rank of c, and the shape must be able to be broadcast to c.shape. A rank of 0 indicates a scalar tensor. | Same as c | ND |
| beta | Input | The coefficient tensor used to scale c, whose shape must be (1,). | Same as c | ND |
| alpha | Input | The coefficient tensor used to scale the product of a × b, whose shape must be (1,). | Same as c | ND |
| c | Output | The computation result, whose shape equals the input c.shape. | Same as c | ND |
Constraint Description
c,a,b,beta,alpha, and the output must have exactly the same data type. OnlyFLOAT16andFLOATare supported, and data type promotion is not supported.- The rank of
cranges from 1 to 8. The ranks ofaandbrange from 0 to the rank ofc. When the rank is 0, the tensor is broadcast as a scalar tensor. aandbare tail-aligned toc.shaperespectively. Each padded dimension must be 1 or equal to the corresponding dimension ofc.- The output shape is fixed to
c.shape. For example,c.shape=(1, 3)anda.shape=(2, 3)are not supported, even if the three inputs can obtain the unified broadcast shape(2, 3). - The shapes of
alphaandbetamust be strictly(1,). - Empty tensors are supported. The empty tensor scenario must still satisfy the preceding rank and broadcast constraints.
- Dynamic shape and dynamic rank are supported. During shape inference,
-1indicates an unknown dimension: if a specific dimension exists on the same tail-aligned axis, the specific dimension is used; if all dimensions are-1,-1is retained. If any input ofc,a, orbis of unknown rank[-2], the output is of unknown rank[-2]. The actual shape at runtime must satisfy the preceding constraints. - The Kernel input and output support only the ND format. The GE graph can insert format conversion for some non-ND data tensors or the requested output layout, and converts them to ND before entering the Kernel. The format conversion capability depends on the rank and shape of the tensor, and it is not guaranteed that any format combination can be converted.
alphaandbetamust still be(1,)tensors in the ND format.
Description: The current InferShape implementation performs shape inference based on
broadcast(a, b, c), while Host Tiling usesc.shapeas the output anchor and checks the broadcast relationship fromaandbtoc.shape. The actual execution constraints are subject to Host Tiling.
Exception Validation
| Violated Condition | Validation Stage | Error Behavior |
|---|---|---|
| A required input or output is missing | Graph building/compilation parameter validation | E80001 |
The rank of c is not within the range of 1 to 8 |
Graph compilation parameter validation may reject it early; Host Tiling retains the full range validation | When the rank is greater than 8, the current integration path presents E80012. If it enters Host Tiling, GRAPH_FAILED is returned, the current integration path presents EZ9999, and a rank out-of-range log is recorded |
| The input dtype is not supported or the input dtypes are inconsistent | Host Tiling | GRAPH_FAILED is returned. The current integration path presents EZ9999 externally and records a dtype validation log |
The rank of a or b is greater than the rank of c, or they cannot be broadcast to c.shape |
Host Tiling | GRAPH_FAILED is returned. The current integration path presents EZ9999 externally and records a rank or broadcast validation log |
The shape of alpha or beta is not (1,) |
Host Tiling | GRAPH_FAILED is returned. The current integration path presents EZ9999 externally and records a shape validation log |
| The graph input is declared as a non-ND format | GE format selection/TransData | Convertible data tensors are converted to ND by GE before execution. Non-convertible rank/shape/format combinations fail at the graph compilation stage and do not enter the Kernel of this operator |
| The output dtype or shape prefilled by the caller is inconsistent with the input | Graph inference | The output dtype follows the input c, and the output shape is inferred from the input shape. The values prefilled by the caller are overwritten by the inference results |
| The graph requests a non-ND output layout | GE format selection/TransData | GE can perform layout conversion after the ND output of the Kernel. The physical output buffer cannot be directly interpreted as a raw ND array |
Description: Error codes are encapsulated by graph compilation or the runtime framework for validation failures. Different integration paths may return only
GRAPH_FAILEDand retain specific logs. The direct Kernel test path is not responsible for validating output descriptors and non-ND formats. Such scenarios should be validated at the graph building boundary, and the fact that the direct Kernel path does not reject them cannot be used to determine operator support or defects.
Invocation Description
| Invocation Method | Sample Code | Description |
|---|---|---|
| Graph mode | test_geir_add_mat_mat_elements.cpp | Invokes the AddMatMatElements operator by building a graph through the operator IR. |
Graph-Mode Explicit Cast Description
- Connecting the output of an explicit Cast operator to AddMatMatElements is supported. When entering AddMatMatElements,
c,a,b,beta, andalphamust have been converted to exactly the sameFLOAT16orFLOATdata type, and the shapes ofbetaandalphamust still be(1,). - AddMatMatElements does not automatically insert Cast for mixed data type inputs, and implicit data type promotion is not supported. If the input data types are still inconsistent after explicit Cast, or the Cast target data type is not within the range of
FLOAT16andFLOAT, graph compilation fails. - Fusion of Cast and AddMatMatElements is not guaranteed, and Cast can be executed as an independent graph node and an independent kernel.