| Files | Last commit | Last update |
|---|---|---|
| 12 days ago | ||
| 4 months ago | ||
| 17 days ago | ||
| 4 days ago | ||
| 4 days ago | ||
| 11 months ago | ||
| 1 month ago | ||
| 17 days ago |
ConvolutionForward
English | 简体中文
Applicable Products
| Product | Support |
|---|---|
| Ascend 950PR&950DT products | √ |
| Atlas A3 products | √ |
| Atlas A2 products | √ |
Function
-
Operator function: implements convolution. It supports 1D convolution, 2D convolution, and 3D convolution, and also supports transposed convolution, dilated convolution, and grouped convolution. When the input parameter is
transposed = True, the transposed convolution or fractional-strided convolution is used. You can regard it as the gradient or the inverse operation of a normal convolution, that is, it restores the input shape from the output shape of the convolution while keeping a connection pattern compatible with the convolution. Its parameters are similar to those of a normal convolution, including the number of input channels, the number of output channels, the kernel size, stride, padding, output padding, groups, bias, dilation, and so on. -
Formula:
Assume that the shape of input is (N,Cin,H,W)(N, C_{\text{in}}, H, W), the shape of weight is (Cout,Cin,Kh,Kw)(C_{\text{out}}, C_{\text{in}}, K_h, K_w), and the shape of output is (N,Cout,Hout,Wout)(N, C_{\text{out}}, H_{\text{out}}, W_{\text{out}}). Then the output is expressed as:
out(Ni,Coutj)=bias(Coutj)+∑k=0Cin−1weight(Coutj,k)⋆input(Ni,k) \text{out}(N_i, C_{\text{out}_j}) = \text{bias}(C_{\text{out}_j}) + \sum_{k = 0}^{C_{\text{in}} - 1} \text{weight}(C_{\text{out}_j}, k) \star \text{input}(N_i, k)
In this formula, ⋆\star denotes the convolution computation, which depends on the dimensions of the convolution input and on the convolution type (dilated convolution or grouped convolution). NN denotes the batch size, CC denotes the number of channels, and WW and HH denote the width and the height respectively. The formulas for computing the corresponding output dimensions are as follows:
Hout=[(H+2∗padding[0]−dilation[0]∗(Kh−1)−1)/stride[0]]+1Wout=[(W+2∗padding[1]−dilation[1]∗(Kw−1)−1)/stride[1]]+1 H_{\text{out}}=[(H + 2 * padding[0] - dilation[0] * (K_h - 1) - 1 ) / stride[0]] + 1 \\ W_{\text{out}}=[(W + 2 * padding[1] - dilation[1] * (K_w - 1) - 1 ) / stride[1]] + 1
Parameters
Parameter name |
Input/Output/Attribute |
Description |
Data type |
Data format |
|---|---|---|---|---|
| input | Input |
|
FLOAT, FLOAT16, BFLOAT16, HIFLOAT8, FLOAT8_E4M3FN | NCL, NCHW, NCDHW |
| weight | Input |
|
FLOAT, FLOAT16, BFLOAT16, HIFLOAT8, FLOAT8_E4M3FN | NCL, NCHW, NCDHW |
| bias | Input |
|
FLOAT, FLOAT16, BFLOAT16 | ND, NCL, NCHW, NCDHW |
| stride | Input |
|
INT64 | - |
| padding | Input |
|
INT64 | - |
| dilation | Input |
|
INT64 | - |
| transposed | Input |
|
BOOL | - |
| outputPadding | Input |
|
INT64 | - |
| groups | Input |
|
INT64 | - |
| output | Output |
|
FLOAT, FLOAT16, BFLOAT16, HIFLOAT8, FLOAT8_E4M3FN | NCL, NCHW, NCDHW |
| cubeMathType | Input |
|
INT8 | - |
- Atlas A2 products, Atlas A3 products:
- The data types of input and weight do not support HIFLOAT8 or FLOAT8_E4M3FN.
- The data type of bias does not support HIFLOAT8 or FLOAT8_E4M3FN. The data type must be consistent with input and weight.
- In the forward scenarios of conv1d, conv2d, and conv3d, bias is converted to FLOAT for computation.
- In the conv2d and conv3d transposed=true scenarios, the sizes of weight H and W must be in the range [1,255], and the other dimensions must be greater than or equal to 1.
- In the conv1d transposed=true scenario, the size of weight L must be in the range [1,255], and the other dimensions must be greater than or equal to 1.
- In the forward conv3d scenario, the sizes of weight H and W must be in the range [1,511].
- When cubeMathType is 0 (KEEP_DTYPE) and the input is FLOAT, this option is currently not supported.
- When cubeMathType is 1 (ALLOW_FP32_DOWN_PRECISION) and the input is FLOAT, conversion to HFLOAT32 for computation is allowed.
- When cubeMathType is 2 (USE_FP16) and the input is BFLOAT16, this option is not supported.
- When cubeMathType is 3 (USE_HF32) and the input is FLOAT, the input is converted to HFLOAT32 for computation.
- Ascend 950PR&950DT products:
- The data types of input and weight support FLOAT, FLOAT16, BFLOAT16, and HIFLOAT8.
- When transposed=true: the data type of input additionally supports FLOAT8_E4M3FN, the N dimension supports a value greater than or equal to 0, and the sizes of all other dimensions must be greater than or equal to 1.
- When transposed=false: when the data type of input is HIFLOAT8, the data type of weight must be consistent with input. The N dimension supports a value greater than or equal to 0; the D, H, and W dimensions support values greater than or equal to 0 (a value of 0 is supported only when the deduced D, H, and W dimensions of output are also 0); the C dimension supports a value greater than or equal to 0 (a value of 0 is supported only when one of the deduced N, C, D, H, and W dimensions of output is 0).
- The data type of bias does not support HIFLOAT8 or FLOAT8_E4M3FN.
- When transposed=true: when the data types of input and weight are HIFLOAT8 or FLOAT8_E4M3FN, bias is not supported.
- When transposed=false: when the data types of input and weight are HIFLOAT8, bias is converted to FLOAT for computation.
- When cubeMathType is 1 (ALLOW_FP32_DOWN_PRECISION) and the input is FLOAT, conversion to HFLOAT32 for computation is allowed.
- When cubeMathType is 2 (USE_FP16) and the input is BFLOAT16, this option is not supported.
- When cubeMathType is 3 (USE_HF32) and the input is FLOAT, the input is converted to HFLOAT32 for computation.
Constraints
- Atlas A2 products, Atlas A3 products: the size of each dimension of each group of tensors in input, weight, and bias must not be greater than 1000000.
- Ascend 950PR&950DT products: in the scenario where transposed is true, 1D, 2D, and 3D convolutions are supported, and empty tensors are supported.
- Due to hardware resource limits, the operator fails to execute for certain combinations of parameter values. Analyze and troubleshoot the problem according to the log information. If the problem cannot be resolved, click Link to obtain technical support.
Invocation Description
| Invocation method | Sample code | Description |
|---|---|---|
| aclnn invocation | test_aclnn_convolution_1d_transpose | Demonstrates the 1D transposed convolution scenario through the aclnnConvolution API, which invokes the Conv2DTranspose operator |
| aclnn invocation | test_aclnn_convolution_2d_transpose | Demonstrates the 2D transposed convolution scenario through the aclnnConvolution API, which invokes the Conv2DTranspose operator |
| aclnn invocation | test_aclnn_convolution_3d_transpose | Demonstrates the 3D transposed convolution scenario through the aclnnConvolution API, which invokes the Conv3DTransposeV2 operator |
| aclnn invocation | test_aclnn_conv_depthwise_2d | Demonstrates 2D depthwise separable convolution using the aclnnConvDepthwise2d API, which invokes the Conv2D operator |
| aclnn invocation | test_aclnn_conv_tbc | Demonstrates time-batch-channel convolution using the aclnnConvTbc API, which invokes the Conv2D operator |
| aclnn invocation | test_aclnn_quant_convolution | Demonstrates 3D quantized convolution using the aclnnQuantConvolution API, which invokes the Conv3DV2 operator |