| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
Implement file credentials provider for AWS hook AssumeRoleWithWebIdentity (#29623) This PR implements a new web_identity_token_loader for the AWS connection AssumeRoleWithWebIdentity authentication mechanism that fetches the access token from a location on the Airflow instance's filesystem. This can be especially useful for Kubernetes environments with the Service Account Volume Projection feature enabled. This is similar to the built-in boto mechanism configured through the AWS_ROLE_ARN and AWS_WEB_IDENTITY_TOKEN_FILE environment variables but is much more flexible as it can be configured individually at the Airflow connection level. Co-authored-by: Ash Berlin-Taylor <ash@apache.org> | 3 年前 | |
AWS Secrets Manager Backend - major update (#27920) | 3 年前 | |
docs: fix typo (#29658) | 3 年前 | |
Add deferrable mode in RedshiftPauseClusterOperator (#28850) In this PR, I'm adding aiobotocore as an additional dependency until https://github.com/aio-libs/aiobotocore/issues/976 has been resolved. I'm adding AwsBaseAsyncHook a basic async AWS hook. This will at present support the default botocore auth i'e if airflow connection is not provided then auth using ENV and if airflow connection is provided then basic auth with secret-key/access-key-id/profile/token and arn-method. maybe we can support the other auth incrementally depending on the community interest. Because the dependency making things a little bit complicated so I have created a new test module deferrable inside AWS provider tests and I'm keeping the async-related test in this particular module. I have also added a new CI job to test/run the AWS deferable operator tests and I'm ignoring the deferable tests in other CI job test runs. Add a trigger class which will wait until the Redshift pause request reaches a terminal state i.e paused or fail, We also have retry logic like the sync operator. This PR donates the following developed RedshiftPauseClusterOperatorAsync` in [astronomer-providers](https://github.com/astronomer/astronomer-providers) repo to apache airflow. | 3 年前 | |
Allow to specify which connection, variable or config are being looked up in the backend using *_lookup_pattern parameters (#29580) * Allow to specify which connection, variable or config are being looked up in the backend using *_lookup_pattern parameters | 3 年前 | |
Prepare docs for 03/2023 wave of Providers (#29878) * Prepare docs for 03/2023 wave of Providers | 3 年前 | |
Add deferrable mode in RedshiftPauseClusterOperator (#28850) In this PR, I'm adding aiobotocore as an additional dependency until https://github.com/aio-libs/aiobotocore/issues/976 has been resolved. I'm adding AwsBaseAsyncHook a basic async AWS hook. This will at present support the default botocore auth i'e if airflow connection is not provided then auth using ENV and if airflow connection is provided then basic auth with secret-key/access-key-id/profile/token and arn-method. maybe we can support the other auth incrementally depending on the community interest. Because the dependency making things a little bit complicated so I have created a new test module deferrable inside AWS provider tests and I'm keeping the async-related test in this particular module. I have also added a new CI job to test/run the AWS deferable operator tests and I'm ignoring the deferable tests in other CI job test runs. Add a trigger class which will wait until the Redshift pause request reaches a terminal state i.e paused or fail, We also have retry logic like the sync operator. This PR donates the following developed RedshiftPauseClusterOperatorAsync` in [astronomer-providers](https://github.com/astronomer/astronomer-providers) repo to apache airflow. | 3 年前 | |
Add automated version replacement in example dag indexes (#28090) Despite earlier attempts to fix the links there were still many places where the links were pointing to wrong versions of examples. It has been Noticed in: https://github.com/apache/airflow/pull/27774#issuecomment-1321166935 This change addresses it in three ways: * updated tool to fix the linx in historically released documentation (applied already in https://github.com/apache/airflow-site/pull/706) * replaced hard-coded version with |version| everywhere and added sphinx extension to convert those to actual provider versions (though due to sphinx limitation it has to be done with post-processing of the generated .html rather than replacing during generation) * added pre-commit that detects any use of example_dags links to main/master/hard-coded version. | 3 年前 | |
Add deferrable mode in RedshiftPauseClusterOperator (#28850) In this PR, I'm adding aiobotocore as an additional dependency until https://github.com/aio-libs/aiobotocore/issues/976 has been resolved. I'm adding AwsBaseAsyncHook a basic async AWS hook. This will at present support the default botocore auth i'e if airflow connection is not provided then auth using ENV and if airflow connection is provided then basic auth with secret-key/access-key-id/profile/token and arn-method. maybe we can support the other auth incrementally depending on the community interest. Because the dependency making things a little bit complicated so I have created a new test module deferrable inside AWS provider tests and I'm keeping the async-related test in this particular module. I have also added a new CI job to test/run the AWS deferable operator tests and I'm ignoring the deferable tests in other CI job test runs. Add a trigger class which will wait until the Redshift pause request reaches a terminal state i.e paused or fail, We also have retry logic like the sync operator. This PR donates the following developed RedshiftPauseClusterOperatorAsync` in [astronomer-providers](https://github.com/astronomer/astronomer-providers) repo to apache airflow. | 3 年前 | |
Add official download page for providers (#18187) In order to fullfill requirements of announce@apache.org we need to have separate download page with instructions on how to download and verify the packages - links should point to mirroring system used by Apache. This PR adds the capability, and since we already have couple of doc .rst files in each provider, the PR also adds the verification if the expected files are there in the documentation. | 4 年前 | |
Add doc and example dag for Amazon SQS Operators (#23312) | 4 年前 |
| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
| 3 年前 | ||
| 3 年前 | ||
| 3 年前 | ||
| 3 年前 | ||
| 3 年前 | ||
| 3 年前 | ||
| 3 年前 | ||
| 3 年前 | ||
| 3 年前 | ||
| 4 年前 | ||
| 4 年前 |