| Files | Last commit | Last update |
|---|---|---|
Release support for S3 checksum change. Co-authored-by: Zoe Wang <33073555+zoewangg@users.noreply.github.com> Co-authored-by: David Ho <70000000+davidh44@users.noreply.github.com> Co-authored-by: Olivier Lepage-Applin (L-Applin) <olapplin@amazon.com> Co-authored-by: John Viegas <joviegas@amazon.com> | 1 year ago | |
Release CRT Sync HTTP client (#4750) * Synchronous CRT Http Client SPI with tests (#4405) * implemented synchronous crt java http client with tests. --------- Co-authored-by: Waqar Ahmed Khan <waahm7@gmail.com> Co-authored-by: Dongie Agnir <261310+dagnir@users.noreply.github.com> * Various refactoring on CRT Sync HTTP Client (#4749) * Make sure CRT resources are closed (#4753) * Load HTTP implementations from classpath based on priority order (#4774) * Various performance optimization for CRT sync HTTP client (#4776) * Various performance optimization for CRT sync HTTP client * Return as soon as the stream starts if there is a payload in sync http client * Clean up tests and add changelog entry * Bump minor version to 2.22.0 * UrlConnectionSdkHttpService should have higher priority than AwsCrtSdkHttpService * Remove CrtResource.waitForNoResources() from integration tests because it increases test time and makes tests flaky especially when tests are running in parallel. We still verify it in wiremock tests and stability tests --------- Co-authored-by: Jonathan M. Henson <jonathan.michael.henson@gmail.com> Co-authored-by: Waqar Ahmed Khan <waahm7@gmail.com> Co-authored-by: Dongie Agnir <261310+dagnir@users.noreply.github.com> | 2 years ago | |
Release CRT Sync HTTP client (#4750) * Synchronous CRT Http Client SPI with tests (#4405) * implemented synchronous crt java http client with tests. --------- Co-authored-by: Waqar Ahmed Khan <waahm7@gmail.com> Co-authored-by: Dongie Agnir <261310+dagnir@users.noreply.github.com> * Various refactoring on CRT Sync HTTP Client (#4749) * Make sure CRT resources are closed (#4753) * Load HTTP implementations from classpath based on priority order (#4774) * Various performance optimization for CRT sync HTTP client (#4776) * Various performance optimization for CRT sync HTTP client * Return as soon as the stream starts if there is a payload in sync http client * Clean up tests and add changelog entry * Bump minor version to 2.22.0 * UrlConnectionSdkHttpService should have higher priority than AwsCrtSdkHttpService * Remove CrtResource.waitForNoResources() from integration tests because it increases test time and makes tests flaky especially when tests are running in parallel. We still verify it in wiremock tests and stability tests --------- Co-authored-by: Jonathan M. Henson <jonathan.michael.henson@gmail.com> Co-authored-by: Waqar Ahmed Khan <waahm7@gmail.com> Co-authored-by: Dongie Agnir <261310+dagnir@users.noreply.github.com> | 2 years ago | |
Add MetricPublisher support to the S3 CRT-based async client (#7500) * Add client-level MetricPublisher support to the S3 CRT client (#7299) * add client-level MetricPublisher support to the S3 CRT client * address review feedback * Add request-level MetricPublisher support to the S3 CRT client (#7316) * add request-level MetricPublisher support to the S3 CRT client * drop @SdkTestInternalApi from CRT request-level metric helpers * refactor : stash request-level publishers once for copyObject instead of a per-sub-request wrapper * address review comments * Publish additional S3 CRT request metrics (#7419) * Publish additional S3 CRT request metrics * Use builder for S3 CRT response handler adapter * Isolate S3 CRT metric publication from event-loop threads (#7422) * Isolate S3 CRT metric publishers from event loop * Use debug logging for S3 CRT metric publishing * Address S3 CRT metric dispatcher review feedback * Address S3 CRT metric dispatcher review comments * Add S3 CRT metric publisher release notes and validation * Isolate S3 CRT metric publisher integration tests * Handle incompatible CRT metric APIs * Clarify CRT upgrade guidance | 10 days ago | |
Add "CRT_MEMORY_BUFFER_DISABLED" advanced client option (#6579) * Add CRT "shouldStream" config as "CRT_MEMORY_BUFFER_DISABLED" SDK advanced client option * changelog * Update CRT_MEMORY_BUFFER_DISABLED javadoc * Add crtBuilder advancedOption method tests | 11 months ago | |
Feature/master/dbz pool (#7536) * Direct buffer pool streaming download in the CRT-based S3 client (#7472) * Integrate CRT borrowed-buffer downloads * Unit tests * WireMock tests * Update javadocs * Add integration tests * Add changelog * Address comments * Address comments and refactoring * Remove redundant lock * Refactoring * Address comments * Refactoring and address comments * Address comments * Cleanup tests * Update javadocs * Add direct buffer pool downloads to S3TransferManager (#7486) * Integrate CRT borrowed-buffer downloads * Unit tests * WireMock tests * Update javadocs * Add integration tests * Add changelog * Address comments * Address comments and refactoring * Remove redundant lock * Refactoring * Address comments * Refactoring and address comments * Add direct buffer pool downloads to S3TransferManager * Add tests * Add integration tests * Add changelog * Update javadocs * Address comments * Cleanup tests * Refactor tests * Update javadocs * DBZ API Updates (#7528) * Update APIs * Add logging * Fix tests import order * Integ test cleanup * Update unit tests to forcePathStyle * Update TM unit tests to forcePathStyle * Update log level from error to warn * Allowlist Transfer Manager module to use S3 direct buffer pool marker * Publish CRT metrics for direct buffer pool downloads | 4 days ago | |
Release CRT Sync HTTP client (#4750) * Synchronous CRT Http Client SPI with tests (#4405) * implemented synchronous crt java http client with tests. --------- Co-authored-by: Waqar Ahmed Khan <waahm7@gmail.com> Co-authored-by: Dongie Agnir <261310+dagnir@users.noreply.github.com> * Various refactoring on CRT Sync HTTP Client (#4749) * Make sure CRT resources are closed (#4753) * Load HTTP implementations from classpath based on priority order (#4774) * Various performance optimization for CRT sync HTTP client (#4776) * Various performance optimization for CRT sync HTTP client * Return as soon as the stream starts if there is a payload in sync http client * Clean up tests and add changelog entry * Bump minor version to 2.22.0 * UrlConnectionSdkHttpService should have higher priority than AwsCrtSdkHttpService * Remove CrtResource.waitForNoResources() from integration tests because it increases test time and makes tests flaky especially when tests are running in parallel. We still verify it in wiremock tests and stability tests --------- Co-authored-by: Jonathan M. Henson <jonathan.michael.henson@gmail.com> Co-authored-by: Waqar Ahmed Khan <waahm7@gmail.com> Co-authored-by: Dongie Agnir <261310+dagnir@users.noreply.github.com> | 2 years ago | |
S3 Cross Region Client (#4132) * Adding a generic method invokeOperation for abstract delegating clien… (#3996) Adding a generic method invokeOperation for abstract delegating client to allow overriding behavior changes for all operations * Add endpointProvider in ClientConfig and RequestOverrideConfig. Also add crossRegionBucketAccess in S3Configuration (#3978) * Add endpointProvider in ClientConfig and RequestOverrideConfig. Also add crossRegionBucketAccess in S3Configuration * updated review comments 1 * updated review comments 2 * Adds S3CrossRegion clients and codegen for retrieving bucket name (#4008) * Adds S3CrossRegion clients and codegen for retrieving bucket name * Removes codegen of bucket parameter since getValueForField() is better * Add back overloads * Adds cross region client logic for decorating endpoint provider (#4026) * Adds cross region client logic for decorating endpoint provider * Paginated methods returning publisher or iterable implement logic in … (#4046) * Paginated methods returning publisher or iterable implement logic in interface instead of throwing unsupported exception * Added internal annotation to class * Wraps s3 client in cross regional client when enabled (#4080) * Wraps s3 client in cross regional client when enabled * Adds composer interface * Add User Agent Api name for Cross region API calls (#4105) * Add User Agent Api name for Cross region API calls * Added test case for default client not to have user agent related to cross region * S3CrossRegion Sync and Async Clients Redirect implementation (#4089) * S3CrossRegionSyncClient Redirect implementation * Added implementation for Async client Decorator * Updated older Cross region test cases * Added paramterized test * Async Exception checged to completableException * Updated test cases and changes the Exception handling when HeadBucket Call fails * Handled Anna-karin's comments * Removed async execution of HeadBucket and attached it to the completableFuture of main request * Handled Zoe's comments * Added test case when Redirected after the Region is cached * Changed region constant to Region Type in Tests * Cross region support for CRT Client (#4129) * Cross region support for CRT Client * removing common class * handled review comments * Integration test cases for Cross region Async and Sync Clients (#4128) * Integration test cases for Cross region Sync and Sync Clients * Renamed files as Integration test * Handled CR comments to take care of retries thus captureInterceptor is removed * rebased and added CRT in Integ test * removed sout from integ * Attach crossRegionAccessEnabled as CustomClientParams to a client Builder, also mention of Composers are renamed as decorators (#4151) * Attach crossRegionAccessEnabled as CustomClientParams to a client Builder, also mention of Composers are renamed as decorators * Removed from S3Configurations * Move the optional parameter in getter --------- Co-authored-by: Anna-Karin Salander <salande@amazon.com> | 3 years ago |
| Files | Last commit | Last update |
|---|---|---|
| 1 year ago | ||
| 2 years ago | ||
| 2 years ago | ||
| 10 days ago | ||
| 11 months ago | ||
| 4 days ago | ||
| 2 years ago | ||
| 3 years ago |