| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
chore: Disable cargo check in local dev (#6439) ## Changes Made I believe the cargo check pre-commit commands are useless in local development. They should run with cargo clippy anyways (since check just ensures that the crate compiles without errors and maybe warnings). Plus, because we do it 2 times with different flags, it causes a lot of recompilation which just makes it slow. So i disabled them for git commits. They are still enabled when you do make precommit and in CI to be safe. | 7 个月前 | |
feat: support various image hash functions (aHash, dHash, pHash, wHash, crop-resistant hash) for deduplication (#6338) Implements 5 image hashing algorithms for image deduplication: aHash (Average Hash): Compares each pixel to the mean intensity dHash (Difference Hash): Compares adjacent pixel differences pHash (Perceptual Hash): DCT-based frequency domain hashing wHash (Wavelet Hash): Haar wavelet transform-based hashing Crop-resistant Hash: Robust against cropping transformations ## Changes Made Added hash methods to CowImage with helper functions (dct2d_32x32, haar_2d) Added ImageHashOps trait and implementations for ImageArray / FixedShapeImageArray Added series-level functions and ScalarUDF registrations Exposed Python APIs: image_ahash, image_dhash, image_phash, image_whash, image_crop_resistant_hash Added corresponding methods to SeriesImageNamespace Added tests covering all 5 algorithms Fixed-size hashes return FixedSizeBinary(8), crop-resistant hash returns variable-length Binary. ## Related Issues Closes #4889 | 6 个月前 | |
perf(image): make image ops run in parallel via rayon (#6333) ## Changes Made use rayon's par_iter to improve performance on various image ops. | Operation | Speedup | |---|---| | resize (512→224) | ~9x | | resize (224→64) | ~8x | | center crop | ~2.5x | | rgb→grayscale | ~2.8x | | encode, rgba→rgb, to_tensor | no change | ### Raw Benchmarks resize/512_to_224 time: [10.139 ms 10.248 ms 10.374 ms] change: [-89.368% -89.246% -89.116%] (p = 0.00 < 0.05) Performance has improved. Found 3 outliers among 50 measurements (6.00%) 2 (4.00%) high mild 1 (2.00%) high severe resize/224_to_64 time: [1.6727 ms 1.7072 ms 1.7476 ms] change: [-87.901% -87.478% -86.943%] (p = 0.00 < 0.05) Performance has improved. Found 2 outliers among 50 measurements (4.00%) 1 (2.00%) high mild 1 (2.00%) high severe crop/512_center_crop_224 time: [2.0640 ms 2.0934 ms 2.1345 ms] change: [-60.818% -60.102% -59.423%] (p = 0.00 < 0.05) Performance has improved. to_mode/rgba_to_rgb time: [1.8285 ms 1.8796 ms 1.9286 ms] change: [-5.5339% -2.2847% +0.4025%] (p = 0.16 > 0.05) No change in performance detected. to_mode/rgb_to_l time: [917.54 µs 921.96 µs 926.82 µs] change: [-63.963% -63.611% -63.243%] (p = 0.00 < 0.05) Performance has improved. Found 4 outliers among 50 measurements (8.00%) 4 (8.00%) high mild encode/png_224x224 time: [28.815 ms 28.947 ms 29.084 ms] change: [+0.7619% +1.2867% +1.8204%] (p = 0.00 < 0.05) Change within noise threshold. Benchmarking encode/jpeg_224x224: Warming up for 1.0000 s Warning: Unable to complete 50 samples in 5.0s. You may wish to increase target time to 6.2s, or reduce sample count to 40. encode/jpeg_224x224 time: [124.56 ms 124.90 ms 125.27 ms] change: [-1.1331% -0.6728% -0.2024%] (p = 0.01 < 0.05) Change within noise threshold. Found 5 outliers among 50 measurements (10.00%) 5 (10.00%) high mild to_tensor/fixed_rgb_224x224 time: [171.55 ns 172.97 ns 174.50 ns] change: [-0.3803% +0.3319% +1.0248%] (p = 0.34 > 0.05) No change in performance detected. ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> | 7 个月前 |
| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
| 7 个月前 | ||
| 6 个月前 | ||
| 7 个月前 |