Daft/.github · xuanwu/Daft

GGitHubchore: optimizes slow tests in CI/CD (#6029 )

文件	最后提交记录	最后更新时间
ISSUE_TEMPLATE	chore: update bug report template (#5652) ## Changes Made I more often than not found myself checking "Other" as many of the categories are not super relevant. So i just updated them based off analyzing some of the recent issues to find the most popular categories. ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> ## Checklist - [ ] Documented in API Docs (if applicable) - [ ] Documented in User Guide (if applicable) - [ ] If adding a new documentation page, doc is added to `docs/mkdocs.yml` navigation - [ ] Documentation builds and is formatted properly --------- Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>	10 个月前
actions	chore: Drop Python 3.9 (#5479) ## Changes Made Python 3.9 is EOL starting from Nov 1, so lets drop it and make 3.10 the minimum. Also, start testing ranges 3.10 to 3.13 --------- Co-authored-by: Colin Ho <colin.ho99@gmail.com>	10 个月前
assets	chore: Drop Python 3.9 (#5479) ## Changes Made Python 3.9 is EOL starting from Nov 1, so lets drop it and make 3.10 the minimum. Also, start testing ranges 3.10 to 3.13 --------- Co-authored-by: Colin Ho <colin.ho99@gmail.com>	10 个月前
ci-scripts	chore: bump `mypy` and `ruff` in pre-commit (#5836) ## Changes Made Bump `mypy` to 1.19.1 and `ruff` to 0.14.10 and resolve pre-commit errors. Rationale: my local `ruff` version is much higher than that in the project `pre-commit`, so I am getting a lot of linter warnings in my IDE. It is also about time to upgrade lints to utilize newer Python language features. ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" -->	9 个月前
workflows	chore: optimizes slow tests in CI/CD (#6029) ## Results The PR reduced unit-test time (3.13, native, 22.0.0, ubuntu-latest, false) from [33m 18s](https://github.com/Eventual-Inc/Daft/actions/runs/20981828603/job/60308365885?pr=6023) to 13m 44s — saving about 20 mins which is nice. The test_context is still slow, but it has very few tests, a big win is parallelization and taking >5 mins off just by skipping the setup for skipped tests. This also reduced the ray tests from 45 mins to 27 mins, and there should be plenty more savings here. Then disabling windows eliminated a 50+ min action. `text ================================================================================ OVERALL SUMMARY ================================================================================ Tests Analyzed: 9620 Total Time: 941.32s Average Time: 0.05s Max Time: 14.70s Min Time: 0.01s` It took 188s to run `make test` on my mac which is nice; it also crushed my machine while it was running 🥲 ## Changes Made * Adds `-n auto` to pytest for parallelize testing on multiple cores * Skips generating fixtures (expensive?) by not actually creating the tests - we were creating test data _then_ skipping for several thousand join tests taking ~5 mins of setup work just to skip. * Memoizes data generation for the window tests (often the slowest for me) * Reduces the data generation size and faster comparison algo (before was 10,000 data points with a O(n^2) algo, now it's 1,000 data points with an O(nlogn) comparison algo) * Disables the RAY_DASHBOARD for the context setup commands, and other minor things to speedup ray init * Skips windows on PRs (>50 minutes) only enabled on main, worthwhile trade-off because we will still catch windows-specific failures when merging to main which is quite rare to be fair. ## Related Issues N/A	8 个月前
CODEOWNERS	chore: Codeowners (#5502) ## Changes Made Initial codeowners for Daft. ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> ## Checklist - [ ] Documented in API Docs (if applicable) - [ ] Documented in User Guide (if applicable) - [ ] If adding a new documentation page, doc is added to `docs/mkdocs.yml` navigation - [ ] Documentation builds and is formatted properly	9 个月前
dependabot.yml	fix: Dependabot tweaks (#4659)	1 年前
pull_request_template.md	chore: remove checklist from pr template (#5653) ## Changes Made nobody is using the checklist. so lets just remove it. ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" -->	10 个月前
release-drafter.yml	ci(release-drafter): use conventional commit labels (#3503)	1 年前