develop/ai_data_engineering

GGitHubrefactor: Remove Unloaded MicroPartitions (#5710)

d9d65cae创建于 2025年12月3日历史提交

文件	最后提交记录	最后更新时间
ai	chore: Remove expression namespaces (#5619) ## Changes Made Bye bye ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> ## Checklist - [ ] Documented in API Docs (if applicable) - [ ] Documented in User Guide (if applicable) - [ ] If adding a new documentation page, doc is added to docs/mkdocs.yml navigation - [ ] Documentation builds and is formatted properly	9 个月前
common_crawl	chore: Remove runner from context (#5628) ## Changes Made Remove runner methods from daft.context, as they are now decoupled from the context. Changed all uses of daft.context.set_runner_... to daft.set_runner_... ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> ## Checklist - [ ] Documented in API Docs (if applicable) - [ ] Documented in User Guide (if applicable) - [ ] If adding a new documentation page, doc is added to docs/mkdocs.yml navigation - [ ] Documentation builds and is formatted properly	9 个月前
parquet	refactor: Remove Unloaded MicroPartitions (#5710) ## Changes Made With the removal of the Ray runner, we no longer use unloaded MicroPartitions for reading ScanTasks, so we can remove that code path entirely. Couple of Notes: * With these changes, I could also update the Partition trait (for MicroPartition and RayPartitionRef) to never error. * I left some code paths to support MicroPartition.read_parquet even though the runners don't use them, only some tests do. If you think I should remove those as well, lmk	9 个月前
tpcds	revert!: "revert: Temporarily revert "Remove deprecated APIs for 0.6" (#5084) ## Changes Made Unrevert https://github.com/Eventual-Inc/Daft/pull/5050 now that we've cut a new v0.5	1 年前
tpch	chore: Remove expression namespaces (#5619) ## Changes Made Bye bye ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> ## Checklist - [ ] Documented in API Docs (if applicable) - [ ] Documented in User Guide (if applicable) - [ ] If adding a new documentation page, doc is added to docs/mkdocs.yml navigation - [ ] Documentation builds and is formatted properly	9 个月前
vllm	feat: experimental vllm provider (#5443) ## Changes Made Adds the experimental VLLMPrefixCachedProvider for daft.functions.ai.prompt. Does async batching and prefix routing. When using the VLLMPrefixCachedProvider, prompt will create a VLLMExpr instead of a UDF, which Daft will turn into a custom VLLM operator. This operator is implemented as a streaming sink, and I had to make some minor changes to our streaming sink APIs to make the async batching mechanism work. ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> ## Checklist - [ ] Documented in API Docs (if applicable) - [ ] Documented in User Guide (if applicable) - [ ] If adding a new documentation page, doc is added to docs/mkdocs.yml navigation - [ ] Documentation builds and is formatted properly	10 个月前
__init__.py	Splits TPCH benchmarking and unit tests (#202) * Refactors common data generation utilities into a separate module in benchmarking/tpch/data_generation.py * Refactors TPC-H Daft answers into a separate module in benchmarking/tpch/answers.py * Creates an entrypoint for benchmarking in benchmarking/tpch/__main__.py * Creates an entrypoint for data generation in benchmarking/tpch/data_generation.py * Shares code between benchmarking entrypoint and TPC-H unit tests	3 年前