main

文件	最后提交记录	最后更新时间
__init__.py	Cython based Pyarrow hash functions (#79) * Implements Hash functions with XXHash * Leverages cython and pyarrow c++ api to do function calls * Currently hash functions for integers types and string are implemented * Implements Null handling for chunked_arrays and arrays * Updates poetry build to inject cython builder into setup.py * builds extensions in CI	4 年前
metadata.py	chore: Move EXPLAIN ANALYZE to Python (#6254) ## Changes Made To make it easier to extend to Flotilla and delete some of the unused visualization functions, I refactored the mermaid generation to run on the Python side and use the generic JSON plan serialization. This also makes it easier to make some Swordfish optimizations in the future.	7 个月前
native_executor.py	chore: Move Flight Server to Rust (#6519) ## Changes Made Provide in Rust so we have direct access to it for optimizations	6 个月前
ray_actor_pool_udf.py	feat(udf): support ray_options and resource overrides in UDF v2 (#5982) ## Changes Made This PR adds support for passing ray_options and overriding resource requirements in Daft UDF v2 (@daft.func and @daft.cls). Key changes: - Update row_wise_udf and batch_udf bindings to accept ray_options and cpus. - Add override_options and with_concurrency methods to Func class in daft/udf/udf_v2.py for dynamic configuration. - Propagate these options from Python to the Rust Logical Plan. - Update type stubs (.pyi) to match new Rust signatures. <!-- Describe what changes were made and why. Include implementation details if necessary. --> ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" -->	7 个月前
udf.py	chore: bump mypy and ruff in pre-commit (#5836) ## Changes Made Bump mypy to 1.19.1 and ruff to 0.14.10 and resolve pre-commit errors. Rationale: my local ruff version is much higher than that in the project pre-commit, so I am getting a lot of linter warnings in my IDE. It is also about time to upgrade lints to utilize newer Python language features. ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" -->	9 个月前
udf_worker.py	feat: UDF metrics (#5507) ## Changes Made Adds ability to create and export custom metrics from udfs, particularly counter and gauge https://prometheus.io/docs/concepts/metric_types. Users define unique metrics by name, and can increment / set them in the udfs. These updates are stored in a static MetricStore, which is keyed by the metric name and type. The udf operator in swordfish can access this MetricStore to update it's own RuntimeStats, which is then subsequently used for dashboard + progress bar. <img width="1249" height="831" alt="Screenshot 2025-11-07 at 10 45 14 PM" src="https://github.com/user-attachments/assets/36cf9d2b-65d2-4b35-88d0-26c2fbd3aa88" /> ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> ## Checklist - [ ] Documented in API Docs (if applicable) - [ ] Documented in User Guide (if applicable) - [ ] If adding a new documentation page, doc is added to docs/mkdocs.yml navigation - [ ] Documentation builds and is formatted properly	11 个月前
vllm.py	feat: experimental vllm provider (#5443) ## Changes Made Adds the experimental VLLMPrefixCachedProvider for daft.functions.ai.prompt. Does async batching and prefix routing. When using the VLLMPrefixCachedProvider, prompt will create a VLLMExpr instead of a UDF, which Daft will turn into a custom VLLM operator. This operator is implemented as a streaming sink, and I had to make some minor changes to our streaming sink APIs to make the async batching mechanism work. ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> ## Checklist - [ ] Documented in API Docs (if applicable) - [ ] Documented in User Guide (if applicable) - [ ] If adding a new documentation page, doc is added to docs/mkdocs.yml navigation - [ ] Documentation builds and is formatted properly	11 个月前