| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
| 8 个月前 | ||
feat: Add guess_mime_type scalar expression for MIME type detection from bytes (#5883) | 8 个月前 | |
feat: Support product (#5515) ## Changes Made <!-- Describe what changes were made and why. Include implementation details if necessary. --> ## Related Issues Closes #4703 <!-- Link to related GitHub issues, e.g., "Closes #123" --> ## Checklist - [ ] Documented in API Docs (if applicable) - [ ] Documented in User Guide (if applicable) - [ ] If adding a new documentation page, doc is added to docs/mkdocs.yml navigation - [ ] Documentation builds and is formatted properly | 10 个月前 | |
feat: audio file subtype (#5602) ## Changes Made Creates new AudioFile class that's mostly a wrapper around soundfile library. provides common methods for interacting with audio files such as - metadata - resample - to_numpy Also supports dataframe expressions - daft.functions.audio_file - daft.functions.resample - daft.functions.audio_metadata Still need to add tests and a few more methods. Will follow up in a separate PR some functionality for audio extraction from video files. ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> ## Checklist - [ ] Documented in API Docs (if applicable) - [ ] Documented in User Guide (if applicable) - [ ] If adding a new documentation page, doc is added to docs/mkdocs.yml navigation - [ ] Documentation builds and is formatted properly | 10 个月前 | |
docs!: update docstrings for various functions (#5344) ## Changes Made updates docstrings for various functions to better reflect the input & output types. ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> ## Checklist - [ ] Documented in API Docs (if applicable) - [ ] Documented in User Guide (if applicable) - [ ] If adding a new documentation page, doc is added to docs/mkdocs.yml navigation - [ ] Documentation builds and is formatted properly --------- Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com> | 11 个月前 | |
feat: migrate first batch of daft functions (#5086) ## Changes Made First phase of our daft.functions migration + Expression namespacing deprecation! These changes should all be uncontroversial, and all of [the comments about them](https://www.notion.so/Expressions-Migration-Tasks-246091bd8634806a8f24eb573d8d3b3e?source=copy_link) have been resolved. Thus, I'm hoping that the reviews for this PR will be a little easier since they should only need to focus on the structural changes rather than the naming ones. I'm leaving the ones with unresolved discussions for future PRs, but this covers something like 95% of expressions. In addition, since the existing tests call the expression methods, which in turn call daft.functions, passing those tests should indicate both that the new functions work and that the existing methods have not been broken. All of the functions are straightforward Python-only changes except for two: - daft.functions.length has to work on binary, string, as well as list types. prior to that they were three separate functions, so I had to write a new scalar function on the Rust side - similarly, daft.functions.concat works for both string and binary, whereas the original functions were separate. I implemented this one by implementing Expression.__add__ between two binary expressions, and then just used the add implementation in the new concat scalar function ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> ## Checklist - [x] Documented in API Docs (if applicable) - [x] Documented in User Guide (if applicable) - [x] If adding a new documentation page, doc is added to docs/mkdocs.yml navigation - [x] Documentation builds and is formatted properly (tag @/ccmao1130 for docs review) --------- Co-authored-by: Srinivas Lade <srinulade1@gmail.com> | 1 年前 | |
chore: Remove expression namespaces (#5619) ## Changes Made Bye bye ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> ## Checklist - [ ] Documented in API Docs (if applicable) - [ ] Documented in User Guide (if applicable) - [ ] If adding a new documentation page, doc is added to docs/mkdocs.yml navigation - [ ] Documentation builds and is formatted properly | 10 个月前 | |
chore: bump mypy and ruff in pre-commit (#5836) ## Changes Made Bump mypy to 1.19.1 and ruff to 0.14.10 and resolve pre-commit errors. Rationale: my local ruff version is much higher than that in the project pre-commit, so I am getting a lot of linter warnings in my IDE. It is also about time to upgrade lints to utilize newer Python language features. ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> | 8 个月前 | |
docs!: update docstrings for various functions (#5344) ## Changes Made updates docstrings for various functions to better reflect the input & output types. ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> ## Checklist - [ ] Documented in API Docs (if applicable) - [ ] Documented in User Guide (if applicable) - [ ] If adding a new documentation page, doc is added to docs/mkdocs.yml navigation - [ ] Documentation builds and is formatted properly --------- Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com> | 11 个月前 | |
feat: Add guess_mime_type scalar expression for MIME type detection from bytes (#5883) | 8 个月前 | |
| 9 个月前 | ||
chore: Remove expression namespaces (#5619) ## Changes Made Bye bye ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> ## Checklist - [ ] Documented in API Docs (if applicable) - [ ] Documented in User Guide (if applicable) - [ ] If adding a new documentation page, doc is added to docs/mkdocs.yml navigation - [ ] Documentation builds and is formatted properly | 10 个月前 | |
chore: deprecate llm_generate function (#5603) ## Changes Made deprecates llm_generate in favor of prompt ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> ## Checklist - [ ] Documented in API Docs (if applicable) - [ ] Documented in User Guide (if applicable) - [ ] If adding a new documentation page, doc is added to docs/mkdocs.yml navigation - [ ] Documentation builds and is formatted properly | 10 个月前 | |
feat: extended hash function to take and hash multiple inputs (#5692) ## Changes Made The 3 core changes are: 1. The Python hash helper now accepts multiple expressions/strings, normalizes bare strings to columns, and forwards them to the native UDF. 2. The Rust hash UDF (src/daft-functions/src/hash.rs) was updated to accept multiple Series: it builds a RecordBatch and uses hash_with(). Single-column and seed handling remain as before. 4. A broadcast-friendly constructor is used so scalar seeds/literals (e.g., hash(a, 0)) are expanded to match row counts. ## Related Issues https://github.com/Eventual-Inc/Daft/issues/4390 --------- Co-authored-by: Colin Ho <chiuhong@usc.edu> | 9 个月前 | |
chore: Remove expression namespaces (#5619) ## Changes Made Bye bye ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> ## Checklist - [ ] Documented in API Docs (if applicable) - [ ] Documented in User Guide (if applicable) - [ ] If adding a new documentation page, doc is added to docs/mkdocs.yml navigation - [ ] Documentation builds and is formatted properly | 10 个月前 | |
feat: migrate nested constructors, get, slice, to_unix_epoch, partitioning functions (#5233) | 1 年前 | |
fix(cast): handle whitespace in string-to-number casting (#5955) ## Changes Made - Handle whitespace trimming for Utf8 -> numeric casting in cast.rs - Add Rust unit tests for whitespace handling in cast operations - Simplify run_process to return raw subprocess stdout - Remove | tr -d ' ' workaround from tests since cast now handles whitespace ## Motivation String-to-number casting in Daft was strict about whitespace, returning None for inputs like " 3 ". This differed from: - Python's int() - Pandas - NumPy - DuckDB All of which handle leading/trailing whitespace gracefully. ### Comparison (Numeric) | Engine | ' 3 ' → int | |--------|-----------------| | Python int() | 3 | | Pandas | 3 | | DuckDB | 3 | | Polars | None | | Daft (before) | None | | **Daft (after)** | **3** | ## Implementation The fix is implemented in src/daft-core/src/array/ops/cast.rs: - Before calling arrow2's cast, check if we're casting Utf8 -> numeric - If so, create a trimmed copy of the string array - Pass the trimmed data to arrow2's existing cast logic Trade-off: Temporarily duplicates string data during cast, but gains code reuse and maintainability. ## Scope This PR only affects **numeric** casting (int, float). ### Date Parsing Date parsing already handles whitespace correctly - chrono::NaiveDate::from_str (used by arrow2) is lenient with whitespace. Added a test to document this existing behavior. ## Related Issues Fixes the root cause of #5942 Related to #5738 | 8 个月前 | |
refactor: Cleanup Dtype Names (#5400) | 11 个月前 | |
refactor: Cleanup Dtype Names (#5400) | 11 个月前 | |
chore: Remove expression namespaces (#5619) ## Changes Made Bye bye ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> ## Checklist - [ ] Documented in API Docs (if applicable) - [ ] Documented in User Guide (if applicable) - [ ] If adding a new documentation page, doc is added to docs/mkdocs.yml navigation - [ ] Documentation builds and is formatted properly | 10 个月前 | |
fix: Clean up UDF display name in progress bar and plans (#5810) ## Changes Made Fix a couple of things with how names for UDFs are displayed in progress bars: * Don't use the unique id for the name, use a clean UDF name * Expose a name_override parameter so we can override built-in UDFs with custom names instead. Useful for the AI functions <img width="722" height="57" alt="Screenshot 2025-12-12 at 3 15 10 PM" src="https://github.com/user-attachments/assets/694cb578-aa1e-446e-93d8-4ea143e72aca" /> | 8 个月前 | |
chore: bump mypy and ruff in pre-commit (#5836) ## Changes Made Bump mypy to 1.19.1 and ruff to 0.14.10 and resolve pre-commit errors. Rationale: my local ruff version is much higher than that in the project pre-commit, so I am getting a lot of linter warnings in my IDE. It is also about time to upgrade lints to utilize newer Python language features. ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> | 8 个月前 |
| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
| 8 个月前 | ||
| 8 个月前 | ||
| 10 个月前 | ||
| 10 个月前 | ||
| 11 个月前 | ||
| 1 年前 | ||
| 10 个月前 | ||
| 8 个月前 | ||
| 11 个月前 | ||
| 8 个月前 | ||
| 9 个月前 | ||
| 10 个月前 | ||
| 10 个月前 | ||
| 9 个月前 | ||
| 10 个月前 | ||
| 1 年前 | ||
| 8 个月前 | ||
| 11 个月前 | ||
| 11 个月前 | ||
| 10 个月前 | ||
| 8 个月前 | ||
| 8 个月前 |