| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
chore: update Slack invite links across docs and README (#6377) ## Summary - Updated all Slack invite links to the new URL across 7 files (README.rst and 6 docs pages) - Replaced two expired invite tokens ( zt-2e77olvxw-... and zt-3l411uyaq-...) with the current one (zt-3rh9jr9iv-...) ## Test plan - [x] make docs builds successfully - [x] make doctests passes (269 tests) 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com> | 7 个月前 | |
docs: document get_or_infer_runner_type and get_or_create_runner (#6453) ## Changes Made get_or_infer_runner_type and get_or_create_runner are both exported in daft.__all__ but were not included in the API docs. This PR: 1. Adds both functions to the Configuration docs page (docs/api/config.md) under a new "Checking the Runner" section, placed between "Setting the Runner" and "Setting Configurations". 2. Adds a docstring to get_or_create_runner in daft/runners/__init__.py, which previously had none. The docstring explains the locking side effect (once called, the runner cannot be changed for the lifetime of the process). | 6 个月前 | |
docs: Revamp optimization docs (#5347) ## Changes Made <!-- Describe what changes were made and why. Include implementation details if necessary. --> ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> ## Checklist - [ ] Documented in API Docs (if applicable) - [ ] Documented in User Guide (if applicable) - [ ] If adding a new documentation page, doc is added to docs/mkdocs.yml navigation - [ ] Documentation builds and is formatted properly | 11 个月前 | |
chore: use dedicated OSS AWS account (#6442) ## Changes Made Update to use new dedicated OSS AWS account: - S3 buckets for GitHub artifacts, and public datasets - CloudFront distribution Requires: - Update ACTIONS_AWS_IAM_ROLE GitHub secret ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> | 6 个月前 | |
feat: Support pattern filtering for SHOW TABLES (#5423) ## Changes Made <!-- Describe what changes were made and why. Include implementation details if necessary. --> ### Extended SQL LIKE Pattern Matching in MemoryCatalog - Upgrade sqlparser to extract namespace from query - Translate SQL LIKE patterns to regex (src/daft-catalog/src/pattern.rs) - Supports standard SQL LIKE wildcards: % (zero or more), _ (exactly one), \ (escape) - Updated documentation on SHOW TABLES syntax and pattern behavior ### Testing - Added pattern matching tests to test_sql_show_tables.py and in src/daft-catalog/pattern.rs - cargo test -p daft-catalog pattern:: ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> Closes #4461 Closes #4007 ## Checklist - [x] Documented in API Docs (if applicable) - [ ] Documented in User Guide (if applicable) - [ ] If adding a new documentation page, doc is added to docs/mkdocs.yml navigation - [ ] Documentation builds and is formatted properly | 9 个月前 | |
feat!: add iceberg table support with the gravitino catalog (#6509) ## Changes Made This refactors the Gravitino catalog implementation to match our Glue implementation. It looks at table information to determine which concrete Table implementation to use. This also refactors the Catalog creation a little bit to once again match Glue. I'm not proud of the Catalog.from_* thing with the objects, and I like the pyiceberg choice of the top-level load_ methods, hence why later implementations like Glue use that pattern, so I've updated Gravitino to follow this. This PR also properly internalizes/encapsulates the client, I wasn't interested in having our own Gravitino client vs. using the python one, but the customer required this -- so I just hid the client and updated the docs accordingly. Also a tiny fix on an old typo of mine from the video reader: read_glob_paths/from_glob_paths. ## Related Issues - Closes #6318 - Closes #6319 | 6 个月前 | |
docs: fix daft dashboard command example (#6483) ## Changes Made fix daft dashboard command example ## Related Issues | 6 个月前 | |
feat(docs): add copy page as markdown button (#5828) ## Summary Adds a "Copy page" button to documentation pages that copies the raw markdown source to clipboard. ## Demo https://github.com/user-attachments/assets/f02fd499-a510-4338-b7e2-4c7bfb5048cb ## Changes - **hooks.py**: Inject button HTML and base64-encoded markdown at build time - **custom.js**: Handle click events to decode and copy markdown - **extra.css**: Style the button ## Supported Pages The button appears on: - Quickstart page - Example pages (excluding index) - AI function pages (excluding overview) ## Test Plan - [x] Verify button appears on quickstart page - [x] Verify button appears on example pages - [x] Verify button appears on AI function pages - [x] Verify button does NOT appear on home page - [x] Verify button does NOT appear on API pages - [x] Verify copied content matches original markdown - [x] Verify button works after instant navigation between pages | 9 个月前 | |
chore: update Slack invite links across docs and README (#6377) ## Summary - Updated all Slack invite links to the new URL across 7 files (README.rst and 6 docs pages) - Replaced two expired invite tokens ( zt-2e77olvxw-... and zt-3l411uyaq-...) with the current one (zt-3rh9jr9iv-...) ## Test plan - [x] make docs builds successfully - [x] make doctests passes (269 tests) 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com> | 7 个月前 | |
feat: Common Crawl x Daft tutorial using Qwen3 (#5472) Added a new tutorial for the new Common Crawl dataset. The notebook explores the crawl data, gives some motivation and exposition around text embeddings, provides a sentence splitting UDF using Spacy, and shows off the new daft.functions.ai.embed_text expression using a locally-running Qwen3 0.6B model. Adds a new example card for this new tutorial, complete with an AI-generated cover image. ## Checklist - [x] Documented in API Docs (if applicable) - [x] Documented in User Guide (if applicable) - [x] If adding a new documentation page, doc is added to docs/mkdocs.yml navigation - [x] Documentation builds and is formatted properly | 11 个月前 | |
ci: remove broken links (#6490) ## Changes Made Removed broken links. | 6 个月前 | |
docs: add UDF patterns tutorial notebook and example page (#6539) ## Summary - Adds tutorials/udf_patterns/udf_patterns.ipynb — a self-contained notebook covering all four UDF patterns (row-wise, generator, async, stateful) plus batch, using a support-ticket dataset throughout - Adds docs/examples/udf-patterns.md — the rendered example page with a Google Colab link at the top - Adds a card to docs/examples/index.md for the new example - Adds a navigation entry to docs/SUMMARY.md ## Test plan - [x] make docs — builds successfully - [x] make doctests — 273 passed, 1 skipped - [x] make format — passed - [x] make lint — passed - [x] make precommit — all hooks passed 🤖 Generated with [Claude Code](https://claude.com/claude-code) --------- Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com> | 6 个月前 | |
refactor(ext): use single, publishable crate for daft-ext types (#6452) ## Changes Made This consolidates the daft-ext types into one crate so it's easy to publish as just 'daft-ext'. Splitting into individual crates so prematurely just adds complexity. ## Related Issues N/A --------- Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com> Co-authored-by: Desmond Cheong <desmondcheongzx@gmail.com> | 6 个月前 | |
feat: migrate first batch of daft functions (#5086) ## Changes Made First phase of our daft.functions migration + Expression namespacing deprecation! These changes should all be uncontroversial, and all of [the comments about them](https://www.notion.so/Expressions-Migration-Tasks-246091bd8634806a8f24eb573d8d3b3e?source=copy_link) have been resolved. Thus, I'm hoping that the reviews for this PR will be a little easier since they should only need to focus on the structural changes rather than the naming ones. I'm leaving the ones with unresolved discussions for future PRs, but this covers something like 95% of expressions. In addition, since the existing tests call the expression methods, which in turn call daft.functions, passing those tests should indicate both that the new functions work and that the existing methods have not been broken. All of the functions are straightforward Python-only changes except for two: - daft.functions.length has to work on binary, string, as well as list types. prior to that they were three separate functions, so I had to write a new scalar function on the Rust side - similarly, daft.functions.concat works for both string and binary, whereas the original functions were separate. I implemented this one by implementing Expression.__add__ between two binary expressions, and then just used the add implementation in the new concat scalar function ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> ## Checklist - [x] Documented in API Docs (if applicable) - [x] Documented in User Guide (if applicable) - [x] If adding a new documentation page, doc is added to docs/mkdocs.yml navigation - [x] Documentation builds and is formatted properly (tag @/ccmao1130 for docs review) --------- Co-authored-by: Srinivas Lade <srinulade1@gmail.com> | 1 年前 | |
docs: add voice-analytics-example and update index (#5737) ## Changes Made A docs update including updating the index page, adding a new voice analytics example, fixing the jinja template for docstrings and removing images from the old covers. --------- Co-authored-by: Srinivas Lade <srinulade1@gmail.com> | 10 个月前 | |
feat(docs): add copy page as markdown button (#5828) ## Summary Adds a "Copy page" button to documentation pages that copies the raw markdown source to clipboard. ## Demo https://github.com/user-attachments/assets/f02fd499-a510-4338-b7e2-4c7bfb5048cb ## Changes - **hooks.py**: Inject button HTML and base64-encoded markdown at build time - **custom.js**: Handle click events to decode and copy markdown - **extra.css**: Style the button ## Supported Pages The button appears on: - Quickstart page - Example pages (excluding index) - AI function pages (excluding overview) ## Test Plan - [x] Verify button appears on quickstart page - [x] Verify button appears on example pages - [x] Verify button appears on AI function pages - [x] Verify button does NOT appear on home page - [x] Verify button does NOT appear on API pages - [x] Verify copied content matches original markdown - [x] Verify button works after instant navigation between pages | 9 个月前 | |
fix: correct grid card indentation on modalities overview page (#6530) ## Summary - Fix broken grid card layout on the [Modalities Overview](https://docs.daft.ai/en/stable/modalities/overview/) page where description text rendered outside the card squares - Change description indentation from 2 spaces to 4 spaces in docs/modalities/overview.md to match MkDocs Material grid card requirements (consistent with docs/api/index.md) Closes #6529 ## Test plan - [x] Verify the modalities overview page renders card descriptions inside the card boxes after deploy 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com> | 6 个月前 | |
ci: remove broken links (#6490) ## Changes Made Removed broken links. | 6 个月前 | |
feat(metrics): add metrics docs (#6253) ## Changes Made * Consolidated observability docs under docs/observability/. * Added a new Progress Indicators page at docs/observability/progress-indicators.md (migrated from optimization docs and retitled/scoped). * Moved logging docs to docs/observability/logging.md. * Added docs/observability/telemetry.md for otel metrics ## Related Issues https://github.com/Eventual-Inc/Daft/discussions/5155 | 7 个月前 | |
docs(optimization): add join strategies guide (#6367) Adds a new page under Optimization covering join types, column name conflict resolution, and execution strategy selection (hash, broadcast, sort-merge). Includes guidance on distributed joins with Ray, disk spilling via flight shuffle, and when to override the optimizer's default strategy. Closes #2690 --------- Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com> | 7 个月前 | |
docs: add noindex tag to non-stable pages (#5105) ## Changes Made Adds noindex tag to all docs that are not /stable/ As per https://aioseo.com/docs/when-to-use-noindex-or-the-robots-txt/ > The biggest difference to understand is that if you want search engines to not include content in search results, then you MUST use the NOINDEX tag and you MUST allow search engines to crawl the content. If search engines CANNOT crawl the content then they CANNOT see the NOINDEX meta tag and therefore CANNOT exclude the content from search results. > > So if you want content not to be included in search results, then use NOINDEX. If you want to stop search engines crawling a directory on your server because it contains nothing they need to see, then use “Disallow” directive in your robots.txt file. i.e. we should: 1. Allow for crawling of all docs (fix robots.txt) NOTE: this is not done in this PR, see below for why 2. Add a canonical link for everything that is not stable NOTE: this is done already 3. Add a <noindex> tag for everything that is not stable This PR just does (3). This means that starting from 0.6.0, all versioned docs will have the noindex tag. However, it is not yet safe to modify our robots.txt because all docs <0.6.0 still do not contain noindex. We should only modify the robots.txt once we have that guarantee. ## Testing * Confirmed that <noindex> tag now appears in this build: https://getdaft-docs--5105.org.readthedocs.build/en/5105/quickstart/ * Previously not appearing in https://docs.daft.ai/en/v0.5.22/quickstart/ | 1 年前 | |
chore(dev): use pyproject.toml to manage the dev dependencies (#4849) ## Changes Made Currently daft uses requirememnts-dev.txt and requirements-doc.txt to manage the dev and doc dependencies but use uv manage the release dependences. But uv has the same capabilities. We could remove requirements.txt and leverage uv to manage all the packages. ## Related Issues Close https://github.com/Eventual-Inc/Daft/issues/4682 Close https://github.com/Eventual-Inc/Daft/pull/4754 --------- Co-authored-by: desmondcheongzx <desmondcheongzx@gmail.com> | 1 年前 | |
docs: Update daft.File API and add docstrings, improve error handling in tests (#5877) - Updated error messages in AudioFile and related functions to provide clearer instructions for installing required modules (soundfile and librosa). - Enhanced docstrings to include detailed metadata descriptions for audio files. - Added new documentation files for daft.File types and updated existing documentation links for better navigation. - Improved test cases to ensure informative error handling when dependencies are missing. This change aims to improve user experience by providing clearer guidance on required dependencies and enhancing the overall documentation structure. | 8 个月前 | |
docs: add voice-analytics-example and update index (#5737) ## Changes Made A docs update including updating the index page, adding a new voice analytics example, fixing the jinja template for docstrings and removing images from the old covers. --------- Co-authored-by: Srinivas Lade <srinulade1@gmail.com> | 10 个月前 | |
| 7 个月前 | ||
docs: add UDF patterns tutorial notebook and example page (#6539) ## Summary - Adds tutorials/udf_patterns/udf_patterns.ipynb — a self-contained notebook covering all four UDF patterns (row-wise, generator, async, stateful) plus batch, using a support-ticket dataset throughout - Adds docs/examples/udf-patterns.md — the rendered example page with a Google Colab link at the top - Adds a card to docs/examples/index.md for the new example - Adds a navigation entry to docs/SUMMARY.md ## Test plan - [x] make docs — builds successfully - [x] make doctests — 273 passed, 1 skipped - [x] make format — passed - [x] make lint — passed - [x] make precommit — all hooks passed 🤖 Generated with [Claude Code](https://claude.com/claude-code) --------- Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com> | 6 个月前 | |
feat(docs): add copy page as markdown button (#5828) ## Summary Adds a "Copy page" button to documentation pages that copies the raw markdown source to clipboard. ## Demo https://github.com/user-attachments/assets/f02fd499-a510-4338-b7e2-4c7bfb5048cb ## Changes - **hooks.py**: Inject button HTML and base64-encoded markdown at build time - **custom.js**: Handle click events to decode and copy markdown - **extra.css**: Style the button ## Supported Pages The button appears on: - Quickstart page - Example pages (excluding index) - AI function pages (excluding overview) ## Test Plan - [x] Verify button appears on quickstart page - [x] Verify button appears on example pages - [x] Verify button appears on AI function pages - [x] Verify button does NOT appear on home page - [x] Verify button does NOT appear on API pages - [x] Verify copied content matches original markdown - [x] Verify button works after instant navigation between pages | 9 个月前 | |
chore: update Slack invite links across docs and README (#6377) ## Summary - Updated all Slack invite links to the new URL across 7 files (README.rst and 6 docs pages) - Replaced two expired invite tokens ( zt-2e77olvxw-... and zt-3l411uyaq-...) with the current one (zt-3rh9jr9iv-...) ## Test plan - [x] make docs builds successfully - [x] make doctests passes (269 tests) 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com> | 7 个月前 | |
| 7 个月前 | ||
ci: remove broken links (#6490) ## Changes Made Removed broken links. | 6 个月前 | |
docs: clean up roadmap wording (#6517) Minor wording improvements to the roadmap page: - Remove redundant intro sentence - Remove exclamation mark from contributions line - Simplify future work intro wording - Fix Result<T> rendering (use backticks instead of backslash escapes) - Shorten visibility sentence in future work section | 6 个月前 | |
fix: add custom robots.txt (#4823) ## Changes Made add custom robots.txt for google search indexing ## Related Issues n/a ## Checklist - [ ] Documented in API Docs (if applicable) - [ ] Documented in User Guide (if applicable) - [ ] If adding a new documentation page, doc is added to docs/mkdocs.yml navigation - [ ] Documentation builds and is formatted properly (tag @/ccmao1130 for docs review) | 1 年前 | |
docs: improve skills install instructions (#6422) ## Changes Made - Remove "globally" from the npx skills add section header since it supports both project and global scope - Replace "This creates symlinks so the skills are available in any project" with a more accurate description of the interactive prompts (skills, agents, scope, and symlink vs copy) | 6 个月前 | |
feat: add dual-send telemetry to osstelemetry.io (#6540) ## Summary Send telemetry data to osstelemetry.io alongside Scarf for side-by-side comparison during evaluation. ## Changes - ** daft/scarf_telemetry.py**: After the existing Scarf GET request, send the same data to https://osstelemetry.io/data with activity_type (mapped from endpoint name) and package=daft as additional params. The osstelemetry.io call is independent - failures are silently caught and do not affect existing Scarf telemetry. - **docs/telemetry.md**: Updated to mention osstelemetry.io alongside Scarf. - **tests/test_scarf_telemetry.py**: Updated test_scarf_telemetry_basic to verify both the Scarf URL (first call) and the osstelemetry.io URL (second call) using call_args_list instead of call_args. ## Request format The existing Scarf request: GET https://daft.gateway.scarf.sh/daft-import?version=0.3.0&platform=Darwin&python=3.11&arch=arm64 The new osstelemetry.io request: GET https://osstelemetry.io/data?activity_type=daft-import&package=daft&version=0.3.0&platform=Darwin&python=3.11&arch=arm64 For runner events, both include the runner param (e.g. runner=native or runner=ray): GET https://daft.gateway.scarf.sh/daft-runner?version=0.3.0&platform=Darwin&python=3.11&arch=arm64&runner=native GET https://osstelemetry.io/data?activity_type=daft-runner&package=daft&version=0.3.0&platform=Darwin&python=3.11&arch=arm64&runner=native ## Details - Opt-out flags (SCARF_NO_ANALYTICS, DO_NOT_TRACK, DAFT_ANALYTICS_ENABLED) apply to both endpoints - Both calls run in the same daemon thread, so no additional threads are created - Dev builds still skip all telemetry ## Testing Tested locally by: 1. Creating a test branch with the dev-build check commented out and both URLs pointed to localhost servers (port 8001 for Scarf, port 8002 for osstelemetry) 2. Running a simple HTTP server that logs all incoming request paths and query params 3. Running import daft to trigger the import telemetry event Both servers received the expected requests: [SCARF] GET /daft-import version: 0.3.0-dev0 platform: Darwin python: 3.11 arch: arm64 [OSSTELEMETRY] GET /data activity_type: daft-import package: daft version: 0.3.0-dev0 platform: Darwin python: 3.11 arch: arm64 | 6 个月前 |
| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
| 7 个月前 | ||
| 6 个月前 | ||
| 11 个月前 | ||
| 6 个月前 | ||
| 9 个月前 | ||
| 6 个月前 | ||
| 6 个月前 | ||
| 9 个月前 | ||
| 7 个月前 | ||
| 11 个月前 | ||
| 6 个月前 | ||
| 6 个月前 | ||
| 6 个月前 | ||
| 1 年前 | ||
| 10 个月前 | ||
| 9 个月前 | ||
| 6 个月前 | ||
| 6 个月前 | ||
| 7 个月前 | ||
| 7 个月前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 8 个月前 | ||
| 10 个月前 | ||
| 7 个月前 | ||
| 6 个月前 | ||
| 9 个月前 | ||
| 7 个月前 | ||
| 7 个月前 | ||
| 6 个月前 | ||
| 6 个月前 | ||
| 1 年前 | ||
| 6 个月前 | ||
| 6 个月前 |