| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
docs: new section for openai compatible providers (#5748) This pull request updates the documentation to provide clearer guidance on using OpenAI-compatible providers and vLLM Online Serving with Daft's prompt function. It introduces new sections, improves discoverability, and updates example references to reflect recent changes in supported use cases. **Documentation improvements for provider usage:** * Added detailed sections in providers.md for "Prompting with OpenAI-Compatible Providers" and "Prompting with vLLM Online Serving", including code samples for OpenRouter, HuggingFace, Databricks, and vLLM setup. * Updated the summary and navigation in providers.md to include the new provider sections for easier access. * Added cross-links in prompt.md to direct users to the new provider documentation for OpenAI-compatible providers and vLLM Online Serving. **Example and navigation updates:** * Changed the example reference in SUMMARY.md from "Document Processing" to "Voice AI Analytics" to better reflect current supported examples. **General documentation clarity:** * Added a section break in prompt.md for improved readability and flow. --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> | 8 个月前 | |
| 8 个月前 | ||
docs: Revamp optimization docs (#5347) ## Changes Made <!-- Describe what changes were made and why. Include implementation details if necessary. --> ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> ## Checklist - [ ] Documented in API Docs (if applicable) - [ ] Documented in User Guide (if applicable) - [ ] If adding a new documentation page, doc is added to docs/mkdocs.yml navigation - [ ] Documentation builds and is formatted properly | 11 个月前 | |
docs: fix broken Bodo benchmark link (#5762) ## Summary Fixes broken link in the TPC-H benchmarks documentation. The file benchmarks/tpch/pyspark_notebook.ipynb in the bodo-ai/Bodo repo was reorganized/removed, causing a 404. This pins the link to the commit that existed when the reference was originally added (Dec 2024). ## Context This was causing the nightly check-links CI job to fail: - https://github.com/Eventual-Inc/Daft/actions/runs/19974612660/job/57287581046 Note: The CI also reports a 404 for https://lancedb.github.io/lance/ but that fix is already on main (#5724) and will be included in the next release. ## Test Plan - [x] Verify the pinned link works: https://github.com/bodo-ai/Bodo/blob/ec18c281c450ca463b55194c45ba11bcf986d04f/benchmarks/tpch/pyspark_notebook.ipynb | 9 个月前 | |
feat: Support pattern filtering for SHOW TABLES (#5423) ## Changes Made <!-- Describe what changes were made and why. Include implementation details if necessary. --> ### Extended SQL LIKE Pattern Matching in MemoryCatalog - Upgrade sqlparser to extract namespace from query - Translate SQL LIKE patterns to regex (src/daft-catalog/src/pattern.rs) - Supports standard SQL LIKE wildcards: % (zero or more), _ (exactly one), \ (escape) - Updated documentation on SHOW TABLES syntax and pattern behavior ### Testing - Added pattern matching tests to test_sql_show_tables.py and in src/daft-catalog/pattern.rs - cargo test -p daft-catalog pattern:: ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> Closes #4461 Closes #4007 ## Checklist - [x] Documented in API Docs (if applicable) - [ ] Documented in User Guide (if applicable) - [ ] If adding a new documentation page, doc is added to docs/mkdocs.yml navigation - [ ] Documentation builds and is formatted properly | 9 个月前 | |
| 8 个月前 | ||
chore: Add basic usage instructions for daft-dashboard in development guide (#5865) ## Changes Made <!-- Describe what changes were made and why. Include implementation details if necessary. --> Add instructions on the basic usage of Daft Dashboard in the development guide to reduce the learning cost for developers. Daft Dashboard is currently in the rapid development stage. There will be a dedicated article or page to introduce its functions and usage in detail later, but it is more appropriate to include it in the development guide at this stage. ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> Signed-off-by: plotor <zhenchao.wang@hotmail.com> | 9 个月前 | |
feat(docs): add copy page as markdown button (#5828) ## Summary Adds a "Copy page" button to documentation pages that copies the raw markdown source to clipboard. ## Demo https://github.com/user-attachments/assets/f02fd499-a510-4338-b7e2-4c7bfb5048cb ## Changes - **hooks.py**: Inject button HTML and base64-encoded markdown at build time - **custom.js**: Handle click events to decode and copy markdown - **extra.css**: Style the button ## Supported Pages The button appears on: - Quickstart page - Example pages (excluding index) - AI function pages (excluding overview) ## Test Plan - [x] Verify button appears on quickstart page - [x] Verify button appears on example pages - [x] Verify button appears on AI function pages - [x] Verify button does NOT appear on home page - [x] Verify button does NOT appear on API pages - [x] Verify copied content matches original markdown - [x] Verify button works after instant navigation between pages | 9 个月前 | |
docs: fix migration guide (#5563) ## Changes Made Follow-up to #5562 ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> ## Checklist - [ ] Documented in API Docs (if applicable) - [ ] Documented in User Guide (if applicable) - [ ] If adding a new documentation page, doc is added to docs/mkdocs.yml navigation - [ ] Documentation builds and is formatted properly | 10 个月前 | |
feat: Common Crawl x Daft tutorial using Qwen3 (#5472) Added a new tutorial for the new Common Crawl dataset. The notebook explores the crawl data, gives some motivation and exposition around text embeddings, provides a sentence splitting UDF using Spacy, and shows off the new daft.functions.ai.embed_text expression using a locally-running Qwen3 0.6B model. Adds a new example card for this new tutorial, complete with an AI-generated cover image. ## Checklist - [x] Documented in API Docs (if applicable) - [x] Documented in User Guide (if applicable) - [x] If adding a new documentation page, doc is added to docs/mkdocs.yml navigation - [x] Documentation builds and is formatted properly | 10 个月前 | |
chore: Remove runner from context (#5628) ## Changes Made Remove runner methods from daft.context, as they are now decoupled from the context. Changed all uses of daft.context.set_runner_... to daft.set_runner_... ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> ## Checklist - [ ] Documented in API Docs (if applicable) - [ ] Documented in User Guide (if applicable) - [ ] If adding a new documentation page, doc is added to docs/mkdocs.yml navigation - [ ] Documentation builds and is formatted properly | 10 个月前 | |
docs: add voice-analytics-example and update index (#5737) ## Changes Made A docs update including updating the index page, adding a new voice analytics example, fixing the jinja template for docstrings and removing images from the old covers. --------- Co-authored-by: Srinivas Lade <srinulade1@gmail.com> | 9 个月前 | |
feat: migrate first batch of daft functions (#5086) ## Changes Made First phase of our daft.functions migration + Expression namespacing deprecation! These changes should all be uncontroversial, and all of [the comments about them](https://www.notion.so/Expressions-Migration-Tasks-246091bd8634806a8f24eb573d8d3b3e?source=copy_link) have been resolved. Thus, I'm hoping that the reviews for this PR will be a little easier since they should only need to focus on the structural changes rather than the naming ones. I'm leaving the ones with unresolved discussions for future PRs, but this covers something like 95% of expressions. In addition, since the existing tests call the expression methods, which in turn call daft.functions, passing those tests should indicate both that the new functions work and that the existing methods have not been broken. All of the functions are straightforward Python-only changes except for two: - daft.functions.length has to work on binary, string, as well as list types. prior to that they were three separate functions, so I had to write a new scalar function on the Rust side - similarly, daft.functions.concat works for both string and binary, whereas the original functions were separate. I implemented this one by implementing Expression.__add__ between two binary expressions, and then just used the add implementation in the new concat scalar function ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> ## Checklist - [x] Documented in API Docs (if applicable) - [x] Documented in User Guide (if applicable) - [x] If adding a new documentation page, doc is added to docs/mkdocs.yml navigation - [x] Documentation builds and is formatted properly (tag @/ccmao1130 for docs review) --------- Co-authored-by: Srinivas Lade <srinulade1@gmail.com> | 1 年前 | |
docs: add voice-analytics-example and update index (#5737) ## Changes Made A docs update including updating the index page, adding a new voice analytics example, fixing the jinja template for docstrings and removing images from the old covers. --------- Co-authored-by: Srinivas Lade <srinulade1@gmail.com> | 9 个月前 | |
feat(docs): add copy page as markdown button (#5828) ## Summary Adds a "Copy page" button to documentation pages that copies the raw markdown source to clipboard. ## Demo https://github.com/user-attachments/assets/f02fd499-a510-4338-b7e2-4c7bfb5048cb ## Changes - **hooks.py**: Inject button HTML and base64-encoded markdown at build time - **custom.js**: Handle click events to decode and copy markdown - **extra.css**: Style the button ## Supported Pages The button appears on: - Quickstart page - Example pages (excluding index) - AI function pages (excluding overview) ## Test Plan - [x] Verify button appears on quickstart page - [x] Verify button appears on example pages - [x] Verify button appears on AI function pages - [x] Verify button does NOT appear on home page - [x] Verify button does NOT appear on API pages - [x] Verify copied content matches original markdown - [x] Verify button works after instant navigation between pages | 9 个月前 | |
chore: Remove expression namespaces (#5619) ## Changes Made Bye bye ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> ## Checklist - [ ] Documented in API Docs (if applicable) - [ ] Documented in User Guide (if applicable) - [ ] If adding a new documentation page, doc is added to docs/mkdocs.yml navigation - [ ] Documentation builds and is formatted properly | 10 个月前 | |
feat(tools): add markdown-to-notebook converter for documentation (#5691) Depends on https://github.com/Eventual-Inc/Daft/pull/5705. Also depends on #5774. ## Summary - Add a new tool tools/convert_md_to_notebook.py that converts Markdown documentation files to Jupyter notebooks - Replace the outdated docs/quickstart.ipynb with a newly generated version at docs/notebooks/quickstart.ipynb - The converter handles MkDocs-specific syntax (admonitions, icons, grid cards) and converts them to HTML that renders properly in Colab/Jupyter ### Key features of the converter: - Automatically adds Colab badge with correct GitHub links - Converts MkDocs admonitions (!!! note, !!! tip, etc.) to styled HTML divs - Converts relative markdown links to absolute docs.daft.ai URLs - Preserves code output blocks from source markdown - Handles pip install commands by prefixing with ! - Supports --branch option for testing Colab links on feature branches - Supports --update-source flag to add Colab badge to the source markdown file ## Test plan - [x] Run the converter on docs/quickstart.md and verify the output renders correctly in Jupyter/Colab - [x] Verify admonitions render as styled HTML boxes - [x] Verify links point to correct docs.daft.ai URLs - [x] Verify Colab badge links to the correct GitHub path ## Internal https://eventualgroup.slack.com/archives/C09GQPUTXQQ/p1765225846124549 Closes EVE-1327. | 9 个月前 | |
| 9 个月前 | ||
docs: add noindex tag to non-stable pages (#5105) ## Changes Made Adds noindex tag to all docs that are not /stable/ As per https://aioseo.com/docs/when-to-use-noindex-or-the-robots-txt/ > The biggest difference to understand is that if you want search engines to not include content in search results, then you MUST use the NOINDEX tag and you MUST allow search engines to crawl the content. If search engines CANNOT crawl the content then they CANNOT see the NOINDEX meta tag and therefore CANNOT exclude the content from search results. > > So if you want content not to be included in search results, then use NOINDEX. If you want to stop search engines crawling a directory on your server because it contains nothing they need to see, then use “Disallow” directive in your robots.txt file. i.e. we should: 1. Allow for crawling of all docs (fix robots.txt) NOTE: this is not done in this PR, see below for why 2. Add a canonical link for everything that is not stable NOTE: this is done already 3. Add a <noindex> tag for everything that is not stable This PR just does (3). This means that starting from 0.6.0, all versioned docs will have the noindex tag. However, it is not yet safe to modify our robots.txt because all docs <0.6.0 still do not contain noindex. We should only modify the robots.txt once we have that guarantee. ## Testing * Confirmed that <noindex> tag now appears in this build: https://getdaft-docs--5105.org.readthedocs.build/en/5105/quickstart/ * Previously not appearing in https://docs.daft.ai/en/v0.5.22/quickstart/ | 1 年前 | |
chore(dev): use pyproject.toml to manage the dev dependencies (#4849) ## Changes Made Currently daft uses requirememnts-dev.txt and requirements-doc.txt to manage the dev and doc dependencies but use uv manage the release dependences. But uv has the same capabilities. We could remove requirements.txt and leverage uv to manage all the packages. ## Related Issues Close https://github.com/Eventual-Inc/Daft/issues/4682 Close https://github.com/Eventual-Inc/Daft/pull/4754 --------- Co-authored-by: desmondcheongzx <desmondcheongzx@gmail.com> | 1 年前 | |
feat: Support pattern filtering for SHOW TABLES (#5423) ## Changes Made <!-- Describe what changes were made and why. Include implementation details if necessary. --> ### Extended SQL LIKE Pattern Matching in MemoryCatalog - Upgrade sqlparser to extract namespace from query - Translate SQL LIKE patterns to regex (src/daft-catalog/src/pattern.rs) - Supports standard SQL LIKE wildcards: % (zero or more), _ (exactly one), \ (escape) - Updated documentation on SHOW TABLES syntax and pattern behavior ### Testing - Added pattern matching tests to test_sql_show_tables.py and in src/daft-catalog/pattern.rs - cargo test -p daft-catalog pattern:: ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> Closes #4461 Closes #4007 ## Checklist - [x] Documented in API Docs (if applicable) - [ ] Documented in User Guide (if applicable) - [ ] If adding a new documentation page, doc is added to docs/mkdocs.yml navigation - [ ] Documentation builds and is formatted properly | 9 个月前 | |
docs: add voice-analytics-example and update index (#5737) ## Changes Made A docs update including updating the index page, adding a new voice analytics example, fixing the jinja template for docstrings and removing images from the old covers. --------- Co-authored-by: Srinivas Lade <srinulade1@gmail.com> | 9 个月前 | |
chore: Remove runner from context (#5628) ## Changes Made Remove runner methods from daft.context, as they are now decoupled from the context. Changed all uses of daft.context.set_runner_... to daft.set_runner_... ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> ## Checklist - [ ] Documented in API Docs (if applicable) - [ ] Documented in User Guide (if applicable) - [ ] If adding a new documentation page, doc is added to docs/mkdocs.yml navigation - [ ] Documentation builds and is formatted properly | 10 个月前 | |
docs: new section for openai compatible providers (#5748) This pull request updates the documentation to provide clearer guidance on using OpenAI-compatible providers and vLLM Online Serving with Daft's prompt function. It introduces new sections, improves discoverability, and updates example references to reflect recent changes in supported use cases. **Documentation improvements for provider usage:** * Added detailed sections in providers.md for "Prompting with OpenAI-Compatible Providers" and "Prompting with vLLM Online Serving", including code samples for OpenRouter, HuggingFace, Databricks, and vLLM setup. * Updated the summary and navigation in providers.md to include the new provider sections for easier access. * Added cross-links in prompt.md to direct users to the new provider documentation for OpenAI-compatible providers and vLLM Online Serving. **Example and navigation updates:** * Changed the example reference in SUMMARY.md from "Document Processing" to "Voice AI Analytics" to better reflect current supported examples. **General documentation clarity:** * Added a section break in prompt.md for improved readability and flow. --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> | 8 个月前 | |
feat(docs): add copy page as markdown button (#5828) ## Summary Adds a "Copy page" button to documentation pages that copies the raw markdown source to clipboard. ## Demo https://github.com/user-attachments/assets/f02fd499-a510-4338-b7e2-4c7bfb5048cb ## Changes - **hooks.py**: Inject button HTML and base64-encoded markdown at build time - **custom.js**: Handle click events to decode and copy markdown - **extra.css**: Style the button ## Supported Pages The button appears on: - Quickstart page - Example pages (excluding index) - AI function pages (excluding overview) ## Test Plan - [x] Verify button appears on quickstart page - [x] Verify button appears on example pages - [x] Verify button appears on AI function pages - [x] Verify button does NOT appear on home page - [x] Verify button does NOT appear on API pages - [x] Verify copied content matches original markdown - [x] Verify button works after instant navigation between pages | 9 个月前 | |
docs: update index overview page (#5627) Updates the documentation index page to better reflect Daft's capabilities: - Update multimodal processing feature to mention audio, video, and embeddings instead of tensors - Remove ML ecosystem integration feature - Add new feature highlighting built-in AI operations - Update connectivity links to point to internal documentation - Add Hugging Face to cloud storage options - Rewrite introduction to emphasize AI and multimodal workloads --- ## Internal Closes EVE-1205 Closes EVE-1170 Closes EVE-1169 Closes EVE-1174 | 10 个月前 | |
feat: Implement embed_image() (#5101) ## Changes Made Adds support for embed_image(), e.g. import daft from daft.functions.ai import embed_image import numpy as np provider = "transformers" model = "openai/clip-vit-base-patch32" test_image = np.random.randint(0, 255, (100, 100, 3), dtype=np.uint8) ( daft.from_pydict({"image": [test_image] * 16}) .select(daft.col("image").cast(daft.DataType.image())) .select(embed_image(daft.col("image"), provider=provider, model=model)) .show() ) **!! Currently only supports OpenAI CLIP models: https://huggingface.co/docs/transformers/en/model_doc/clip** --------- Co-authored-by: R. C. Howell <5731503+rchowell@users.noreply.github.com> | 1 年前 | |
feat(tools): add markdown-to-notebook converter for documentation (#5691) Depends on https://github.com/Eventual-Inc/Daft/pull/5705. Also depends on #5774. ## Summary - Add a new tool tools/convert_md_to_notebook.py that converts Markdown documentation files to Jupyter notebooks - Replace the outdated docs/quickstart.ipynb with a newly generated version at docs/notebooks/quickstart.ipynb - The converter handles MkDocs-specific syntax (admonitions, icons, grid cards) and converts them to HTML that renders properly in Colab/Jupyter ### Key features of the converter: - Automatically adds Colab badge with correct GitHub links - Converts MkDocs admonitions (!!! note, !!! tip, etc.) to styled HTML divs - Converts relative markdown links to absolute docs.daft.ai URLs - Preserves code output blocks from source markdown - Handles pip install commands by prefixing with ! - Supports --branch option for testing Colab links on feature branches - Supports --update-source flag to add Colab badge to the source markdown file ## Test plan - [x] Run the converter on docs/quickstart.md and verify the output renders correctly in Jupyter/Colab - [x] Verify admonitions render as styled HTML boxes - [x] Verify links point to correct docs.daft.ai URLs - [x] Verify Colab badge links to the correct GitHub path ## Internal https://eventualgroup.slack.com/archives/C09GQPUTXQQ/p1765225846124549 Closes EVE-1327. | 9 个月前 | |
chore!: remove spark connect (#5743) # Remove Spark Connect support ## Motivation We've maintained Spark Connect compatibility for about a year with minimal adoption or interest from users. ## Changes removes spark connect from codebase ## Rationale - No user traction: Haven't seen meaningful adoption despite being available for ~1 year - Maintenance burden: Substantial codebase to maintain, test, and keep compatible This simplifies the codebase and lets us focus on what makes Daft unique. | 9 个月前 | |
fix: add custom robots.txt (#4823) ## Changes Made add custom robots.txt for google search indexing ## Related Issues n/a ## Checklist - [ ] Documented in API Docs (if applicable) - [ ] Documented in User Guide (if applicable) - [ ] If adding a new documentation page, doc is added to docs/mkdocs.yml navigation - [ ] Documentation builds and is formatted properly (tag @/ccmao1130 for docs review) | 1 年前 | |
docs: Restructure docs to target users (#4875) ## Changes Made Our current docs target daft developers instead of users. Let's flip the script. Here's the build: https://docs.daft.ai/en/desmond-restructure-docs/ | 1 年前 |
| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
| 8 个月前 | ||
| 8 个月前 | ||
| 11 个月前 | ||
| 9 个月前 | ||
| 9 个月前 | ||
| 8 个月前 | ||
| 9 个月前 | ||
| 9 个月前 | ||
| 10 个月前 | ||
| 10 个月前 | ||
| 10 个月前 | ||
| 9 个月前 | ||
| 1 年前 | ||
| 9 个月前 | ||
| 9 个月前 | ||
| 10 个月前 | ||
| 9 个月前 | ||
| 9 个月前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 9 个月前 | ||
| 9 个月前 | ||
| 10 个月前 | ||
| 8 个月前 | ||
| 9 个月前 | ||
| 10 个月前 | ||
| 1 年前 | ||
| 9 个月前 | ||
| 9 个月前 | ||
| 1 年前 | ||
| 1 年前 |