| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
feat(catalog): Integrate session and catalog actions alongside existing APIs [2/3] (#3825) This is PR [2/3] for integrating #3805 to Daft/main. This PR adds several implementations with basic end-to-end sanity tests. Most notably, this PR includes the bi-directional implementations for Catalogs and Tables. These enable us to use python-backed implementations in rust (for daft-connect and daft-sql) while also being able to return Catalog/Table python objects for use with the python APIs. **Changes** 1. Adds several internal factories for attach/detaching supported objects to the session. 2. Adds Catalog.from_pydict to cover basic needs and some backwards compatibility. 3. Adds Identifier.from_str for pyiceberg style identifiers (these are entirely optional). 4. Flesh out the [minimal session actions](https://github.com/Eventual-Inc/Daft/compare/rchowell/catalog-1-of-3...rchowell/catalog-2-of-3?expand=1#diff-fc2305e1560f8f7d5a974f58325f4b231bc638d6bacebbc795b6f8fb924114ccR1884-R1895) for a release. 5. Adds Bindings for a single name resolution abstraction, will come in handy for case-normalization in the near future. 6. Updates daft-connect and daft-sql to use attach_table Part [3/3] will cutover all deprecated APIs to use these new APIs and remove the unused artifacts. These APIs are enumerated in #3820 | 1 年前 | |
| 6 个月前 | ||
feat(catalogs): Rust-based in-memory catalog and table (#4445) ## Changes Made Move the implementation of MemoryCatalog and MemoryTable from Python into Rust, thus making them the first full Rust-based implementations of catalogs and tables! In addition, added the ability to modify (append and overwrite) MemoryTables. Slightly related: changed Table ABC so that append and overwrite need to be implemented instead of write. ## Related Issues Follow-up to #4394 ## Checklist - [x] Documented in API Docs (if applicable) - [x] Documented in User Guide (if applicable) - [x] If adding a new documentation page, doc is added to docs/mkdocs.yml navigation - [x] Documentation builds and is formatted properly (tag @/ccmao1130 for docs review) | 1 年前 | |
feat!: add iceberg table support with the gravitino catalog (#6509) ## Changes Made This refactors the Gravitino catalog implementation to match our Glue implementation. It looks at table information to determine which concrete Table implementation to use. This also refactors the Catalog creation a little bit to once again match Glue. I'm not proud of the Catalog.from_* thing with the objects, and I like the pyiceberg choice of the top-level load_ methods, hence why later implementations like Glue use that pattern, so I've updated Gravitino to follow this. This PR also properly internalizes/encapsulates the client, I wasn't interested in having our own Gravitino client vs. using the python one, but the customer required this -- so I just hid the client and updated the docs accordingly. Also a tiny fix on an old typo of mine from the video reader: read_glob_paths/from_glob_paths. ## Related Issues - Closes #6318 - Closes #6319 | 6 个月前 | |
fix: close connections in io tests and address other warnings (#6470) ## Changes Made * Iceberg tests weren't closing the sqlite connection which made our CI logs flooded with warnings. * Several other io tests had the same issue. * Also fixes some additional warnings which are making CI logs noisy. ## Related Issues N/A | 6 个月前 | |
chore: Upgrade Ruff ruleset to 3.9 and add from __future__ import annotations (#4393) | 1 年前 | |
feat: Support pattern filtering for SHOW TABLES (#5423) ## Changes Made <!-- Describe what changes were made and why. Include implementation details if necessary. --> ### Extended SQL LIKE Pattern Matching in MemoryCatalog - Upgrade sqlparser to extract namespace from query - Translate SQL LIKE patterns to regex (src/daft-catalog/src/pattern.rs) - Supports standard SQL LIKE wildcards: % (zero or more), _ (exactly one), \ (escape) - Updated documentation on SHOW TABLES syntax and pattern behavior ### Testing - Added pattern matching tests to test_sql_show_tables.py and in src/daft-catalog/pattern.rs - cargo test -p daft-catalog pattern:: ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> Closes #4461 Closes #4007 ## Checklist - [x] Documented in API Docs (if applicable) - [ ] Documented in User Guide (if applicable) - [ ] If adding a new documentation page, doc is added to docs/mkdocs.yml navigation - [ ] Documentation builds and is formatted properly | 9 个月前 | |
chore: Upgrade Ruff ruleset to 3.9 and add from __future__ import annotations (#4393) | 1 年前 | |
| 6 个月前 | ||
| 6 个月前 |
| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
| 1 年前 | ||
| 6 个月前 | ||
| 1 年前 | ||
| 6 个月前 | ||
| 6 个月前 | ||
| 1 年前 | ||
| 9 个月前 | ||
| 1 年前 | ||
| 6 个月前 | ||
| 6 个月前 |