develop/ai_data_engineering

文件	最后提交记录	最后更新时间
__glue.py	chore: bump mypy and ruff in pre-commit (#5836) ## Changes Made Bump mypy to 1.19.1 and ruff to 0.14.10 and resolve pre-commit errors. Rationale: my local ruff version is much higher than that in the project pre-commit, so I am getting a lot of linter warnings in my IDE. It is also about time to upgrade lints to utilize newer Python language features. ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" -->	9 个月前
__gravitino.py	feat: Add Apache Gravitino catalog in catalog module (#5694) ## Changes Made Add support for Apache Gravitino as a data catalog in Daft. This PR is adding the catalog class implementation. ## Related Issues The first pr for https://github.com/Eventual-Inc/Daft/issues/5503 --------- Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>	10 个月前
__iceberg.py	revert!: "revert: Temporarily revert "Remove deprecated APIs for 0.6" (#5084) ## Changes Made Unrevert https://github.com/Eventual-Inc/Daft/pull/5050 now that we've cut a new v0.5	1 年前
__init__.py	feat: Support pattern filtering for SHOW TABLES (#5423) ## Changes Made <!-- Describe what changes were made and why. Include implementation details if necessary. --> ### Extended SQL LIKE Pattern Matching in MemoryCatalog - Upgrade sqlparser to extract namespace from query - Translate SQL LIKE patterns to regex (src/daft-catalog/src/pattern.rs) - Supports standard SQL LIKE wildcards: % (zero or more), _ (exactly one), \ (escape) - Updated documentation on SHOW TABLES syntax and pattern behavior ### Testing - Added pattern matching tests to test_sql_show_tables.py and in src/daft-catalog/pattern.rs - cargo test -p daft-catalog pattern:: ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> Closes #4461 Closes #4007 ## Checklist - [x] Documented in API Docs (if applicable) - [ ] Documented in User Guide (if applicable) - [ ] If adding a new documentation page, doc is added to docs/mkdocs.yml navigation - [ ] Documentation builds and is formatted properly	9 个月前
__internal.py	feat: support creating partitioned tables in Iceberg via the Catalog interface. (#4951) ## Changes Made Support creating partitioned tables in Iceberg via the Catalog interface. Added function to translate daft's PartitionFields to a pyiceberg PartitionSpec and handled partition field list if passed as argument in _create_table function. ## Related Issues #4876 ## Checklist - [ ] Documented in API Docs (if applicable) - [ ] Documented in User Guide (if applicable) - [ ] If adding a new documentation page, doc is added to docs/mkdocs.yml navigation - [ ] Documentation builds and is formatted properly (tag @/ccmao1130 for docs review) --------- Co-authored-by: redpheonixx <“amit220698@gmail.com”>	1 年前
__postgres.py	fix: Postgres overwrite table should enable RLS and set up pgvector automatically (#5657) ## Changes Made Previously we didn't use the drop, create, append table functionality in the Table.overwrite() method. This resulted in duplicate code that we didn't implement correctly. We can instead simply rely on existing implementations that already work. --------- Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>	10 个月前
__s3tables.py	feat: support creating partitioned tables in Iceberg via the Catalog interface. (#4951) ## Changes Made Support creating partitioned tables in Iceberg via the Catalog interface. Added function to translate daft's PartitionFields to a pyiceberg PartitionSpec and handled partition field list if passed as argument in _create_table function. ## Related Issues #4876 ## Checklist - [ ] Documented in API Docs (if applicable) - [ ] Documented in User Guide (if applicable) - [ ] If adding a new documentation page, doc is added to docs/mkdocs.yml navigation - [ ] Documentation builds and is formatted properly (tag @/ccmao1130 for docs review) --------- Co-authored-by: redpheonixx <“amit220698@gmail.com”>	1 年前
__unity.py	feat(deltalake): allow users to ignore deletion vectors on read (#5758) ## Changes Made an an option to ignore deletion vectors on a delta lake table read instead of failing. ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" -->	10 个月前