| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
feat(agg): support map_groups with v2 udf (#5927) ## Summary Extend grouped aggregation map_groups to support Daft's new UDF system (@daft.func.batch and @daft.cls/@daft.method.batch) in addition to legacy @daft.udf. ## Changes ## Changes Made <!-- Describe what changes were made and why. Include implementation details if necessary. --> ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> | 8 个月前 | |
refactor: write empty dataframe to parquet/json files via native IO (#5682) ## Changes Made Currently, if the final dataframe is empty, will use the pyarrow fs to write the empty parquet/json files, but if the dataframe is not empty, will use the daft native io to write the data, the write behavior is not consistent, especially if we want to implement new storage backend, we need to cover both scenarios. Secondly, the write empty dataframe to json file is not working currently, because only parquet and csv file format supported during write_empty_tabular, the json file format is not implemented via pyarrow fs. BTW, there still remains a issue that we can write a empty json, but cannot read the empty json via daft.read_json() since cannot infer the schema info. ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> | 9 个月前 |
| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
| 8 个月前 | ||
| 9 个月前 |