GGitHubchore: Remove expression namespaces (#5619 )

f76e65a2创建于 2025年11月26日历史提交

文件	最后提交记录	最后更新时间
audio_transcription	chore: Remove expression namespaces (#5619) ## Changes Made Bye bye ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> ## Checklist - [ ] Documented in API Docs (if applicable) - [ ] Documented in User Guide (if applicable) - [ ] If adding a new documentation page, doc is added to `docs/mkdocs.yml` navigation - [ ] Documentation builds and is formatted properly	10 个月前
document_embedding	chore: Remove expression namespaces (#5619) ## Changes Made Bye bye ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> ## Checklist - [ ] Documented in API Docs (if applicable) - [ ] Documented in User Guide (if applicable) - [ ] If adding a new documentation page, doc is added to `docs/mkdocs.yml` navigation - [ ] Documentation builds and is formatted properly	10 个月前
image_classification	chore: Remove expression namespaces (#5619) ## Changes Made Bye bye ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> ## Checklist - [ ] Documented in API Docs (if applicable) - [ ] Documented in User Guide (if applicable) - [ ] If adding a new documentation page, doc is added to `docs/mkdocs.yml` navigation - [ ] Documentation builds and is formatted properly	10 个月前
video_object_detection	chore: Remove expression namespaces (#5619) ## Changes Made Bye bye ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> ## Checklist - [ ] Documented in API Docs (if applicable) - [ ] Documented in User Guide (if applicable) - [ ] If adding a new documentation page, doc is added to `docs/mkdocs.yml` navigation - [ ] Documentation builds and is formatted properly	10 个月前
README.md	docs: Update AI benchmarks (#5264) ## Changes Made Some updates to the AI benchmarks: - Made all data publicly available (requester pays) - Pin versions of libraries in the cluster.yaml - Added run logs in an s3 bucket. - Updated some numbers - Pretty format the charts ## Related Issues <!-- Link to related GitHub issues, e.g., "Closes #123" --> ## Checklist - [ ] Documented in API Docs (if applicable) - [ ] Documented in User Guide (if applicable) - [ ] If adding a new documentation page, doc is added to `docs/mkdocs.yml` navigation - [ ] Documentation builds and is formatted properly (tag @/ccmao1130 for docs review) --------- Co-authored-by: EC2 Default User <ec2-user@ip-172-31-22-159.us-west-2.compute.internal>	1 年前

AI Benchmarks

This repository contains performance benchmarks comparing different data processing engines (Daft, Ray Data, and Spark) across various AI and multimodal data processing workloads.

Overview

The benchmarks cover four different workload types, each designed to test different aspects of multimodal data processing:

Audio Transcription - Transcribing audio files
Document Embedding - Generating embeddings for PDF documents
Image Classification - Classify images
Video Object Detection - Detect objects in videos

Performance Results Summary

Workload	Data Size	Daft	Ray Data	Spark
Audio Transcription	113,800 audio files	6m 22s	29m 20s	25m 46s
Document Embedding	10,000 PDFs	1m 54s	14m 32s	8m 4s
Image Classification	803,580 images	4m 23s	23m 30s	45m 7s
Video Object Detection	1,000 videos	11m 46s	25m 54s	3h 36m