文件	最后提交记录	最后更新时间
README.md	Refactor HuggingFace Inference Examples (#204) This PR reorganizes and refactors the DeepSpeed huggingface inference examples. Changes in this PR: - Remove Transformers folder - Add README(s) - pip install requirements.txt - Code example - Point to benchmarking and other resources in DeepSpeed repo - Normalize all names i.e. test-[model_name].py - Add T5 translation task (English to French) - Add huggingface pipeline() object and refactor test-gptj.py - Create folders for different types of ML tasks (text-generation, fill-mask, etc) - Add BERT fill-mask example - Update queries to something more sensible - TODO: Add test-bloom to text-generation folder - Fix typos in code comments Co-authored-by: Lev Kurilenko <lekurile@microsoft.com> Co-authored-by: Ammar Ahmad Awan <ammar.awan@microsoft.com>	3 年前
requirements.txt	Refactor HuggingFace Inference Examples (#204) This PR reorganizes and refactors the DeepSpeed huggingface inference examples. Changes in this PR: - Remove Transformers folder - Add README(s) - pip install requirements.txt - Code example - Point to benchmarking and other resources in DeepSpeed repo - Normalize all names i.e. test-[model_name].py - Add T5 translation task (English to French) - Add huggingface pipeline() object and refactor test-gptj.py - Create folders for different types of ML tasks (text-generation, fill-mask, etc) - Add BERT fill-mask example - Update queries to something more sensible - TODO: Add test-bloom to text-generation folder - Fix typos in code comments Co-authored-by: Lev Kurilenko <lekurile@microsoft.com> Co-authored-by: Ammar Ahmad Awan <ammar.awan@microsoft.com>	3 年前
test-t5.py	Refactor HuggingFace Inference Examples (#204) This PR reorganizes and refactors the DeepSpeed huggingface inference examples. Changes in this PR: - Remove Transformers folder - Add README(s) - pip install requirements.txt - Code example - Point to benchmarking and other resources in DeepSpeed repo - Normalize all names i.e. test-[model_name].py - Add T5 translation task (English to French) - Add huggingface pipeline() object and refactor test-gptj.py - Create folders for different types of ML tasks (text-generation, fill-mask, etc) - Add BERT fill-mask example - Update queries to something more sensible - TODO: Add test-bloom to text-generation folder - Fix typos in code comments Co-authored-by: Lev Kurilenko <lekurile@microsoft.com> Co-authored-by: Ammar Ahmad Awan <ammar.awan@microsoft.com>	3 年前

DeepSpeed Huggingface Text2Text Generation Examples

Setup

Python dependencies:

pip install -r requirements.txt

Usage

Examples can be run as follows:

deepspeed --num_gpus [number of GPUs] test-[model].py

Example Output

Command:

deepspeed --num_gpus 1 test-t5.py

Output:

[{'generated_text': 'd review: this is the best cast iron skillet. Great review! Great review! Great'}]