| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
[RLlib; docs] RLlib documentation do-over (new API stack): Main index page. (#48285) | 1 年前 | |
[Doc] Run pre-commit on rllib docs (#47005) ## Why are these changes needed? Currently we have no linting on any part of the docs code. This PR runs pre-commit on the rllib docs. This PR fixes the following issues: ` trim trailing whitespace.................................................Failed - hook id: trailing-whitespace - exit code: 1 - files were modified by this hook Fixing doc/source/rllib/rllib-rlmodule.rst Fixing doc/source/rllib/rllib-offline.rst Fixing doc/source/rllib/images/catalog/ppo_catalog_and_rlm_diagram.svg Fixing doc/source/rllib/key-concepts.rst Fixing doc/source/rllib/rllib-fault-tolerance.rst Fixing doc/source/rllib/images/connector-diagram.svg Fixing doc/source/rllib/images/catalog/catalog_rlmspecs_diagram.svg Fixing doc/source/rllib/images/catalog/catalog_and_rlm_diagram.svg Fixing doc/source/rllib/rllib-learner.rst fix end of files.........................................................Failed - hook id: end-of-file-fixer - exit code: 1 - files were modified by this hook Fixing doc/source/rllib/package_ref/policy.rst Fixing doc/source/rllib/images/episodes/sa_episode_getters.svg Fixing doc/source/rllib/images/algos/sac-architecture.svg Fixing doc/source/rllib/package_ref/evaluation.rst Fixing doc/source/rllib/images/multi-flat.svg Fixing doc/source/rllib/images/algos/marwil-architecture.svg Fixing doc/source/rllib/images/rllib-config.svg Fixing doc/source/rllib/images/sigils/cont-actions.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-vector-envs.svg Fixing doc/source/rllib/images/algos/ppo-architecture.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-tf-and-torch.svg Fixing doc/source/rllib/images/a2c-arch.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-distributed-learning.svg Fixing doc/source/rllib/images/episodes/sa_episode_non_finalized.svg Fixing doc/source/rllib/images/dqn-arch.svg Fixing doc/source/rllib/images/episodes/sa_episode_non_finalized_vs_finalized.svg Fixing doc/source/rllib/images/algos/appo-architecture.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-multi-agent.svg Fixing doc/source/rllib/images/sigils/multi-gpu.svg Fixing doc/source/rllib/images/episodes/usage_of_episodes.svg Fixing doc/source/rllib/images/rollout_worker_class_overview.svg Fixing doc/source/rllib/images/catalog/ppo_catalog_and_rlm_diagram.svg Fixing doc/source/rllib/images/sigils/new-api-stack.svg Fixing doc/source/rllib/images/sigils/old-api-stack.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-offline-rl.svg Fixing doc/source/rllib/key-concepts.rst Fixing doc/source/rllib/images/impala-arch.svg Fixing doc/source/rllib/images/algos/dqn-architecture.svg Fixing doc/source/rllib/images/episodes/sa_episode.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-external-simulators.svg Fixing doc/source/rllib/images/episodes/sa_episode_finalized.svg Fixing doc/source/rllib/images/rllib-envs.svg Fixing doc/source/rllib/images/dreamerv3/atari100k_1_vs_4gpus.svg Fixing doc/source/rllib/images/apex-arch.svg Fixing doc/source/rllib/images/rllib-index-header.svg Fixing doc/source/rllib/images/algos/icm-architecture.svg Fixing doc/source/rllib/images/sigils/multi-agent.svg Fixing doc/source/rllib/images/sigils/multi-node-multi-gpu.svg Fixing doc/source/rllib/images/env_classes_overview.svg Fixing doc/source/rllib/images/connector-diagram.svg Fixing doc/source/rllib/images/rllib-components.svg Fixing doc/source/rllib/images/algos/impala-architecture.svg Fixing doc/source/rllib/images/rllib-sample-collection.svg Fixing doc/source/rllib/images/policy_classes_overview.svg Fixing doc/source/rllib/images/dreamerv3/dmc_1_vs_4gpus.svg Fixing doc/source/rllib/images/algos/dreamerv3-architecture.svg Fixing doc/source/rllib/package_ref/replay-buffers.rst Fixing doc/source/rllib/images/catalog/catalog_rlmspecs_diagram.svg Fixing doc/source/rllib/images/dreamerv3/pong_1_2_and_4gpus.svg Fixing doc/source/rllib/images/ddppo-arch.svg Fixing doc/source/rllib/images/multi-agent.svg Fixing doc/source/rllib/images/rllib-logo.svg Fixing doc/source/rllib/images/algos/curiosity-architecture.svg Fixing doc/source/rllib/images/episodes/sa_episode_cut_and_lookback.svg Fixing doc/source/rllib/images/rllib-trajectory-view-example.svg Fixing doc/source/rllib/images/rllib-api.svg Fixing doc/source/rllib/images/rllib-stack.svg Fixing doc/source/rllib/images/sigils/discr-actions.svg Fixing doc/source/rllib/images/algos/bc-architecture.svg Fixing doc/source/rllib/images/rllib-batch-modes.svg Fixing doc/source/rllib/images/rllib-external.svg Fixing doc/source/rllib/images/catalog/catalog_and_rlm_diagram.svg Fixing doc/source/rllib/images/sigils/single-agent.svg Fixing doc/source/rllib/package_ref/utils.rst Fixing doc/source/rllib/images/trainer_class_overview.svg Fixing doc/source/rllib/rllib-learner.rst check for added large files..............................................Passed check python ast.........................................................Passed check json...........................................(no files to check)Skipped check toml...........................................(no files to check)Skipped black....................................................................Passed flake8...................................................................Passed prettier.............................................(no files to check)Skipped mypy.................................................(no files to check)Skipped isort (python)...........................................................Passed rst directives end with two colons.......................................Passed rst inline code next to normal text..................................Failed - hook id: rst-inline-touching-normal - exit code: 1 doc/source/rllib/rllib-advanced-api.rst:268:An evaluation step runs - using its own EnvRunners - for evaluation_duration use logger.warning(......................................................Passed check for not-real mock methods..........................................Passed ShellCheck v0.9.0....................................(no files to check)Skipped clang-format.........................................(no files to check)Skipped Google Java Formatter................................(no files to check)Skipped Check for Ray docstyle violations........................................Passed Check for Ray import order violations....................................Passed ## Related issue number Part of https://github.com/ray-project/ray/issues/42587. ## Checks - [x] I've signed off every commit(by using the -s flag, i.e., git commit -s) in this PR. - [x] I've run scripts/format.sh to lint the changes in this PR. - [x] I've included any doc changes needed for https://docs.ray.io/en/master/. - [ ] I've added any new APIs to the API Reference. For example, if I added a method in Tune, I've added it in doc/source/tune/api/ under the corresponding .rst` file. - [x] I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/ - Testing Strategy - [x] Unit tests - [ ] Release tests - [ ] This PR is not tested :( Signed-off-by: pdmurray <peynmurray@gmail.com> | 1 年前 | |
Fix lint (#49710) Signed-off-by: dentiny <dentinyhao@gmail.com> | 1 年前 | |
[Doc] Run pre-commit on rllib docs (#47005) ## Why are these changes needed? Currently we have no linting on any part of the docs code. This PR runs pre-commit on the rllib docs. This PR fixes the following issues: ` trim trailing whitespace.................................................Failed - hook id: trailing-whitespace - exit code: 1 - files were modified by this hook Fixing doc/source/rllib/rllib-rlmodule.rst Fixing doc/source/rllib/rllib-offline.rst Fixing doc/source/rllib/images/catalog/ppo_catalog_and_rlm_diagram.svg Fixing doc/source/rllib/key-concepts.rst Fixing doc/source/rllib/rllib-fault-tolerance.rst Fixing doc/source/rllib/images/connector-diagram.svg Fixing doc/source/rllib/images/catalog/catalog_rlmspecs_diagram.svg Fixing doc/source/rllib/images/catalog/catalog_and_rlm_diagram.svg Fixing doc/source/rllib/rllib-learner.rst fix end of files.........................................................Failed - hook id: end-of-file-fixer - exit code: 1 - files were modified by this hook Fixing doc/source/rllib/package_ref/policy.rst Fixing doc/source/rllib/images/episodes/sa_episode_getters.svg Fixing doc/source/rllib/images/algos/sac-architecture.svg Fixing doc/source/rllib/package_ref/evaluation.rst Fixing doc/source/rllib/images/multi-flat.svg Fixing doc/source/rllib/images/algos/marwil-architecture.svg Fixing doc/source/rllib/images/rllib-config.svg Fixing doc/source/rllib/images/sigils/cont-actions.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-vector-envs.svg Fixing doc/source/rllib/images/algos/ppo-architecture.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-tf-and-torch.svg Fixing doc/source/rllib/images/a2c-arch.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-distributed-learning.svg Fixing doc/source/rllib/images/episodes/sa_episode_non_finalized.svg Fixing doc/source/rllib/images/dqn-arch.svg Fixing doc/source/rllib/images/episodes/sa_episode_non_finalized_vs_finalized.svg Fixing doc/source/rllib/images/algos/appo-architecture.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-multi-agent.svg Fixing doc/source/rllib/images/sigils/multi-gpu.svg Fixing doc/source/rllib/images/episodes/usage_of_episodes.svg Fixing doc/source/rllib/images/rollout_worker_class_overview.svg Fixing doc/source/rllib/images/catalog/ppo_catalog_and_rlm_diagram.svg Fixing doc/source/rllib/images/sigils/new-api-stack.svg Fixing doc/source/rllib/images/sigils/old-api-stack.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-offline-rl.svg Fixing doc/source/rllib/key-concepts.rst Fixing doc/source/rllib/images/impala-arch.svg Fixing doc/source/rllib/images/algos/dqn-architecture.svg Fixing doc/source/rllib/images/episodes/sa_episode.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-external-simulators.svg Fixing doc/source/rllib/images/episodes/sa_episode_finalized.svg Fixing doc/source/rllib/images/rllib-envs.svg Fixing doc/source/rllib/images/dreamerv3/atari100k_1_vs_4gpus.svg Fixing doc/source/rllib/images/apex-arch.svg Fixing doc/source/rllib/images/rllib-index-header.svg Fixing doc/source/rllib/images/algos/icm-architecture.svg Fixing doc/source/rllib/images/sigils/multi-agent.svg Fixing doc/source/rllib/images/sigils/multi-node-multi-gpu.svg Fixing doc/source/rllib/images/env_classes_overview.svg Fixing doc/source/rllib/images/connector-diagram.svg Fixing doc/source/rllib/images/rllib-components.svg Fixing doc/source/rllib/images/algos/impala-architecture.svg Fixing doc/source/rllib/images/rllib-sample-collection.svg Fixing doc/source/rllib/images/policy_classes_overview.svg Fixing doc/source/rllib/images/dreamerv3/dmc_1_vs_4gpus.svg Fixing doc/source/rllib/images/algos/dreamerv3-architecture.svg Fixing doc/source/rllib/package_ref/replay-buffers.rst Fixing doc/source/rllib/images/catalog/catalog_rlmspecs_diagram.svg Fixing doc/source/rllib/images/dreamerv3/pong_1_2_and_4gpus.svg Fixing doc/source/rllib/images/ddppo-arch.svg Fixing doc/source/rllib/images/multi-agent.svg Fixing doc/source/rllib/images/rllib-logo.svg Fixing doc/source/rllib/images/algos/curiosity-architecture.svg Fixing doc/source/rllib/images/episodes/sa_episode_cut_and_lookback.svg Fixing doc/source/rllib/images/rllib-trajectory-view-example.svg Fixing doc/source/rllib/images/rllib-api.svg Fixing doc/source/rllib/images/rllib-stack.svg Fixing doc/source/rllib/images/sigils/discr-actions.svg Fixing doc/source/rllib/images/algos/bc-architecture.svg Fixing doc/source/rllib/images/rllib-batch-modes.svg Fixing doc/source/rllib/images/rllib-external.svg Fixing doc/source/rllib/images/catalog/catalog_and_rlm_diagram.svg Fixing doc/source/rllib/images/sigils/single-agent.svg Fixing doc/source/rllib/package_ref/utils.rst Fixing doc/source/rllib/images/trainer_class_overview.svg Fixing doc/source/rllib/rllib-learner.rst check for added large files..............................................Passed check python ast.........................................................Passed check json...........................................(no files to check)Skipped check toml...........................................(no files to check)Skipped black....................................................................Passed flake8...................................................................Passed prettier.............................................(no files to check)Skipped mypy.................................................(no files to check)Skipped isort (python)...........................................................Passed rst directives end with two colons.......................................Passed rst inline code next to normal text..................................Failed - hook id: rst-inline-touching-normal - exit code: 1 doc/source/rllib/rllib-advanced-api.rst:268:An evaluation step runs - using its own EnvRunners - for evaluation_duration use logger.warning(......................................................Passed check for not-real mock methods..........................................Passed ShellCheck v0.9.0....................................(no files to check)Skipped clang-format.........................................(no files to check)Skipped Google Java Formatter................................(no files to check)Skipped Check for Ray docstyle violations........................................Passed Check for Ray import order violations....................................Passed ## Related issue number Part of https://github.com/ray-project/ray/issues/42587. ## Checks - [x] I've signed off every commit(by using the -s flag, i.e., git commit -s) in this PR. - [x] I've run scripts/format.sh to lint the changes in this PR. - [x] I've included any doc changes needed for https://docs.ray.io/en/master/. - [ ] I've added any new APIs to the API Reference. For example, if I added a method in Tune, I've added it in doc/source/tune/api/ under the corresponding .rst` file. - [x] I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/ - Testing Strategy - [x] Unit tests - [ ] Release tests - [ ] This PR is not tested :( Signed-off-by: pdmurray <peynmurray@gmail.com> | 1 年前 | |
Fix lint (#49546) Signed-off-by: dentiny <dentinyhao@gmail.com> | 1 年前 | |
[Doc] Run pre-commit on rllib docs (#47005) ## Why are these changes needed? Currently we have no linting on any part of the docs code. This PR runs pre-commit on the rllib docs. This PR fixes the following issues: ` trim trailing whitespace.................................................Failed - hook id: trailing-whitespace - exit code: 1 - files were modified by this hook Fixing doc/source/rllib/rllib-rlmodule.rst Fixing doc/source/rllib/rllib-offline.rst Fixing doc/source/rllib/images/catalog/ppo_catalog_and_rlm_diagram.svg Fixing doc/source/rllib/key-concepts.rst Fixing doc/source/rllib/rllib-fault-tolerance.rst Fixing doc/source/rllib/images/connector-diagram.svg Fixing doc/source/rllib/images/catalog/catalog_rlmspecs_diagram.svg Fixing doc/source/rllib/images/catalog/catalog_and_rlm_diagram.svg Fixing doc/source/rllib/rllib-learner.rst fix end of files.........................................................Failed - hook id: end-of-file-fixer - exit code: 1 - files were modified by this hook Fixing doc/source/rllib/package_ref/policy.rst Fixing doc/source/rllib/images/episodes/sa_episode_getters.svg Fixing doc/source/rllib/images/algos/sac-architecture.svg Fixing doc/source/rllib/package_ref/evaluation.rst Fixing doc/source/rllib/images/multi-flat.svg Fixing doc/source/rllib/images/algos/marwil-architecture.svg Fixing doc/source/rllib/images/rllib-config.svg Fixing doc/source/rllib/images/sigils/cont-actions.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-vector-envs.svg Fixing doc/source/rllib/images/algos/ppo-architecture.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-tf-and-torch.svg Fixing doc/source/rllib/images/a2c-arch.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-distributed-learning.svg Fixing doc/source/rllib/images/episodes/sa_episode_non_finalized.svg Fixing doc/source/rllib/images/dqn-arch.svg Fixing doc/source/rllib/images/episodes/sa_episode_non_finalized_vs_finalized.svg Fixing doc/source/rllib/images/algos/appo-architecture.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-multi-agent.svg Fixing doc/source/rllib/images/sigils/multi-gpu.svg Fixing doc/source/rllib/images/episodes/usage_of_episodes.svg Fixing doc/source/rllib/images/rollout_worker_class_overview.svg Fixing doc/source/rllib/images/catalog/ppo_catalog_and_rlm_diagram.svg Fixing doc/source/rllib/images/sigils/new-api-stack.svg Fixing doc/source/rllib/images/sigils/old-api-stack.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-offline-rl.svg Fixing doc/source/rllib/key-concepts.rst Fixing doc/source/rllib/images/impala-arch.svg Fixing doc/source/rllib/images/algos/dqn-architecture.svg Fixing doc/source/rllib/images/episodes/sa_episode.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-external-simulators.svg Fixing doc/source/rllib/images/episodes/sa_episode_finalized.svg Fixing doc/source/rllib/images/rllib-envs.svg Fixing doc/source/rllib/images/dreamerv3/atari100k_1_vs_4gpus.svg Fixing doc/source/rllib/images/apex-arch.svg Fixing doc/source/rllib/images/rllib-index-header.svg Fixing doc/source/rllib/images/algos/icm-architecture.svg Fixing doc/source/rllib/images/sigils/multi-agent.svg Fixing doc/source/rllib/images/sigils/multi-node-multi-gpu.svg Fixing doc/source/rllib/images/env_classes_overview.svg Fixing doc/source/rllib/images/connector-diagram.svg Fixing doc/source/rllib/images/rllib-components.svg Fixing doc/source/rllib/images/algos/impala-architecture.svg Fixing doc/source/rllib/images/rllib-sample-collection.svg Fixing doc/source/rllib/images/policy_classes_overview.svg Fixing doc/source/rllib/images/dreamerv3/dmc_1_vs_4gpus.svg Fixing doc/source/rllib/images/algos/dreamerv3-architecture.svg Fixing doc/source/rllib/package_ref/replay-buffers.rst Fixing doc/source/rllib/images/catalog/catalog_rlmspecs_diagram.svg Fixing doc/source/rllib/images/dreamerv3/pong_1_2_and_4gpus.svg Fixing doc/source/rllib/images/ddppo-arch.svg Fixing doc/source/rllib/images/multi-agent.svg Fixing doc/source/rllib/images/rllib-logo.svg Fixing doc/source/rllib/images/algos/curiosity-architecture.svg Fixing doc/source/rllib/images/episodes/sa_episode_cut_and_lookback.svg Fixing doc/source/rllib/images/rllib-trajectory-view-example.svg Fixing doc/source/rllib/images/rllib-api.svg Fixing doc/source/rllib/images/rllib-stack.svg Fixing doc/source/rllib/images/sigils/discr-actions.svg Fixing doc/source/rllib/images/algos/bc-architecture.svg Fixing doc/source/rllib/images/rllib-batch-modes.svg Fixing doc/source/rllib/images/rllib-external.svg Fixing doc/source/rllib/images/catalog/catalog_and_rlm_diagram.svg Fixing doc/source/rllib/images/sigils/single-agent.svg Fixing doc/source/rllib/package_ref/utils.rst Fixing doc/source/rllib/images/trainer_class_overview.svg Fixing doc/source/rllib/rllib-learner.rst check for added large files..............................................Passed check python ast.........................................................Passed check json...........................................(no files to check)Skipped check toml...........................................(no files to check)Skipped black....................................................................Passed flake8...................................................................Passed prettier.............................................(no files to check)Skipped mypy.................................................(no files to check)Skipped isort (python)...........................................................Passed rst directives end with two colons.......................................Passed rst inline code next to normal text..................................Failed - hook id: rst-inline-touching-normal - exit code: 1 doc/source/rllib/rllib-advanced-api.rst:268:An evaluation step runs - using its own EnvRunners - for evaluation_duration use logger.warning(......................................................Passed check for not-real mock methods..........................................Passed ShellCheck v0.9.0....................................(no files to check)Skipped clang-format.........................................(no files to check)Skipped Google Java Formatter................................(no files to check)Skipped Check for Ray docstyle violations........................................Passed Check for Ray import order violations....................................Passed ## Related issue number Part of https://github.com/ray-project/ray/issues/42587. ## Checks - [x] I've signed off every commit(by using the -s flag, i.e., git commit -s) in this PR. - [x] I've run scripts/format.sh to lint the changes in this PR. - [x] I've included any doc changes needed for https://docs.ray.io/en/master/. - [ ] I've added any new APIs to the API Reference. For example, if I added a method in Tune, I've added it in doc/source/tune/api/ under the corresponding .rst` file. - [x] I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/ - Testing Strategy - [x] Unit tests - [ ] Release tests - [ ] This PR is not tested :( Signed-off-by: pdmurray <peynmurray@gmail.com> | 1 年前 | |
Fix lint (#49702) Signed-off-by: dentiny <dentinyhao@gmail.com> | 1 年前 | |
Fix lint (#49546) Signed-off-by: dentiny <dentinyhao@gmail.com> | 1 年前 | |
[RLlib; docs] RLlib documentation do-over (new API stack): Main index page. (#48285) | 1 年前 | |
[docs] new structure (#21776) This PR consolidates both #21667 and #21759 (look there for features), but improves on them in the following way: - [x] we reverted renaming of existing projects tune, rllib, train, cluster, serve, raysgd and data so that links won't break. I think my consolidation efforts with the ray- prefix were a little overeager in that regard. It's better like this. Only the creation of ray-core was a necessity, and some files moved into the rllib folder, so that should be relatively benign. - [x] Additionally, we added Algolia docsearch, screenshot below. This is _much_ better than our current search. Caveat: there's a sphinx dependency that needs to be replaced (sphinx-tabs) by another, newer one (sphinx-panels), as the former prevents loading of the algolia.js library. Will follow-up in the next PR (hoping this one doesn't get re-re-re-re-reverted). | 4 年前 | |
[RLlib; docs] Docs do-over (new API stack): New rllib-callback.rst page. (#49513) | 1 年前 | |
[Doc] Run pre-commit on rllib docs (#47005) ## Why are these changes needed? Currently we have no linting on any part of the docs code. This PR runs pre-commit on the rllib docs. This PR fixes the following issues: ` trim trailing whitespace.................................................Failed - hook id: trailing-whitespace - exit code: 1 - files were modified by this hook Fixing doc/source/rllib/rllib-rlmodule.rst Fixing doc/source/rllib/rllib-offline.rst Fixing doc/source/rllib/images/catalog/ppo_catalog_and_rlm_diagram.svg Fixing doc/source/rllib/key-concepts.rst Fixing doc/source/rllib/rllib-fault-tolerance.rst Fixing doc/source/rllib/images/connector-diagram.svg Fixing doc/source/rllib/images/catalog/catalog_rlmspecs_diagram.svg Fixing doc/source/rllib/images/catalog/catalog_and_rlm_diagram.svg Fixing doc/source/rllib/rllib-learner.rst fix end of files.........................................................Failed - hook id: end-of-file-fixer - exit code: 1 - files were modified by this hook Fixing doc/source/rllib/package_ref/policy.rst Fixing doc/source/rllib/images/episodes/sa_episode_getters.svg Fixing doc/source/rllib/images/algos/sac-architecture.svg Fixing doc/source/rllib/package_ref/evaluation.rst Fixing doc/source/rllib/images/multi-flat.svg Fixing doc/source/rllib/images/algos/marwil-architecture.svg Fixing doc/source/rllib/images/rllib-config.svg Fixing doc/source/rllib/images/sigils/cont-actions.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-vector-envs.svg Fixing doc/source/rllib/images/algos/ppo-architecture.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-tf-and-torch.svg Fixing doc/source/rllib/images/a2c-arch.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-distributed-learning.svg Fixing doc/source/rllib/images/episodes/sa_episode_non_finalized.svg Fixing doc/source/rllib/images/dqn-arch.svg Fixing doc/source/rllib/images/episodes/sa_episode_non_finalized_vs_finalized.svg Fixing doc/source/rllib/images/algos/appo-architecture.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-multi-agent.svg Fixing doc/source/rllib/images/sigils/multi-gpu.svg Fixing doc/source/rllib/images/episodes/usage_of_episodes.svg Fixing doc/source/rllib/images/rollout_worker_class_overview.svg Fixing doc/source/rllib/images/catalog/ppo_catalog_and_rlm_diagram.svg Fixing doc/source/rllib/images/sigils/new-api-stack.svg Fixing doc/source/rllib/images/sigils/old-api-stack.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-offline-rl.svg Fixing doc/source/rllib/key-concepts.rst Fixing doc/source/rllib/images/impala-arch.svg Fixing doc/source/rllib/images/algos/dqn-architecture.svg Fixing doc/source/rllib/images/episodes/sa_episode.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-external-simulators.svg Fixing doc/source/rllib/images/episodes/sa_episode_finalized.svg Fixing doc/source/rllib/images/rllib-envs.svg Fixing doc/source/rllib/images/dreamerv3/atari100k_1_vs_4gpus.svg Fixing doc/source/rllib/images/apex-arch.svg Fixing doc/source/rllib/images/rllib-index-header.svg Fixing doc/source/rllib/images/algos/icm-architecture.svg Fixing doc/source/rllib/images/sigils/multi-agent.svg Fixing doc/source/rllib/images/sigils/multi-node-multi-gpu.svg Fixing doc/source/rllib/images/env_classes_overview.svg Fixing doc/source/rllib/images/connector-diagram.svg Fixing doc/source/rllib/images/rllib-components.svg Fixing doc/source/rllib/images/algos/impala-architecture.svg Fixing doc/source/rllib/images/rllib-sample-collection.svg Fixing doc/source/rllib/images/policy_classes_overview.svg Fixing doc/source/rllib/images/dreamerv3/dmc_1_vs_4gpus.svg Fixing doc/source/rllib/images/algos/dreamerv3-architecture.svg Fixing doc/source/rllib/package_ref/replay-buffers.rst Fixing doc/source/rllib/images/catalog/catalog_rlmspecs_diagram.svg Fixing doc/source/rllib/images/dreamerv3/pong_1_2_and_4gpus.svg Fixing doc/source/rllib/images/ddppo-arch.svg Fixing doc/source/rllib/images/multi-agent.svg Fixing doc/source/rllib/images/rllib-logo.svg Fixing doc/source/rllib/images/algos/curiosity-architecture.svg Fixing doc/source/rllib/images/episodes/sa_episode_cut_and_lookback.svg Fixing doc/source/rllib/images/rllib-trajectory-view-example.svg Fixing doc/source/rllib/images/rllib-api.svg Fixing doc/source/rllib/images/rllib-stack.svg Fixing doc/source/rllib/images/sigils/discr-actions.svg Fixing doc/source/rllib/images/algos/bc-architecture.svg Fixing doc/source/rllib/images/rllib-batch-modes.svg Fixing doc/source/rllib/images/rllib-external.svg Fixing doc/source/rllib/images/catalog/catalog_and_rlm_diagram.svg Fixing doc/source/rllib/images/sigils/single-agent.svg Fixing doc/source/rllib/package_ref/utils.rst Fixing doc/source/rllib/images/trainer_class_overview.svg Fixing doc/source/rllib/rllib-learner.rst check for added large files..............................................Passed check python ast.........................................................Passed check json...........................................(no files to check)Skipped check toml...........................................(no files to check)Skipped black....................................................................Passed flake8...................................................................Passed prettier.............................................(no files to check)Skipped mypy.................................................(no files to check)Skipped isort (python)...........................................................Passed rst directives end with two colons.......................................Passed rst inline code next to normal text..................................Failed - hook id: rst-inline-touching-normal - exit code: 1 doc/source/rllib/rllib-advanced-api.rst:268:An evaluation step runs - using its own EnvRunners - for evaluation_duration use logger.warning(......................................................Passed check for not-real mock methods..........................................Passed ShellCheck v0.9.0....................................(no files to check)Skipped clang-format.........................................(no files to check)Skipped Google Java Formatter................................(no files to check)Skipped Check for Ray docstyle violations........................................Passed Check for Ray import order violations....................................Passed ## Related issue number Part of https://github.com/ray-project/ray/issues/42587. ## Checks - [x] I've signed off every commit(by using the -s flag, i.e., git commit -s) in this PR. - [x] I've run scripts/format.sh to lint the changes in this PR. - [x] I've included any doc changes needed for https://docs.ray.io/en/master/. - [ ] I've added any new APIs to the API Reference. For example, if I added a method in Tune, I've added it in doc/source/tune/api/ under the corresponding .rst` file. - [x] I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/ - Testing Strategy - [x] Unit tests - [ ] Release tests - [ ] This PR is not tested :( Signed-off-by: pdmurray <peynmurray@gmail.com> | 1 年前 | |
[docs] new structure (#21776) This PR consolidates both #21667 and #21759 (look there for features), but improves on them in the following way: - [x] we reverted renaming of existing projects tune, rllib, train, cluster, serve, raysgd and data so that links won't break. I think my consolidation efforts with the ray- prefix were a little overeager in that regard. It's better like this. Only the creation of ray-core was a necessity, and some files moved into the rllib folder, so that should be relatively benign. - [x] Additionally, we added Algolia docsearch, screenshot below. This is _much_ better than our current search. Caveat: there's a sphinx dependency that needs to be replaced (sphinx-tabs) by another, newer one (sphinx-panels), as the former prevents loading of the algolia.js library. Will follow-up in the next PR (hoping this one doesn't get re-re-re-re-reverted). | 4 年前 | |
[Doc] Run pre-commit on rllib docs (#47005) ## Why are these changes needed? Currently we have no linting on any part of the docs code. This PR runs pre-commit on the rllib docs. This PR fixes the following issues: ` trim trailing whitespace.................................................Failed - hook id: trailing-whitespace - exit code: 1 - files were modified by this hook Fixing doc/source/rllib/rllib-rlmodule.rst Fixing doc/source/rllib/rllib-offline.rst Fixing doc/source/rllib/images/catalog/ppo_catalog_and_rlm_diagram.svg Fixing doc/source/rllib/key-concepts.rst Fixing doc/source/rllib/rllib-fault-tolerance.rst Fixing doc/source/rllib/images/connector-diagram.svg Fixing doc/source/rllib/images/catalog/catalog_rlmspecs_diagram.svg Fixing doc/source/rllib/images/catalog/catalog_and_rlm_diagram.svg Fixing doc/source/rllib/rllib-learner.rst fix end of files.........................................................Failed - hook id: end-of-file-fixer - exit code: 1 - files were modified by this hook Fixing doc/source/rllib/package_ref/policy.rst Fixing doc/source/rllib/images/episodes/sa_episode_getters.svg Fixing doc/source/rllib/images/algos/sac-architecture.svg Fixing doc/source/rllib/package_ref/evaluation.rst Fixing doc/source/rllib/images/multi-flat.svg Fixing doc/source/rllib/images/algos/marwil-architecture.svg Fixing doc/source/rllib/images/rllib-config.svg Fixing doc/source/rllib/images/sigils/cont-actions.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-vector-envs.svg Fixing doc/source/rllib/images/algos/ppo-architecture.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-tf-and-torch.svg Fixing doc/source/rllib/images/a2c-arch.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-distributed-learning.svg Fixing doc/source/rllib/images/episodes/sa_episode_non_finalized.svg Fixing doc/source/rllib/images/dqn-arch.svg Fixing doc/source/rllib/images/episodes/sa_episode_non_finalized_vs_finalized.svg Fixing doc/source/rllib/images/algos/appo-architecture.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-multi-agent.svg Fixing doc/source/rllib/images/sigils/multi-gpu.svg Fixing doc/source/rllib/images/episodes/usage_of_episodes.svg Fixing doc/source/rllib/images/rollout_worker_class_overview.svg Fixing doc/source/rllib/images/catalog/ppo_catalog_and_rlm_diagram.svg Fixing doc/source/rllib/images/sigils/new-api-stack.svg Fixing doc/source/rllib/images/sigils/old-api-stack.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-offline-rl.svg Fixing doc/source/rllib/key-concepts.rst Fixing doc/source/rllib/images/impala-arch.svg Fixing doc/source/rllib/images/algos/dqn-architecture.svg Fixing doc/source/rllib/images/episodes/sa_episode.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-external-simulators.svg Fixing doc/source/rllib/images/episodes/sa_episode_finalized.svg Fixing doc/source/rllib/images/rllib-envs.svg Fixing doc/source/rllib/images/dreamerv3/atari100k_1_vs_4gpus.svg Fixing doc/source/rllib/images/apex-arch.svg Fixing doc/source/rllib/images/rllib-index-header.svg Fixing doc/source/rllib/images/algos/icm-architecture.svg Fixing doc/source/rllib/images/sigils/multi-agent.svg Fixing doc/source/rllib/images/sigils/multi-node-multi-gpu.svg Fixing doc/source/rllib/images/env_classes_overview.svg Fixing doc/source/rllib/images/connector-diagram.svg Fixing doc/source/rllib/images/rllib-components.svg Fixing doc/source/rllib/images/algos/impala-architecture.svg Fixing doc/source/rllib/images/rllib-sample-collection.svg Fixing doc/source/rllib/images/policy_classes_overview.svg Fixing doc/source/rllib/images/dreamerv3/dmc_1_vs_4gpus.svg Fixing doc/source/rllib/images/algos/dreamerv3-architecture.svg Fixing doc/source/rllib/package_ref/replay-buffers.rst Fixing doc/source/rllib/images/catalog/catalog_rlmspecs_diagram.svg Fixing doc/source/rllib/images/dreamerv3/pong_1_2_and_4gpus.svg Fixing doc/source/rllib/images/ddppo-arch.svg Fixing doc/source/rllib/images/multi-agent.svg Fixing doc/source/rllib/images/rllib-logo.svg Fixing doc/source/rllib/images/algos/curiosity-architecture.svg Fixing doc/source/rllib/images/episodes/sa_episode_cut_and_lookback.svg Fixing doc/source/rllib/images/rllib-trajectory-view-example.svg Fixing doc/source/rllib/images/rllib-api.svg Fixing doc/source/rllib/images/rllib-stack.svg Fixing doc/source/rllib/images/sigils/discr-actions.svg Fixing doc/source/rllib/images/algos/bc-architecture.svg Fixing doc/source/rllib/images/rllib-batch-modes.svg Fixing doc/source/rllib/images/rllib-external.svg Fixing doc/source/rllib/images/catalog/catalog_and_rlm_diagram.svg Fixing doc/source/rllib/images/sigils/single-agent.svg Fixing doc/source/rllib/package_ref/utils.rst Fixing doc/source/rllib/images/trainer_class_overview.svg Fixing doc/source/rllib/rllib-learner.rst check for added large files..............................................Passed check python ast.........................................................Passed check json...........................................(no files to check)Skipped check toml...........................................(no files to check)Skipped black....................................................................Passed flake8...................................................................Passed prettier.............................................(no files to check)Skipped mypy.................................................(no files to check)Skipped isort (python)...........................................................Passed rst directives end with two colons.......................................Passed rst inline code next to normal text..................................Failed - hook id: rst-inline-touching-normal - exit code: 1 doc/source/rllib/rllib-advanced-api.rst:268:An evaluation step runs - using its own EnvRunners - for evaluation_duration use logger.warning(......................................................Passed check for not-real mock methods..........................................Passed ShellCheck v0.9.0....................................(no files to check)Skipped clang-format.........................................(no files to check)Skipped Google Java Formatter................................(no files to check)Skipped Check for Ray docstyle violations........................................Passed Check for Ray import order violations....................................Passed ## Related issue number Part of https://github.com/ray-project/ray/issues/42587. ## Checks - [x] I've signed off every commit(by using the -s flag, i.e., git commit -s) in this PR. - [x] I've run scripts/format.sh to lint the changes in this PR. - [x] I've included any doc changes needed for https://docs.ray.io/en/master/. - [ ] I've added any new APIs to the API Reference. For example, if I added a method in Tune, I've added it in doc/source/tune/api/ under the corresponding .rst` file. - [x] I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/ - Testing Strategy - [x] Unit tests - [ ] Release tests - [ ] This PR is not tested :( Signed-off-by: pdmurray <peynmurray@gmail.com> | 1 年前 | |
[docs] new structure (#21776) This PR consolidates both #21667 and #21759 (look there for features), but improves on them in the following way: - [x] we reverted renaming of existing projects tune, rllib, train, cluster, serve, raysgd and data so that links won't break. I think my consolidation efforts with the ray- prefix were a little overeager in that regard. It's better like this. Only the creation of ray-core was a necessity, and some files moved into the rllib folder, so that should be relatively benign. - [x] Additionally, we added Algolia docsearch, screenshot below. This is _much_ better than our current search. Caveat: there's a sphinx dependency that needs to be replaced (sphinx-tabs) by another, newer one (sphinx-panels), as the former prevents loading of the algolia.js library. Will follow-up in the next PR (hoping this one doesn't get re-re-re-re-reverted). | 4 年前 | |
[Doc] Run pre-commit on rllib docs (#47005) ## Why are these changes needed? Currently we have no linting on any part of the docs code. This PR runs pre-commit on the rllib docs. This PR fixes the following issues: ` trim trailing whitespace.................................................Failed - hook id: trailing-whitespace - exit code: 1 - files were modified by this hook Fixing doc/source/rllib/rllib-rlmodule.rst Fixing doc/source/rllib/rllib-offline.rst Fixing doc/source/rllib/images/catalog/ppo_catalog_and_rlm_diagram.svg Fixing doc/source/rllib/key-concepts.rst Fixing doc/source/rllib/rllib-fault-tolerance.rst Fixing doc/source/rllib/images/connector-diagram.svg Fixing doc/source/rllib/images/catalog/catalog_rlmspecs_diagram.svg Fixing doc/source/rllib/images/catalog/catalog_and_rlm_diagram.svg Fixing doc/source/rllib/rllib-learner.rst fix end of files.........................................................Failed - hook id: end-of-file-fixer - exit code: 1 - files were modified by this hook Fixing doc/source/rllib/package_ref/policy.rst Fixing doc/source/rllib/images/episodes/sa_episode_getters.svg Fixing doc/source/rllib/images/algos/sac-architecture.svg Fixing doc/source/rllib/package_ref/evaluation.rst Fixing doc/source/rllib/images/multi-flat.svg Fixing doc/source/rllib/images/algos/marwil-architecture.svg Fixing doc/source/rllib/images/rllib-config.svg Fixing doc/source/rllib/images/sigils/cont-actions.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-vector-envs.svg Fixing doc/source/rllib/images/algos/ppo-architecture.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-tf-and-torch.svg Fixing doc/source/rllib/images/a2c-arch.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-distributed-learning.svg Fixing doc/source/rllib/images/episodes/sa_episode_non_finalized.svg Fixing doc/source/rllib/images/dqn-arch.svg Fixing doc/source/rllib/images/episodes/sa_episode_non_finalized_vs_finalized.svg Fixing doc/source/rllib/images/algos/appo-architecture.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-multi-agent.svg Fixing doc/source/rllib/images/sigils/multi-gpu.svg Fixing doc/source/rllib/images/episodes/usage_of_episodes.svg Fixing doc/source/rllib/images/rollout_worker_class_overview.svg Fixing doc/source/rllib/images/catalog/ppo_catalog_and_rlm_diagram.svg Fixing doc/source/rllib/images/sigils/new-api-stack.svg Fixing doc/source/rllib/images/sigils/old-api-stack.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-offline-rl.svg Fixing doc/source/rllib/key-concepts.rst Fixing doc/source/rllib/images/impala-arch.svg Fixing doc/source/rllib/images/algos/dqn-architecture.svg Fixing doc/source/rllib/images/episodes/sa_episode.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-external-simulators.svg Fixing doc/source/rllib/images/episodes/sa_episode_finalized.svg Fixing doc/source/rllib/images/rllib-envs.svg Fixing doc/source/rllib/images/dreamerv3/atari100k_1_vs_4gpus.svg Fixing doc/source/rllib/images/apex-arch.svg Fixing doc/source/rllib/images/rllib-index-header.svg Fixing doc/source/rllib/images/algos/icm-architecture.svg Fixing doc/source/rllib/images/sigils/multi-agent.svg Fixing doc/source/rllib/images/sigils/multi-node-multi-gpu.svg Fixing doc/source/rllib/images/env_classes_overview.svg Fixing doc/source/rllib/images/connector-diagram.svg Fixing doc/source/rllib/images/rllib-components.svg Fixing doc/source/rllib/images/algos/impala-architecture.svg Fixing doc/source/rllib/images/rllib-sample-collection.svg Fixing doc/source/rllib/images/policy_classes_overview.svg Fixing doc/source/rllib/images/dreamerv3/dmc_1_vs_4gpus.svg Fixing doc/source/rllib/images/algos/dreamerv3-architecture.svg Fixing doc/source/rllib/package_ref/replay-buffers.rst Fixing doc/source/rllib/images/catalog/catalog_rlmspecs_diagram.svg Fixing doc/source/rllib/images/dreamerv3/pong_1_2_and_4gpus.svg Fixing doc/source/rllib/images/ddppo-arch.svg Fixing doc/source/rllib/images/multi-agent.svg Fixing doc/source/rllib/images/rllib-logo.svg Fixing doc/source/rllib/images/algos/curiosity-architecture.svg Fixing doc/source/rllib/images/episodes/sa_episode_cut_and_lookback.svg Fixing doc/source/rllib/images/rllib-trajectory-view-example.svg Fixing doc/source/rllib/images/rllib-api.svg Fixing doc/source/rllib/images/rllib-stack.svg Fixing doc/source/rllib/images/sigils/discr-actions.svg Fixing doc/source/rllib/images/algos/bc-architecture.svg Fixing doc/source/rllib/images/rllib-batch-modes.svg Fixing doc/source/rllib/images/rllib-external.svg Fixing doc/source/rllib/images/catalog/catalog_and_rlm_diagram.svg Fixing doc/source/rllib/images/sigils/single-agent.svg Fixing doc/source/rllib/package_ref/utils.rst Fixing doc/source/rllib/images/trainer_class_overview.svg Fixing doc/source/rllib/rllib-learner.rst check for added large files..............................................Passed check python ast.........................................................Passed check json...........................................(no files to check)Skipped check toml...........................................(no files to check)Skipped black....................................................................Passed flake8...................................................................Passed prettier.............................................(no files to check)Skipped mypy.................................................(no files to check)Skipped isort (python)...........................................................Passed rst directives end with two colons.......................................Passed rst inline code next to normal text..................................Failed - hook id: rst-inline-touching-normal - exit code: 1 doc/source/rllib/rllib-advanced-api.rst:268:An evaluation step runs - using its own EnvRunners - for evaluation_duration use logger.warning(......................................................Passed check for not-real mock methods..........................................Passed ShellCheck v0.9.0....................................(no files to check)Skipped clang-format.........................................(no files to check)Skipped Google Java Formatter................................(no files to check)Skipped Check for Ray docstyle violations........................................Passed Check for Ray import order violations....................................Passed ## Related issue number Part of https://github.com/ray-project/ray/issues/42587. ## Checks - [x] I've signed off every commit(by using the -s flag, i.e., git commit -s) in this PR. - [x] I've run scripts/format.sh to lint the changes in this PR. - [x] I've included any doc changes needed for https://docs.ray.io/en/master/. - [ ] I've added any new APIs to the API Reference. For example, if I added a method in Tune, I've added it in doc/source/tune/api/ under the corresponding .rst` file. - [x] I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/ - Testing Strategy - [x] Unit tests - [ ] Release tests - [ ] This PR is not tested :( Signed-off-by: pdmurray <peynmurray@gmail.com> | 1 年前 | |
[docs] new structure (#21776) This PR consolidates both #21667 and #21759 (look there for features), but improves on them in the following way: - [x] we reverted renaming of existing projects tune, rllib, train, cluster, serve, raysgd and data so that links won't break. I think my consolidation efforts with the ray- prefix were a little overeager in that regard. It's better like this. Only the creation of ray-core was a necessity, and some files moved into the rllib folder, so that should be relatively benign. - [x] Additionally, we added Algolia docsearch, screenshot below. This is _much_ better than our current search. Caveat: there's a sphinx dependency that needs to be replaced (sphinx-tabs) by another, newer one (sphinx-panels), as the former prevents loading of the algolia.js library. Will follow-up in the next PR (hoping this one doesn't get re-re-re-re-reverted). | 4 年前 | |
[RLlib] Docs do-over (new API stack): New MetricsLogger API rst page. (#49538) | 1 年前 | |
[Doc] Run pre-commit on rllib docs (#47005) ## Why are these changes needed? Currently we have no linting on any part of the docs code. This PR runs pre-commit on the rllib docs. This PR fixes the following issues: ` trim trailing whitespace.................................................Failed - hook id: trailing-whitespace - exit code: 1 - files were modified by this hook Fixing doc/source/rllib/rllib-rlmodule.rst Fixing doc/source/rllib/rllib-offline.rst Fixing doc/source/rllib/images/catalog/ppo_catalog_and_rlm_diagram.svg Fixing doc/source/rllib/key-concepts.rst Fixing doc/source/rllib/rllib-fault-tolerance.rst Fixing doc/source/rllib/images/connector-diagram.svg Fixing doc/source/rllib/images/catalog/catalog_rlmspecs_diagram.svg Fixing doc/source/rllib/images/catalog/catalog_and_rlm_diagram.svg Fixing doc/source/rllib/rllib-learner.rst fix end of files.........................................................Failed - hook id: end-of-file-fixer - exit code: 1 - files were modified by this hook Fixing doc/source/rllib/package_ref/policy.rst Fixing doc/source/rllib/images/episodes/sa_episode_getters.svg Fixing doc/source/rllib/images/algos/sac-architecture.svg Fixing doc/source/rllib/package_ref/evaluation.rst Fixing doc/source/rllib/images/multi-flat.svg Fixing doc/source/rllib/images/algos/marwil-architecture.svg Fixing doc/source/rllib/images/rllib-config.svg Fixing doc/source/rllib/images/sigils/cont-actions.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-vector-envs.svg Fixing doc/source/rllib/images/algos/ppo-architecture.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-tf-and-torch.svg Fixing doc/source/rllib/images/a2c-arch.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-distributed-learning.svg Fixing doc/source/rllib/images/episodes/sa_episode_non_finalized.svg Fixing doc/source/rllib/images/dqn-arch.svg Fixing doc/source/rllib/images/episodes/sa_episode_non_finalized_vs_finalized.svg Fixing doc/source/rllib/images/algos/appo-architecture.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-multi-agent.svg Fixing doc/source/rllib/images/sigils/multi-gpu.svg Fixing doc/source/rllib/images/episodes/usage_of_episodes.svg Fixing doc/source/rllib/images/rollout_worker_class_overview.svg Fixing doc/source/rllib/images/catalog/ppo_catalog_and_rlm_diagram.svg Fixing doc/source/rllib/images/sigils/new-api-stack.svg Fixing doc/source/rllib/images/sigils/old-api-stack.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-offline-rl.svg Fixing doc/source/rllib/key-concepts.rst Fixing doc/source/rllib/images/impala-arch.svg Fixing doc/source/rllib/images/algos/dqn-architecture.svg Fixing doc/source/rllib/images/episodes/sa_episode.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-external-simulators.svg Fixing doc/source/rllib/images/episodes/sa_episode_finalized.svg Fixing doc/source/rllib/images/rllib-envs.svg Fixing doc/source/rllib/images/dreamerv3/atari100k_1_vs_4gpus.svg Fixing doc/source/rllib/images/apex-arch.svg Fixing doc/source/rllib/images/rllib-index-header.svg Fixing doc/source/rllib/images/algos/icm-architecture.svg Fixing doc/source/rllib/images/sigils/multi-agent.svg Fixing doc/source/rllib/images/sigils/multi-node-multi-gpu.svg Fixing doc/source/rllib/images/env_classes_overview.svg Fixing doc/source/rllib/images/connector-diagram.svg Fixing doc/source/rllib/images/rllib-components.svg Fixing doc/source/rllib/images/algos/impala-architecture.svg Fixing doc/source/rllib/images/rllib-sample-collection.svg Fixing doc/source/rllib/images/policy_classes_overview.svg Fixing doc/source/rllib/images/dreamerv3/dmc_1_vs_4gpus.svg Fixing doc/source/rllib/images/algos/dreamerv3-architecture.svg Fixing doc/source/rllib/package_ref/replay-buffers.rst Fixing doc/source/rllib/images/catalog/catalog_rlmspecs_diagram.svg Fixing doc/source/rllib/images/dreamerv3/pong_1_2_and_4gpus.svg Fixing doc/source/rllib/images/ddppo-arch.svg Fixing doc/source/rllib/images/multi-agent.svg Fixing doc/source/rllib/images/rllib-logo.svg Fixing doc/source/rllib/images/algos/curiosity-architecture.svg Fixing doc/source/rllib/images/episodes/sa_episode_cut_and_lookback.svg Fixing doc/source/rllib/images/rllib-trajectory-view-example.svg Fixing doc/source/rllib/images/rllib-api.svg Fixing doc/source/rllib/images/rllib-stack.svg Fixing doc/source/rllib/images/sigils/discr-actions.svg Fixing doc/source/rllib/images/algos/bc-architecture.svg Fixing doc/source/rllib/images/rllib-batch-modes.svg Fixing doc/source/rllib/images/rllib-external.svg Fixing doc/source/rllib/images/catalog/catalog_and_rlm_diagram.svg Fixing doc/source/rllib/images/sigils/single-agent.svg Fixing doc/source/rllib/package_ref/utils.rst Fixing doc/source/rllib/images/trainer_class_overview.svg Fixing doc/source/rllib/rllib-learner.rst check for added large files..............................................Passed check python ast.........................................................Passed check json...........................................(no files to check)Skipped check toml...........................................(no files to check)Skipped black....................................................................Passed flake8...................................................................Passed prettier.............................................(no files to check)Skipped mypy.................................................(no files to check)Skipped isort (python)...........................................................Passed rst directives end with two colons.......................................Passed rst inline code next to normal text..................................Failed - hook id: rst-inline-touching-normal - exit code: 1 doc/source/rllib/rllib-advanced-api.rst:268:An evaluation step runs - using its own EnvRunners - for evaluation_duration use logger.warning(......................................................Passed check for not-real mock methods..........................................Passed ShellCheck v0.9.0....................................(no files to check)Skipped clang-format.........................................(no files to check)Skipped Google Java Formatter................................(no files to check)Skipped Check for Ray docstyle violations........................................Passed Check for Ray import order violations....................................Passed ## Related issue number Part of https://github.com/ray-project/ray/issues/42587. ## Checks - [x] I've signed off every commit(by using the -s flag, i.e., git commit -s) in this PR. - [x] I've run scripts/format.sh to lint the changes in this PR. - [x] I've included any doc changes needed for https://docs.ray.io/en/master/. - [ ] I've added any new APIs to the API Reference. For example, if I added a method in Tune, I've added it in doc/source/tune/api/ under the corresponding .rst` file. - [x] I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/ - Testing Strategy - [x] Unit tests - [ ] Release tests - [ ] This PR is not tested :( Signed-off-by: pdmurray <peynmurray@gmail.com> | 1 年前 | |
[docs] new structure (#21776) This PR consolidates both #21667 and #21759 (look there for features), but improves on them in the following way: - [x] we reverted renaming of existing projects tune, rllib, train, cluster, serve, raysgd and data so that links won't break. I think my consolidation efforts with the ray- prefix were a little overeager in that regard. It's better like this. Only the creation of ray-core was a necessity, and some files moved into the rllib folder, so that should be relatively benign. - [x] Additionally, we added Algolia docsearch, screenshot below. This is _much_ better than our current search. Caveat: there's a sphinx dependency that needs to be replaced (sphinx-tabs) by another, newer one (sphinx-panels), as the former prevents loading of the algolia.js library. Will follow-up in the next PR (hoping this one doesn't get re-re-re-re-reverted). | 4 年前 | |
[docs] new structure (#21776) This PR consolidates both #21667 and #21759 (look there for features), but improves on them in the following way: - [x] we reverted renaming of existing projects tune, rllib, train, cluster, serve, raysgd and data so that links won't break. I think my consolidation efforts with the ray- prefix were a little overeager in that regard. It's better like this. Only the creation of ray-core was a necessity, and some files moved into the rllib folder, so that should be relatively benign. - [x] Additionally, we added Algolia docsearch, screenshot below. This is _much_ better than our current search. Caveat: there's a sphinx dependency that needs to be replaced (sphinx-tabs) by another, newer one (sphinx-panels), as the former prevents loading of the algolia.js library. Will follow-up in the next PR (hoping this one doesn't get re-re-re-re-reverted). | 4 年前 | |
[Doc] Run pre-commit on rllib docs (#47005) ## Why are these changes needed? Currently we have no linting on any part of the docs code. This PR runs pre-commit on the rllib docs. This PR fixes the following issues: ` trim trailing whitespace.................................................Failed - hook id: trailing-whitespace - exit code: 1 - files were modified by this hook Fixing doc/source/rllib/rllib-rlmodule.rst Fixing doc/source/rllib/rllib-offline.rst Fixing doc/source/rllib/images/catalog/ppo_catalog_and_rlm_diagram.svg Fixing doc/source/rllib/key-concepts.rst Fixing doc/source/rllib/rllib-fault-tolerance.rst Fixing doc/source/rllib/images/connector-diagram.svg Fixing doc/source/rllib/images/catalog/catalog_rlmspecs_diagram.svg Fixing doc/source/rllib/images/catalog/catalog_and_rlm_diagram.svg Fixing doc/source/rllib/rllib-learner.rst fix end of files.........................................................Failed - hook id: end-of-file-fixer - exit code: 1 - files were modified by this hook Fixing doc/source/rllib/package_ref/policy.rst Fixing doc/source/rllib/images/episodes/sa_episode_getters.svg Fixing doc/source/rllib/images/algos/sac-architecture.svg Fixing doc/source/rllib/package_ref/evaluation.rst Fixing doc/source/rllib/images/multi-flat.svg Fixing doc/source/rllib/images/algos/marwil-architecture.svg Fixing doc/source/rllib/images/rllib-config.svg Fixing doc/source/rllib/images/sigils/cont-actions.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-vector-envs.svg Fixing doc/source/rllib/images/algos/ppo-architecture.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-tf-and-torch.svg Fixing doc/source/rllib/images/a2c-arch.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-distributed-learning.svg Fixing doc/source/rllib/images/episodes/sa_episode_non_finalized.svg Fixing doc/source/rllib/images/dqn-arch.svg Fixing doc/source/rllib/images/episodes/sa_episode_non_finalized_vs_finalized.svg Fixing doc/source/rllib/images/algos/appo-architecture.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-multi-agent.svg Fixing doc/source/rllib/images/sigils/multi-gpu.svg Fixing doc/source/rllib/images/episodes/usage_of_episodes.svg Fixing doc/source/rllib/images/rollout_worker_class_overview.svg Fixing doc/source/rllib/images/catalog/ppo_catalog_and_rlm_diagram.svg Fixing doc/source/rllib/images/sigils/new-api-stack.svg Fixing doc/source/rllib/images/sigils/old-api-stack.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-offline-rl.svg Fixing doc/source/rllib/key-concepts.rst Fixing doc/source/rllib/images/impala-arch.svg Fixing doc/source/rllib/images/algos/dqn-architecture.svg Fixing doc/source/rllib/images/episodes/sa_episode.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-external-simulators.svg Fixing doc/source/rllib/images/episodes/sa_episode_finalized.svg Fixing doc/source/rllib/images/rllib-envs.svg Fixing doc/source/rllib/images/dreamerv3/atari100k_1_vs_4gpus.svg Fixing doc/source/rllib/images/apex-arch.svg Fixing doc/source/rllib/images/rllib-index-header.svg Fixing doc/source/rllib/images/algos/icm-architecture.svg Fixing doc/source/rllib/images/sigils/multi-agent.svg Fixing doc/source/rllib/images/sigils/multi-node-multi-gpu.svg Fixing doc/source/rllib/images/env_classes_overview.svg Fixing doc/source/rllib/images/connector-diagram.svg Fixing doc/source/rllib/images/rllib-components.svg Fixing doc/source/rllib/images/algos/impala-architecture.svg Fixing doc/source/rllib/images/rllib-sample-collection.svg Fixing doc/source/rllib/images/policy_classes_overview.svg Fixing doc/source/rllib/images/dreamerv3/dmc_1_vs_4gpus.svg Fixing doc/source/rllib/images/algos/dreamerv3-architecture.svg Fixing doc/source/rllib/package_ref/replay-buffers.rst Fixing doc/source/rllib/images/catalog/catalog_rlmspecs_diagram.svg Fixing doc/source/rllib/images/dreamerv3/pong_1_2_and_4gpus.svg Fixing doc/source/rllib/images/ddppo-arch.svg Fixing doc/source/rllib/images/multi-agent.svg Fixing doc/source/rllib/images/rllib-logo.svg Fixing doc/source/rllib/images/algos/curiosity-architecture.svg Fixing doc/source/rllib/images/episodes/sa_episode_cut_and_lookback.svg Fixing doc/source/rllib/images/rllib-trajectory-view-example.svg Fixing doc/source/rllib/images/rllib-api.svg Fixing doc/source/rllib/images/rllib-stack.svg Fixing doc/source/rllib/images/sigils/discr-actions.svg Fixing doc/source/rllib/images/algos/bc-architecture.svg Fixing doc/source/rllib/images/rllib-batch-modes.svg Fixing doc/source/rllib/images/rllib-external.svg Fixing doc/source/rllib/images/catalog/catalog_and_rlm_diagram.svg Fixing doc/source/rllib/images/sigils/single-agent.svg Fixing doc/source/rllib/package_ref/utils.rst Fixing doc/source/rllib/images/trainer_class_overview.svg Fixing doc/source/rllib/rllib-learner.rst check for added large files..............................................Passed check python ast.........................................................Passed check json...........................................(no files to check)Skipped check toml...........................................(no files to check)Skipped black....................................................................Passed flake8...................................................................Passed prettier.............................................(no files to check)Skipped mypy.................................................(no files to check)Skipped isort (python)...........................................................Passed rst directives end with two colons.......................................Passed rst inline code next to normal text..................................Failed - hook id: rst-inline-touching-normal - exit code: 1 doc/source/rllib/rllib-advanced-api.rst:268:An evaluation step runs - using its own EnvRunners - for evaluation_duration use logger.warning(......................................................Passed check for not-real mock methods..........................................Passed ShellCheck v0.9.0....................................(no files to check)Skipped clang-format.........................................(no files to check)Skipped Google Java Formatter................................(no files to check)Skipped Check for Ray docstyle violations........................................Passed Check for Ray import order violations....................................Passed ## Related issue number Part of https://github.com/ray-project/ray/issues/42587. ## Checks - [x] I've signed off every commit(by using the -s flag, i.e., git commit -s) in this PR. - [x] I've run scripts/format.sh to lint the changes in this PR. - [x] I've included any doc changes needed for https://docs.ray.io/en/master/. - [ ] I've added any new APIs to the API Reference. For example, if I added a method in Tune, I've added it in doc/source/tune/api/ under the corresponding .rst` file. - [x] I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/ - Testing Strategy - [x] Unit tests - [ ] Release tests - [ ] This PR is not tested :( Signed-off-by: pdmurray <peynmurray@gmail.com> | 1 年前 | |
[RLlib] [docs] CLI user guide. (#29661) | 3 年前 | |
[docs] new structure (#21776) This PR consolidates both #21667 and #21759 (look there for features), but improves on them in the following way: - [x] we reverted renaming of existing projects tune, rllib, train, cluster, serve, raysgd and data so that links won't break. I think my consolidation efforts with the ray- prefix were a little overeager in that regard. It's better like this. Only the creation of ray-core was a necessity, and some files moved into the rllib folder, so that should be relatively benign. - [x] Additionally, we added Algolia docsearch, screenshot below. This is _much_ better than our current search. Caveat: there's a sphinx dependency that needs to be replaced (sphinx-tabs) by another, newer one (sphinx-panels), as the former prevents loading of the algolia.js library. Will follow-up in the next PR (hoping this one doesn't get re-re-re-re-reverted). | 4 年前 | |
[Doc] Run pre-commit on rllib docs (#47005) ## Why are these changes needed? Currently we have no linting on any part of the docs code. This PR runs pre-commit on the rllib docs. This PR fixes the following issues: ` trim trailing whitespace.................................................Failed - hook id: trailing-whitespace - exit code: 1 - files were modified by this hook Fixing doc/source/rllib/rllib-rlmodule.rst Fixing doc/source/rllib/rllib-offline.rst Fixing doc/source/rllib/images/catalog/ppo_catalog_and_rlm_diagram.svg Fixing doc/source/rllib/key-concepts.rst Fixing doc/source/rllib/rllib-fault-tolerance.rst Fixing doc/source/rllib/images/connector-diagram.svg Fixing doc/source/rllib/images/catalog/catalog_rlmspecs_diagram.svg Fixing doc/source/rllib/images/catalog/catalog_and_rlm_diagram.svg Fixing doc/source/rllib/rllib-learner.rst fix end of files.........................................................Failed - hook id: end-of-file-fixer - exit code: 1 - files were modified by this hook Fixing doc/source/rllib/package_ref/policy.rst Fixing doc/source/rllib/images/episodes/sa_episode_getters.svg Fixing doc/source/rllib/images/algos/sac-architecture.svg Fixing doc/source/rllib/package_ref/evaluation.rst Fixing doc/source/rllib/images/multi-flat.svg Fixing doc/source/rllib/images/algos/marwil-architecture.svg Fixing doc/source/rllib/images/rllib-config.svg Fixing doc/source/rllib/images/sigils/cont-actions.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-vector-envs.svg Fixing doc/source/rllib/images/algos/ppo-architecture.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-tf-and-torch.svg Fixing doc/source/rllib/images/a2c-arch.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-distributed-learning.svg Fixing doc/source/rllib/images/episodes/sa_episode_non_finalized.svg Fixing doc/source/rllib/images/dqn-arch.svg Fixing doc/source/rllib/images/episodes/sa_episode_non_finalized_vs_finalized.svg Fixing doc/source/rllib/images/algos/appo-architecture.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-multi-agent.svg Fixing doc/source/rllib/images/sigils/multi-gpu.svg Fixing doc/source/rllib/images/episodes/usage_of_episodes.svg Fixing doc/source/rllib/images/rollout_worker_class_overview.svg Fixing doc/source/rllib/images/catalog/ppo_catalog_and_rlm_diagram.svg Fixing doc/source/rllib/images/sigils/new-api-stack.svg Fixing doc/source/rllib/images/sigils/old-api-stack.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-offline-rl.svg Fixing doc/source/rllib/key-concepts.rst Fixing doc/source/rllib/images/impala-arch.svg Fixing doc/source/rllib/images/algos/dqn-architecture.svg Fixing doc/source/rllib/images/episodes/sa_episode.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-external-simulators.svg Fixing doc/source/rllib/images/episodes/sa_episode_finalized.svg Fixing doc/source/rllib/images/rllib-envs.svg Fixing doc/source/rllib/images/dreamerv3/atari100k_1_vs_4gpus.svg Fixing doc/source/rllib/images/apex-arch.svg Fixing doc/source/rllib/images/rllib-index-header.svg Fixing doc/source/rllib/images/algos/icm-architecture.svg Fixing doc/source/rllib/images/sigils/multi-agent.svg Fixing doc/source/rllib/images/sigils/multi-node-multi-gpu.svg Fixing doc/source/rllib/images/env_classes_overview.svg Fixing doc/source/rllib/images/connector-diagram.svg Fixing doc/source/rllib/images/rllib-components.svg Fixing doc/source/rllib/images/algos/impala-architecture.svg Fixing doc/source/rllib/images/rllib-sample-collection.svg Fixing doc/source/rllib/images/policy_classes_overview.svg Fixing doc/source/rllib/images/dreamerv3/dmc_1_vs_4gpus.svg Fixing doc/source/rllib/images/algos/dreamerv3-architecture.svg Fixing doc/source/rllib/package_ref/replay-buffers.rst Fixing doc/source/rllib/images/catalog/catalog_rlmspecs_diagram.svg Fixing doc/source/rllib/images/dreamerv3/pong_1_2_and_4gpus.svg Fixing doc/source/rllib/images/ddppo-arch.svg Fixing doc/source/rllib/images/multi-agent.svg Fixing doc/source/rllib/images/rllib-logo.svg Fixing doc/source/rllib/images/algos/curiosity-architecture.svg Fixing doc/source/rllib/images/episodes/sa_episode_cut_and_lookback.svg Fixing doc/source/rllib/images/rllib-trajectory-view-example.svg Fixing doc/source/rllib/images/rllib-api.svg Fixing doc/source/rllib/images/rllib-stack.svg Fixing doc/source/rllib/images/sigils/discr-actions.svg Fixing doc/source/rllib/images/algos/bc-architecture.svg Fixing doc/source/rllib/images/rllib-batch-modes.svg Fixing doc/source/rllib/images/rllib-external.svg Fixing doc/source/rllib/images/catalog/catalog_and_rlm_diagram.svg Fixing doc/source/rllib/images/sigils/single-agent.svg Fixing doc/source/rllib/package_ref/utils.rst Fixing doc/source/rllib/images/trainer_class_overview.svg Fixing doc/source/rllib/rllib-learner.rst check for added large files..............................................Passed check python ast.........................................................Passed check json...........................................(no files to check)Skipped check toml...........................................(no files to check)Skipped black....................................................................Passed flake8...................................................................Passed prettier.............................................(no files to check)Skipped mypy.................................................(no files to check)Skipped isort (python)...........................................................Passed rst directives end with two colons.......................................Passed rst inline code next to normal text..................................Failed - hook id: rst-inline-touching-normal - exit code: 1 doc/source/rllib/rllib-advanced-api.rst:268:An evaluation step runs - using its own EnvRunners - for evaluation_duration use logger.warning(......................................................Passed check for not-real mock methods..........................................Passed ShellCheck v0.9.0....................................(no files to check)Skipped clang-format.........................................(no files to check)Skipped Google Java Formatter................................(no files to check)Skipped Check for Ray docstyle violations........................................Passed Check for Ray import order violations....................................Passed ## Related issue number Part of https://github.com/ray-project/ray/issues/42587. ## Checks - [x] I've signed off every commit(by using the -s flag, i.e., git commit -s) in this PR. - [x] I've run scripts/format.sh to lint the changes in this PR. - [x] I've included any doc changes needed for https://docs.ray.io/en/master/. - [ ] I've added any new APIs to the API Reference. For example, if I added a method in Tune, I've added it in doc/source/tune/api/ under the corresponding .rst` file. - [x] I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/ - Testing Strategy - [x] Unit tests - [ ] Release tests - [ ] This PR is not tested :( Signed-off-by: pdmurray <peynmurray@gmail.com> | 1 年前 | |
[docs] new structure (#21776) This PR consolidates both #21667 and #21759 (look there for features), but improves on them in the following way: - [x] we reverted renaming of existing projects tune, rllib, train, cluster, serve, raysgd and data so that links won't break. I think my consolidation efforts with the ray- prefix were a little overeager in that regard. It's better like this. Only the creation of ray-core was a necessity, and some files moved into the rllib folder, so that should be relatively benign. - [x] Additionally, we added Algolia docsearch, screenshot below. This is _much_ better than our current search. Caveat: there's a sphinx dependency that needs to be replaced (sphinx-tabs) by another, newer one (sphinx-panels), as the former prevents loading of the algolia.js library. Will follow-up in the next PR (hoping this one doesn't get re-re-re-re-reverted). | 4 年前 | |
[Doc] Run pre-commit on rllib docs (#47005) ## Why are these changes needed? Currently we have no linting on any part of the docs code. This PR runs pre-commit on the rllib docs. This PR fixes the following issues: ` trim trailing whitespace.................................................Failed - hook id: trailing-whitespace - exit code: 1 - files were modified by this hook Fixing doc/source/rllib/rllib-rlmodule.rst Fixing doc/source/rllib/rllib-offline.rst Fixing doc/source/rllib/images/catalog/ppo_catalog_and_rlm_diagram.svg Fixing doc/source/rllib/key-concepts.rst Fixing doc/source/rllib/rllib-fault-tolerance.rst Fixing doc/source/rllib/images/connector-diagram.svg Fixing doc/source/rllib/images/catalog/catalog_rlmspecs_diagram.svg Fixing doc/source/rllib/images/catalog/catalog_and_rlm_diagram.svg Fixing doc/source/rllib/rllib-learner.rst fix end of files.........................................................Failed - hook id: end-of-file-fixer - exit code: 1 - files were modified by this hook Fixing doc/source/rllib/package_ref/policy.rst Fixing doc/source/rllib/images/episodes/sa_episode_getters.svg Fixing doc/source/rllib/images/algos/sac-architecture.svg Fixing doc/source/rllib/package_ref/evaluation.rst Fixing doc/source/rllib/images/multi-flat.svg Fixing doc/source/rllib/images/algos/marwil-architecture.svg Fixing doc/source/rllib/images/rllib-config.svg Fixing doc/source/rllib/images/sigils/cont-actions.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-vector-envs.svg Fixing doc/source/rllib/images/algos/ppo-architecture.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-tf-and-torch.svg Fixing doc/source/rllib/images/a2c-arch.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-distributed-learning.svg Fixing doc/source/rllib/images/episodes/sa_episode_non_finalized.svg Fixing doc/source/rllib/images/dqn-arch.svg Fixing doc/source/rllib/images/episodes/sa_episode_non_finalized_vs_finalized.svg Fixing doc/source/rllib/images/algos/appo-architecture.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-multi-agent.svg Fixing doc/source/rllib/images/sigils/multi-gpu.svg Fixing doc/source/rllib/images/episodes/usage_of_episodes.svg Fixing doc/source/rllib/images/rollout_worker_class_overview.svg Fixing doc/source/rllib/images/catalog/ppo_catalog_and_rlm_diagram.svg Fixing doc/source/rllib/images/sigils/new-api-stack.svg Fixing doc/source/rllib/images/sigils/old-api-stack.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-offline-rl.svg Fixing doc/source/rllib/key-concepts.rst Fixing doc/source/rllib/images/impala-arch.svg Fixing doc/source/rllib/images/algos/dqn-architecture.svg Fixing doc/source/rllib/images/episodes/sa_episode.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-external-simulators.svg Fixing doc/source/rllib/images/episodes/sa_episode_finalized.svg Fixing doc/source/rllib/images/rllib-envs.svg Fixing doc/source/rllib/images/dreamerv3/atari100k_1_vs_4gpus.svg Fixing doc/source/rllib/images/apex-arch.svg Fixing doc/source/rllib/images/rllib-index-header.svg Fixing doc/source/rllib/images/algos/icm-architecture.svg Fixing doc/source/rllib/images/sigils/multi-agent.svg Fixing doc/source/rllib/images/sigils/multi-node-multi-gpu.svg Fixing doc/source/rllib/images/env_classes_overview.svg Fixing doc/source/rllib/images/connector-diagram.svg Fixing doc/source/rllib/images/rllib-components.svg Fixing doc/source/rllib/images/algos/impala-architecture.svg Fixing doc/source/rllib/images/rllib-sample-collection.svg Fixing doc/source/rllib/images/policy_classes_overview.svg Fixing doc/source/rllib/images/dreamerv3/dmc_1_vs_4gpus.svg Fixing doc/source/rllib/images/algos/dreamerv3-architecture.svg Fixing doc/source/rllib/package_ref/replay-buffers.rst Fixing doc/source/rllib/images/catalog/catalog_rlmspecs_diagram.svg Fixing doc/source/rllib/images/dreamerv3/pong_1_2_and_4gpus.svg Fixing doc/source/rllib/images/ddppo-arch.svg Fixing doc/source/rllib/images/multi-agent.svg Fixing doc/source/rllib/images/rllib-logo.svg Fixing doc/source/rllib/images/algos/curiosity-architecture.svg Fixing doc/source/rllib/images/episodes/sa_episode_cut_and_lookback.svg Fixing doc/source/rllib/images/rllib-trajectory-view-example.svg Fixing doc/source/rllib/images/rllib-api.svg Fixing doc/source/rllib/images/rllib-stack.svg Fixing doc/source/rllib/images/sigils/discr-actions.svg Fixing doc/source/rllib/images/algos/bc-architecture.svg Fixing doc/source/rllib/images/rllib-batch-modes.svg Fixing doc/source/rllib/images/rllib-external.svg Fixing doc/source/rllib/images/catalog/catalog_and_rlm_diagram.svg Fixing doc/source/rllib/images/sigils/single-agent.svg Fixing doc/source/rllib/package_ref/utils.rst Fixing doc/source/rllib/images/trainer_class_overview.svg Fixing doc/source/rllib/rllib-learner.rst check for added large files..............................................Passed check python ast.........................................................Passed check json...........................................(no files to check)Skipped check toml...........................................(no files to check)Skipped black....................................................................Passed flake8...................................................................Passed prettier.............................................(no files to check)Skipped mypy.................................................(no files to check)Skipped isort (python)...........................................................Passed rst directives end with two colons.......................................Passed rst inline code next to normal text..................................Failed - hook id: rst-inline-touching-normal - exit code: 1 doc/source/rllib/rllib-advanced-api.rst:268:An evaluation step runs - using its own EnvRunners - for evaluation_duration use logger.warning(......................................................Passed check for not-real mock methods..........................................Passed ShellCheck v0.9.0....................................(no files to check)Skipped clang-format.........................................(no files to check)Skipped Google Java Formatter................................(no files to check)Skipped Check for Ray docstyle violations........................................Passed Check for Ray import order violations....................................Passed ## Related issue number Part of https://github.com/ray-project/ray/issues/42587. ## Checks - [x] I've signed off every commit(by using the -s flag, i.e., git commit -s) in this PR. - [x] I've run scripts/format.sh to lint the changes in this PR. - [x] I've included any doc changes needed for https://docs.ray.io/en/master/. - [ ] I've added any new APIs to the API Reference. For example, if I added a method in Tune, I've added it in doc/source/tune/api/ under the corresponding .rst` file. - [x] I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/ - Testing Strategy - [x] Unit tests - [ ] Release tests - [ ] This PR is not tested :( Signed-off-by: pdmurray <peynmurray@gmail.com> | 1 年前 | |
[RLlib; docs] RLlib documentation do-over (new API stack): Main index page. (#48285) | 1 年前 | |
Fix lint (#49546) Signed-off-by: dentiny <dentinyhao@gmail.com> | 1 年前 | |
[RLlib]: Add Off-Policy Estimation docs (#26809) Co-authored-by: Kourosh Hakhamaneshi <kourosh@anyscale.com> | 4 年前 | |
[Doc] Run pre-commit on rllib docs (#47005) ## Why are these changes needed? Currently we have no linting on any part of the docs code. This PR runs pre-commit on the rllib docs. This PR fixes the following issues: ` trim trailing whitespace.................................................Failed - hook id: trailing-whitespace - exit code: 1 - files were modified by this hook Fixing doc/source/rllib/rllib-rlmodule.rst Fixing doc/source/rllib/rllib-offline.rst Fixing doc/source/rllib/images/catalog/ppo_catalog_and_rlm_diagram.svg Fixing doc/source/rllib/key-concepts.rst Fixing doc/source/rllib/rllib-fault-tolerance.rst Fixing doc/source/rllib/images/connector-diagram.svg Fixing doc/source/rllib/images/catalog/catalog_rlmspecs_diagram.svg Fixing doc/source/rllib/images/catalog/catalog_and_rlm_diagram.svg Fixing doc/source/rllib/rllib-learner.rst fix end of files.........................................................Failed - hook id: end-of-file-fixer - exit code: 1 - files were modified by this hook Fixing doc/source/rllib/package_ref/policy.rst Fixing doc/source/rllib/images/episodes/sa_episode_getters.svg Fixing doc/source/rllib/images/algos/sac-architecture.svg Fixing doc/source/rllib/package_ref/evaluation.rst Fixing doc/source/rllib/images/multi-flat.svg Fixing doc/source/rllib/images/algos/marwil-architecture.svg Fixing doc/source/rllib/images/rllib-config.svg Fixing doc/source/rllib/images/sigils/cont-actions.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-vector-envs.svg Fixing doc/source/rllib/images/algos/ppo-architecture.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-tf-and-torch.svg Fixing doc/source/rllib/images/a2c-arch.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-distributed-learning.svg Fixing doc/source/rllib/images/episodes/sa_episode_non_finalized.svg Fixing doc/source/rllib/images/dqn-arch.svg Fixing doc/source/rllib/images/episodes/sa_episode_non_finalized_vs_finalized.svg Fixing doc/source/rllib/images/algos/appo-architecture.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-multi-agent.svg Fixing doc/source/rllib/images/sigils/multi-gpu.svg Fixing doc/source/rllib/images/episodes/usage_of_episodes.svg Fixing doc/source/rllib/images/rollout_worker_class_overview.svg Fixing doc/source/rllib/images/catalog/ppo_catalog_and_rlm_diagram.svg Fixing doc/source/rllib/images/sigils/new-api-stack.svg Fixing doc/source/rllib/images/sigils/old-api-stack.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-offline-rl.svg Fixing doc/source/rllib/key-concepts.rst Fixing doc/source/rllib/images/impala-arch.svg Fixing doc/source/rllib/images/algos/dqn-architecture.svg Fixing doc/source/rllib/images/episodes/sa_episode.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-external-simulators.svg Fixing doc/source/rllib/images/episodes/sa_episode_finalized.svg Fixing doc/source/rllib/images/rllib-envs.svg Fixing doc/source/rllib/images/dreamerv3/atari100k_1_vs_4gpus.svg Fixing doc/source/rllib/images/apex-arch.svg Fixing doc/source/rllib/images/rllib-index-header.svg Fixing doc/source/rllib/images/algos/icm-architecture.svg Fixing doc/source/rllib/images/sigils/multi-agent.svg Fixing doc/source/rllib/images/sigils/multi-node-multi-gpu.svg Fixing doc/source/rllib/images/env_classes_overview.svg Fixing doc/source/rllib/images/connector-diagram.svg Fixing doc/source/rllib/images/rllib-components.svg Fixing doc/source/rllib/images/algos/impala-architecture.svg Fixing doc/source/rllib/images/rllib-sample-collection.svg Fixing doc/source/rllib/images/policy_classes_overview.svg Fixing doc/source/rllib/images/dreamerv3/dmc_1_vs_4gpus.svg Fixing doc/source/rllib/images/algos/dreamerv3-architecture.svg Fixing doc/source/rllib/package_ref/replay-buffers.rst Fixing doc/source/rllib/images/catalog/catalog_rlmspecs_diagram.svg Fixing doc/source/rllib/images/dreamerv3/pong_1_2_and_4gpus.svg Fixing doc/source/rllib/images/ddppo-arch.svg Fixing doc/source/rllib/images/multi-agent.svg Fixing doc/source/rllib/images/rllib-logo.svg Fixing doc/source/rllib/images/algos/curiosity-architecture.svg Fixing doc/source/rllib/images/episodes/sa_episode_cut_and_lookback.svg Fixing doc/source/rllib/images/rllib-trajectory-view-example.svg Fixing doc/source/rllib/images/rllib-api.svg Fixing doc/source/rllib/images/rllib-stack.svg Fixing doc/source/rllib/images/sigils/discr-actions.svg Fixing doc/source/rllib/images/algos/bc-architecture.svg Fixing doc/source/rllib/images/rllib-batch-modes.svg Fixing doc/source/rllib/images/rllib-external.svg Fixing doc/source/rllib/images/catalog/catalog_and_rlm_diagram.svg Fixing doc/source/rllib/images/sigils/single-agent.svg Fixing doc/source/rllib/package_ref/utils.rst Fixing doc/source/rllib/images/trainer_class_overview.svg Fixing doc/source/rllib/rllib-learner.rst check for added large files..............................................Passed check python ast.........................................................Passed check json...........................................(no files to check)Skipped check toml...........................................(no files to check)Skipped black....................................................................Passed flake8...................................................................Passed prettier.............................................(no files to check)Skipped mypy.................................................(no files to check)Skipped isort (python)...........................................................Passed rst directives end with two colons.......................................Passed rst inline code next to normal text..................................Failed - hook id: rst-inline-touching-normal - exit code: 1 doc/source/rllib/rllib-advanced-api.rst:268:An evaluation step runs - using its own EnvRunners - for evaluation_duration use logger.warning(......................................................Passed check for not-real mock methods..........................................Passed ShellCheck v0.9.0....................................(no files to check)Skipped clang-format.........................................(no files to check)Skipped Google Java Formatter................................(no files to check)Skipped Check for Ray docstyle violations........................................Passed Check for Ray import order violations....................................Passed ## Related issue number Part of https://github.com/ray-project/ray/issues/42587. ## Checks - [x] I've signed off every commit(by using the -s flag, i.e., git commit -s) in this PR. - [x] I've run scripts/format.sh to lint the changes in this PR. - [x] I've included any doc changes needed for https://docs.ray.io/en/master/. - [ ] I've added any new APIs to the API Reference. For example, if I added a method in Tune, I've added it in doc/source/tune/api/ under the corresponding .rst` file. - [x] I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/ - Testing Strategy - [x] Unit tests - [ ] Release tests - [ ] This PR is not tested :( Signed-off-by: pdmurray <peynmurray@gmail.com> | 1 年前 | |
[docs] new structure (#21776) This PR consolidates both #21667 and #21759 (look there for features), but improves on them in the following way: - [x] we reverted renaming of existing projects tune, rllib, train, cluster, serve, raysgd and data so that links won't break. I think my consolidation efforts with the ray- prefix were a little overeager in that regard. It's better like this. Only the creation of ray-core was a necessity, and some files moved into the rllib folder, so that should be relatively benign. - [x] Additionally, we added Algolia docsearch, screenshot below. This is _much_ better than our current search. Caveat: there's a sphinx dependency that needs to be replaced (sphinx-tabs) by another, newer one (sphinx-panels), as the former prevents loading of the algolia.js library. Will follow-up in the next PR (hoping this one doesn't get re-re-re-re-reverted). | 4 年前 | |
[Doc] Run pre-commit on rllib docs (#47005) ## Why are these changes needed? Currently we have no linting on any part of the docs code. This PR runs pre-commit on the rllib docs. This PR fixes the following issues: ` trim trailing whitespace.................................................Failed - hook id: trailing-whitespace - exit code: 1 - files were modified by this hook Fixing doc/source/rllib/rllib-rlmodule.rst Fixing doc/source/rllib/rllib-offline.rst Fixing doc/source/rllib/images/catalog/ppo_catalog_and_rlm_diagram.svg Fixing doc/source/rllib/key-concepts.rst Fixing doc/source/rllib/rllib-fault-tolerance.rst Fixing doc/source/rllib/images/connector-diagram.svg Fixing doc/source/rllib/images/catalog/catalog_rlmspecs_diagram.svg Fixing doc/source/rllib/images/catalog/catalog_and_rlm_diagram.svg Fixing doc/source/rllib/rllib-learner.rst fix end of files.........................................................Failed - hook id: end-of-file-fixer - exit code: 1 - files were modified by this hook Fixing doc/source/rllib/package_ref/policy.rst Fixing doc/source/rllib/images/episodes/sa_episode_getters.svg Fixing doc/source/rllib/images/algos/sac-architecture.svg Fixing doc/source/rllib/package_ref/evaluation.rst Fixing doc/source/rllib/images/multi-flat.svg Fixing doc/source/rllib/images/algos/marwil-architecture.svg Fixing doc/source/rllib/images/rllib-config.svg Fixing doc/source/rllib/images/sigils/cont-actions.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-vector-envs.svg Fixing doc/source/rllib/images/algos/ppo-architecture.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-tf-and-torch.svg Fixing doc/source/rllib/images/a2c-arch.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-distributed-learning.svg Fixing doc/source/rllib/images/episodes/sa_episode_non_finalized.svg Fixing doc/source/rllib/images/dqn-arch.svg Fixing doc/source/rllib/images/episodes/sa_episode_non_finalized_vs_finalized.svg Fixing doc/source/rllib/images/algos/appo-architecture.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-multi-agent.svg Fixing doc/source/rllib/images/sigils/multi-gpu.svg Fixing doc/source/rllib/images/episodes/usage_of_episodes.svg Fixing doc/source/rllib/images/rollout_worker_class_overview.svg Fixing doc/source/rllib/images/catalog/ppo_catalog_and_rlm_diagram.svg Fixing doc/source/rllib/images/sigils/new-api-stack.svg Fixing doc/source/rllib/images/sigils/old-api-stack.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-offline-rl.svg Fixing doc/source/rllib/key-concepts.rst Fixing doc/source/rllib/images/impala-arch.svg Fixing doc/source/rllib/images/algos/dqn-architecture.svg Fixing doc/source/rllib/images/episodes/sa_episode.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-external-simulators.svg Fixing doc/source/rllib/images/episodes/sa_episode_finalized.svg Fixing doc/source/rllib/images/rllib-envs.svg Fixing doc/source/rllib/images/dreamerv3/atari100k_1_vs_4gpus.svg Fixing doc/source/rllib/images/apex-arch.svg Fixing doc/source/rllib/images/rllib-index-header.svg Fixing doc/source/rllib/images/algos/icm-architecture.svg Fixing doc/source/rllib/images/sigils/multi-agent.svg Fixing doc/source/rllib/images/sigils/multi-node-multi-gpu.svg Fixing doc/source/rllib/images/env_classes_overview.svg Fixing doc/source/rllib/images/connector-diagram.svg Fixing doc/source/rllib/images/rllib-components.svg Fixing doc/source/rllib/images/algos/impala-architecture.svg Fixing doc/source/rllib/images/rllib-sample-collection.svg Fixing doc/source/rllib/images/policy_classes_overview.svg Fixing doc/source/rllib/images/dreamerv3/dmc_1_vs_4gpus.svg Fixing doc/source/rllib/images/algos/dreamerv3-architecture.svg Fixing doc/source/rllib/package_ref/replay-buffers.rst Fixing doc/source/rllib/images/catalog/catalog_rlmspecs_diagram.svg Fixing doc/source/rllib/images/dreamerv3/pong_1_2_and_4gpus.svg Fixing doc/source/rllib/images/ddppo-arch.svg Fixing doc/source/rllib/images/multi-agent.svg Fixing doc/source/rllib/images/rllib-logo.svg Fixing doc/source/rllib/images/algos/curiosity-architecture.svg Fixing doc/source/rllib/images/episodes/sa_episode_cut_and_lookback.svg Fixing doc/source/rllib/images/rllib-trajectory-view-example.svg Fixing doc/source/rllib/images/rllib-api.svg Fixing doc/source/rllib/images/rllib-stack.svg Fixing doc/source/rllib/images/sigils/discr-actions.svg Fixing doc/source/rllib/images/algos/bc-architecture.svg Fixing doc/source/rllib/images/rllib-batch-modes.svg Fixing doc/source/rllib/images/rllib-external.svg Fixing doc/source/rllib/images/catalog/catalog_and_rlm_diagram.svg Fixing doc/source/rllib/images/sigils/single-agent.svg Fixing doc/source/rllib/package_ref/utils.rst Fixing doc/source/rllib/images/trainer_class_overview.svg Fixing doc/source/rllib/rllib-learner.rst check for added large files..............................................Passed check python ast.........................................................Passed check json...........................................(no files to check)Skipped check toml...........................................(no files to check)Skipped black....................................................................Passed flake8...................................................................Passed prettier.............................................(no files to check)Skipped mypy.................................................(no files to check)Skipped isort (python)...........................................................Passed rst directives end with two colons.......................................Passed rst inline code next to normal text..................................Failed - hook id: rst-inline-touching-normal - exit code: 1 doc/source/rllib/rllib-advanced-api.rst:268:An evaluation step runs - using its own EnvRunners - for evaluation_duration use logger.warning(......................................................Passed check for not-real mock methods..........................................Passed ShellCheck v0.9.0....................................(no files to check)Skipped clang-format.........................................(no files to check)Skipped Google Java Formatter................................(no files to check)Skipped Check for Ray docstyle violations........................................Passed Check for Ray import order violations....................................Passed ## Related issue number Part of https://github.com/ray-project/ray/issues/42587. ## Checks - [x] I've signed off every commit(by using the -s flag, i.e., git commit -s) in this PR. - [x] I've run scripts/format.sh to lint the changes in this PR. - [x] I've included any doc changes needed for https://docs.ray.io/en/master/. - [ ] I've added any new APIs to the API Reference. For example, if I added a method in Tune, I've added it in doc/source/tune/api/ under the corresponding .rst` file. - [x] I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/ - Testing Strategy - [x] Unit tests - [ ] Release tests - [ ] This PR is not tested :( Signed-off-by: pdmurray <peynmurray@gmail.com> | 1 年前 | |
Fix lint (#49546) Signed-off-by: dentiny <dentinyhao@gmail.com> | 1 年前 | |
[docs] new structure (#21776) This PR consolidates both #21667 and #21759 (look there for features), but improves on them in the following way: - [x] we reverted renaming of existing projects tune, rllib, train, cluster, serve, raysgd and data so that links won't break. I think my consolidation efforts with the ray- prefix were a little overeager in that regard. It's better like this. Only the creation of ray-core was a necessity, and some files moved into the rllib folder, so that should be relatively benign. - [x] Additionally, we added Algolia docsearch, screenshot below. This is _much_ better than our current search. Caveat: there's a sphinx dependency that needs to be replaced (sphinx-tabs) by another, newer one (sphinx-panels), as the former prevents loading of the algolia.js library. Will follow-up in the next PR (hoping this one doesn't get re-re-re-re-reverted). | 4 年前 | |
Fix lint (#49597) Signed-off-by: dentiny <dentinyhao@gmail.com> | 1 年前 | |
[docs] new structure (#21776) This PR consolidates both #21667 and #21759 (look there for features), but improves on them in the following way: - [x] we reverted renaming of existing projects tune, rllib, train, cluster, serve, raysgd and data so that links won't break. I think my consolidation efforts with the ray- prefix were a little overeager in that regard. It's better like this. Only the creation of ray-core was a necessity, and some files moved into the rllib folder, so that should be relatively benign. - [x] Additionally, we added Algolia docsearch, screenshot below. This is _much_ better than our current search. Caveat: there's a sphinx dependency that needs to be replaced (sphinx-tabs) by another, newer one (sphinx-panels), as the former prevents loading of the algolia.js library. Will follow-up in the next PR (hoping this one doesn't get re-re-re-re-reverted). | 4 年前 | |
[docs] new structure (#21776) This PR consolidates both #21667 and #21759 (look there for features), but improves on them in the following way: - [x] we reverted renaming of existing projects tune, rllib, train, cluster, serve, raysgd and data so that links won't break. I think my consolidation efforts with the ray- prefix were a little overeager in that regard. It's better like this. Only the creation of ray-core was a necessity, and some files moved into the rllib folder, so that should be relatively benign. - [x] Additionally, we added Algolia docsearch, screenshot below. This is _much_ better than our current search. Caveat: there's a sphinx dependency that needs to be replaced (sphinx-tabs) by another, newer one (sphinx-panels), as the former prevents loading of the algolia.js library. Will follow-up in the next PR (hoping this one doesn't get re-re-re-re-reverted). | 4 年前 | |
[docs] new structure (#21776) This PR consolidates both #21667 and #21759 (look there for features), but improves on them in the following way: - [x] we reverted renaming of existing projects tune, rllib, train, cluster, serve, raysgd and data so that links won't break. I think my consolidation efforts with the ray- prefix were a little overeager in that regard. It's better like this. Only the creation of ray-core was a necessity, and some files moved into the rllib folder, so that should be relatively benign. - [x] Additionally, we added Algolia docsearch, screenshot below. This is _much_ better than our current search. Caveat: there's a sphinx dependency that needs to be replaced (sphinx-tabs) by another, newer one (sphinx-panels), as the former prevents loading of the algolia.js library. Will follow-up in the next PR (hoping this one doesn't get re-re-re-re-reverted). | 4 年前 | |
[Doc] Run pre-commit on rllib docs (#47005) ## Why are these changes needed? Currently we have no linting on any part of the docs code. This PR runs pre-commit on the rllib docs. This PR fixes the following issues: ` trim trailing whitespace.................................................Failed - hook id: trailing-whitespace - exit code: 1 - files were modified by this hook Fixing doc/source/rllib/rllib-rlmodule.rst Fixing doc/source/rllib/rllib-offline.rst Fixing doc/source/rllib/images/catalog/ppo_catalog_and_rlm_diagram.svg Fixing doc/source/rllib/key-concepts.rst Fixing doc/source/rllib/rllib-fault-tolerance.rst Fixing doc/source/rllib/images/connector-diagram.svg Fixing doc/source/rllib/images/catalog/catalog_rlmspecs_diagram.svg Fixing doc/source/rllib/images/catalog/catalog_and_rlm_diagram.svg Fixing doc/source/rllib/rllib-learner.rst fix end of files.........................................................Failed - hook id: end-of-file-fixer - exit code: 1 - files were modified by this hook Fixing doc/source/rllib/package_ref/policy.rst Fixing doc/source/rllib/images/episodes/sa_episode_getters.svg Fixing doc/source/rllib/images/algos/sac-architecture.svg Fixing doc/source/rllib/package_ref/evaluation.rst Fixing doc/source/rllib/images/multi-flat.svg Fixing doc/source/rllib/images/algos/marwil-architecture.svg Fixing doc/source/rllib/images/rllib-config.svg Fixing doc/source/rllib/images/sigils/cont-actions.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-vector-envs.svg Fixing doc/source/rllib/images/algos/ppo-architecture.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-tf-and-torch.svg Fixing doc/source/rllib/images/a2c-arch.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-distributed-learning.svg Fixing doc/source/rllib/images/episodes/sa_episode_non_finalized.svg Fixing doc/source/rllib/images/dqn-arch.svg Fixing doc/source/rllib/images/episodes/sa_episode_non_finalized_vs_finalized.svg Fixing doc/source/rllib/images/algos/appo-architecture.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-multi-agent.svg Fixing doc/source/rllib/images/sigils/multi-gpu.svg Fixing doc/source/rllib/images/episodes/usage_of_episodes.svg Fixing doc/source/rllib/images/rollout_worker_class_overview.svg Fixing doc/source/rllib/images/catalog/ppo_catalog_and_rlm_diagram.svg Fixing doc/source/rllib/images/sigils/new-api-stack.svg Fixing doc/source/rllib/images/sigils/old-api-stack.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-offline-rl.svg Fixing doc/source/rllib/key-concepts.rst Fixing doc/source/rllib/images/impala-arch.svg Fixing doc/source/rllib/images/algos/dqn-architecture.svg Fixing doc/source/rllib/images/episodes/sa_episode.svg Fixing doc/source/rllib/images/sigils/rllib-sigil-external-simulators.svg Fixing doc/source/rllib/images/episodes/sa_episode_finalized.svg Fixing doc/source/rllib/images/rllib-envs.svg Fixing doc/source/rllib/images/dreamerv3/atari100k_1_vs_4gpus.svg Fixing doc/source/rllib/images/apex-arch.svg Fixing doc/source/rllib/images/rllib-index-header.svg Fixing doc/source/rllib/images/algos/icm-architecture.svg Fixing doc/source/rllib/images/sigils/multi-agent.svg Fixing doc/source/rllib/images/sigils/multi-node-multi-gpu.svg Fixing doc/source/rllib/images/env_classes_overview.svg Fixing doc/source/rllib/images/connector-diagram.svg Fixing doc/source/rllib/images/rllib-components.svg Fixing doc/source/rllib/images/algos/impala-architecture.svg Fixing doc/source/rllib/images/rllib-sample-collection.svg Fixing doc/source/rllib/images/policy_classes_overview.svg Fixing doc/source/rllib/images/dreamerv3/dmc_1_vs_4gpus.svg Fixing doc/source/rllib/images/algos/dreamerv3-architecture.svg Fixing doc/source/rllib/package_ref/replay-buffers.rst Fixing doc/source/rllib/images/catalog/catalog_rlmspecs_diagram.svg Fixing doc/source/rllib/images/dreamerv3/pong_1_2_and_4gpus.svg Fixing doc/source/rllib/images/ddppo-arch.svg Fixing doc/source/rllib/images/multi-agent.svg Fixing doc/source/rllib/images/rllib-logo.svg Fixing doc/source/rllib/images/algos/curiosity-architecture.svg Fixing doc/source/rllib/images/episodes/sa_episode_cut_and_lookback.svg Fixing doc/source/rllib/images/rllib-trajectory-view-example.svg Fixing doc/source/rllib/images/rllib-api.svg Fixing doc/source/rllib/images/rllib-stack.svg Fixing doc/source/rllib/images/sigils/discr-actions.svg Fixing doc/source/rllib/images/algos/bc-architecture.svg Fixing doc/source/rllib/images/rllib-batch-modes.svg Fixing doc/source/rllib/images/rllib-external.svg Fixing doc/source/rllib/images/catalog/catalog_and_rlm_diagram.svg Fixing doc/source/rllib/images/sigils/single-agent.svg Fixing doc/source/rllib/package_ref/utils.rst Fixing doc/source/rllib/images/trainer_class_overview.svg Fixing doc/source/rllib/rllib-learner.rst check for added large files..............................................Passed check python ast.........................................................Passed check json...........................................(no files to check)Skipped check toml...........................................(no files to check)Skipped black....................................................................Passed flake8...................................................................Passed prettier.............................................(no files to check)Skipped mypy.................................................(no files to check)Skipped isort (python)...........................................................Passed rst directives end with two colons.......................................Passed rst inline code next to normal text..................................Failed - hook id: rst-inline-touching-normal - exit code: 1 doc/source/rllib/rllib-advanced-api.rst:268:An evaluation step runs - using its own EnvRunners - for evaluation_duration use logger.warning(......................................................Passed check for not-real mock methods..........................................Passed ShellCheck v0.9.0....................................(no files to check)Skipped clang-format.........................................(no files to check)Skipped Google Java Formatter................................(no files to check)Skipped Check for Ray docstyle violations........................................Passed Check for Ray import order violations....................................Passed ## Related issue number Part of https://github.com/ray-project/ray/issues/42587. ## Checks - [x] I've signed off every commit(by using the -s flag, i.e., git commit -s) in this PR. - [x] I've run scripts/format.sh to lint the changes in this PR. - [x] I've included any doc changes needed for https://docs.ray.io/en/master/. - [ ] I've added any new APIs to the API Reference. For example, if I added a method in Tune, I've added it in doc/source/tune/api/ under the corresponding .rst` file. - [x] I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/ - Testing Strategy - [x] Unit tests - [ ] Release tests - [ ] This PR is not tested :( Signed-off-by: pdmurray <peynmurray@gmail.com> | 1 年前 |
| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 4 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 4 年前 | ||
| 1 年前 | ||
| 4 年前 | ||
| 1 年前 | ||
| 4 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 4 年前 | ||
| 4 年前 | ||
| 1 年前 | ||
| 3 年前 | ||
| 4 年前 | ||
| 1 年前 | ||
| 4 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 4 年前 | ||
| 1 年前 | ||
| 4 年前 | ||
| 1 年前 | ||
| 1 年前 | ||
| 4 年前 | ||
| 1 年前 | ||
| 4 年前 | ||
| 4 年前 | ||
| 4 年前 | ||
| 1 年前 |
