| Add initial tests suite (#27)
* add tests/ with initial metrics tests
* shell: add shell script to run all tests
* tests: add initial tests for data and metrics_accuracy
* Added unit tests for scoring rules. (#24)
* Tests for calibration functions (#25)
* added calibration tests, fixed some comments in scoring rule tests
* added all calibration and recalibration tests
* tests: update docstring in recalibration tests
* tests: add additional tests for metrics
* clean data functions, remove old function, update imports
* tests: add data test and fix imports
* tests: update test_metrics_accuracy to use deterministic data
* examples: update viz_minimal given updated data function
Co-authored-by: Ian Char <ianchar4@gmail.com>
Co-authored-by: Youngseog Chung <youngsec@cs.cmu.edu> | 5 年前 |
| Add initial tests suite (#27)
* add tests/ with initial metrics tests
* shell: add shell script to run all tests
* tests: add initial tests for data and metrics_accuracy
* Added unit tests for scoring rules. (#24)
* Tests for calibration functions (#25)
* added calibration tests, fixed some comments in scoring rule tests
* added all calibration and recalibration tests
* tests: update docstring in recalibration tests
* tests: add additional tests for metrics
* clean data functions, remove old function, update imports
* tests: add data test and fix imports
* tests: update test_metrics_accuracy to use deterministic data
* examples: update viz_minimal given updated data function
Co-authored-by: Ian Char <ianchar4@gmail.com>
Co-authored-by: Youngseog Chung <youngsec@cs.cmu.edu> | 5 年前 |
| Recal updates (#40)
* added std recalibrator
* added 3 recalibrators, added check positive util, fixed some typos
* added tests, updated esxamples
* updated based on comments on pull request
* tests: remove one extra comment in test_metrics_accuracy
Co-authored-by: willieneis <willie.neiswanger@gmail.com> | 4 年前 |
| Recal updates (#40)
* added std recalibrator
* added 3 recalibrators, added check positive util, fixed some typos
* added tests, updated esxamples
* updated based on comments on pull request
* tests: remove one extra comment in test_metrics_accuracy
Co-authored-by: willieneis <willie.neiswanger@gmail.com> | 4 年前 |
| Clean imports and dependencies, fix plotting function, update tests (#83)
* update version to 0.1.1rc1
* update requirements
* remove extra imports from metrics_calibration.py
* split up miscalibration_area function into two
* update docstring wording
* 1) Remove shapely package dependencies 2) Replace miscalibration area computation in plot_calibration function 3) Remove show argument from plot_calibration function 4) Append prop_type argument in plot_calibration function
* 1) Remove unnecessary arguments in plot_sharpness function 2) Make tests for filter_subset usages.
* bump version to 0.1.1rc2
* blackify code
* update recalibration tests for scipy update
* bump version to 0.1.1rc3
* remove setup.py, link pyproject.toml to requirements
* update README dev install command
* bump version to 0.1.1rc4
* add requirements back into pyproject.toml, remove requirements.txt
* remove requirements ref in requirements_dev
* update install details in README, docs
* Updated optimizer bounds and let user provide them. (#84)
Co-authored-by: Ian Char <ianchar4@gmail.com>
* update default optimizer_bounds for std_recalibrator
* format recalibration with black
* update test_recalibration to loosen checks
* bump version to 0.1.1rc5
* bump version to 0.1.1
* update pip details in README, docs/installation
Co-authored-by: Youngseog Chung <youngsec@cs.cmu.edu>
Co-authored-by: Ian Char <ianchar4@gmail.com> | 3 年前 |
| Add initial tests suite (#27)
* add tests/ with initial metrics tests
* shell: add shell script to run all tests
* tests: add initial tests for data and metrics_accuracy
* Added unit tests for scoring rules. (#24)
* Tests for calibration functions (#25)
* added calibration tests, fixed some comments in scoring rule tests
* added all calibration and recalibration tests
* tests: update docstring in recalibration tests
* tests: add additional tests for metrics
* clean data functions, remove old function, update imports
* tests: add data test and fix imports
* tests: update test_metrics_accuracy to use deterministic data
* examples: update viz_minimal given updated data function
Co-authored-by: Ian Char <ianchar4@gmail.com>
Co-authored-by: Youngseog Chung <youngsec@cs.cmu.edu> | 5 年前 |
| Clean imports and dependencies, fix plotting function, update tests (#83)
* update version to 0.1.1rc1
* update requirements
* remove extra imports from metrics_calibration.py
* split up miscalibration_area function into two
* update docstring wording
* 1) Remove shapely package dependencies 2) Replace miscalibration area computation in plot_calibration function 3) Remove show argument from plot_calibration function 4) Append prop_type argument in plot_calibration function
* 1) Remove unnecessary arguments in plot_sharpness function 2) Make tests for filter_subset usages.
* bump version to 0.1.1rc2
* blackify code
* update recalibration tests for scipy update
* bump version to 0.1.1rc3
* remove setup.py, link pyproject.toml to requirements
* update README dev install command
* bump version to 0.1.1rc4
* add requirements back into pyproject.toml, remove requirements.txt
* remove requirements ref in requirements_dev
* update install details in README, docs
* Updated optimizer bounds and let user provide them. (#84)
Co-authored-by: Ian Char <ianchar4@gmail.com>
* update default optimizer_bounds for std_recalibrator
* format recalibration with black
* update test_recalibration to loosen checks
* bump version to 0.1.1rc5
* bump version to 0.1.1
* update pip details in README, docs/installation
Co-authored-by: Youngseog Chung <youngsec@cs.cmu.edu>
Co-authored-by: Ian Char <ianchar4@gmail.com> | 3 年前 |
| Faster version of miscalibration_area (#68)
* Faster version of miscalibration_area
* update black format
* rename trapezium to trapezoid
* rename remaining trapezium to trapezoid
* Incorporated vectorize, recalibration, and prop_type options into new miscalibration area.
* 1) Write tests for trapezoid area. 2) Write tests for assert_is_positive util function. 3) Update reference calibration values in calibration tests. 4) Apply black formatting.
* Removed previous is_positive test, update trapezoid test, changed tolerance on recal.
* 1) Fix miscalibration_area for recalibration 2) Fix tests for recalibration and metrics_calibration.
* Delete old miscalibration_area code
* split test_trapezoid_area into smaller tests
* 1) Fix expected proportions calculation with num_bins. 2) Fix tests accordingly.
* Black formatting
* Fix import ordering.
* Updated output types in trapezoid and intersection functions.
Co-authored-by: Michael Dunne <mdunne@proterabio.com>
Co-authored-by: willieneis <willie.neiswanger@gmail.com>
Co-authored-by: Youngseog Chung <youngsec@cs.cmu.edu>
Co-authored-by: Ian Char <ianchar4@gmail.com> | 3 年前 |
| Clean imports and dependencies, fix plotting function, update tests (#83)
* update version to 0.1.1rc1
* update requirements
* remove extra imports from metrics_calibration.py
* split up miscalibration_area function into two
* update docstring wording
* 1) Remove shapely package dependencies 2) Replace miscalibration area computation in plot_calibration function 3) Remove show argument from plot_calibration function 4) Append prop_type argument in plot_calibration function
* 1) Remove unnecessary arguments in plot_sharpness function 2) Make tests for filter_subset usages.
* bump version to 0.1.1rc2
* blackify code
* update recalibration tests for scipy update
* bump version to 0.1.1rc3
* remove setup.py, link pyproject.toml to requirements
* update README dev install command
* bump version to 0.1.1rc4
* add requirements back into pyproject.toml, remove requirements.txt
* remove requirements ref in requirements_dev
* update install details in README, docs
* Updated optimizer bounds and let user provide them. (#84)
Co-authored-by: Ian Char <ianchar4@gmail.com>
* update default optimizer_bounds for std_recalibrator
* format recalibration with black
* update test_recalibration to loosen checks
* bump version to 0.1.1rc5
* bump version to 0.1.1
* update pip details in README, docs/installation
Co-authored-by: Youngseog Chung <youngsec@cs.cmu.edu>
Co-authored-by: Ian Char <ianchar4@gmail.com> | 3 年前 |