Find and Run Venn-Abers Example Scripts

Annotated example collections cover manual calibration with its fit diagnoses and assessment graphics, training and frozen workflows, learned postprocessing, and Grid/Bayes selection. Each collection has a contents list with a separate entry for every example script.

Details

Open the collections with vignette() or list all guides and examples with browseVignettes("vennabers"). Vignettes are available after installing a built source package. The original scripts are installed under system.file("examples", package = "vennabers") even when installing directly from a checkout without building vignettes.

The articles display the complete scripts without running their fits during documentation builds. Use file.show() to read an installed script and source() to run it, including its checks. Workflow, postprocessing and tuning scripts use optional packages named in their code and DESCRIPTION; install them explicitly before running those examples. Resampling, tuning and composition matrices can take longer than the introductory guides.

manual calibration

vignette("examples-manual", package = "vennabers").

Scripts: binary-options.R, cross-venn-abers.R, inductive-ovo.R, inductive-ovr.R, cross-multiclass.R, one-hot-classes.R, inductive-regression.R, cross-regression.R, calibration-graphics.R.

training and frozen workflows

vignette("examples-workflows", package = "vennabers").

Scripts: calibrated-workflow.R, encoded-binary.R, encoded-multiclass-regression.R, reference-splits.R, inductive-sizes.R, model-adapter.R, engine-options.R, full-model-workflow.R, full-multiclass-workflow.R, full-regression-workflow.R, pairwise-inductive.R, pairwise-cross.R, frozen-binary.R, frozen-multiclass-regression.R, frozen-schema.R.

learned postprocessing

vignette("examples-postprocessing", package = "vennabers").

Scripts: sigmoid-holdout.R, tailor-holdout.R, tailor-multiclass-holdout.R, tailor-regression-holdout.R, isotonic-regression-holdout.R, binary-ensemble.R, multiclass-ensemble.R, regression-ensemble.R, pairwise-postprocessing.R, full-postprocessing.R.

Grid and Bayes selection

vignette("examples-tuning", package = "vennabers").

Scripts: binary-grid.R, shared-multiclass-grid.R, shared-multiclass-bayes.R, pairwise-grid.R, pairwise-bayes.R, regression-grid.R, regression-bayes.R, postprocessing-grid.R, postprocessing-bayes.R.

See also

vennabers-package, venn_abers, calibrated_workflow, calibrate_workflow, workflow_postprocessing, venn_abers_tuning.

Examples

# Locate an installed script without running its fits:
script <- system.file("examples", "binary-options.R", package = "vennabers")
script
#> [1] "/tmp/RtmpBnTCfh/temp_libpath192478f23885/vennabers/examples/binary-options.R"
# file.show(script)
# source(script)