Package: yardstick 1.4.0.9000

Emil Hvitfeldt

yardstick: Tidy Characterizations of Model Performance

Tidy tools for quantifying how well model fits to a data set such as confusion matrices, class probability curve summaries, and regression metrics (e.g., RMSE).

Authors:Max Kuhn [aut], Davis Vaughan [aut], Emil Hvitfeldt [aut, cre], Posit Software, PBC [cph, fnd]

yardstick_1.4.0.9000.tar.gz
yardstick_1.4.0.9000.zip(r-4.7)yardstick_1.4.0.9000.zip(r-4.6)yardstick_1.4.0.9000.zip(r-4.5)
yardstick_1.4.0.9000.tgz(r-4.6-x86_64)yardstick_1.4.0.9000.tgz(r-4.6-arm64)yardstick_1.4.0.9000.tgz(r-4.5-x86_64)yardstick_1.4.0.9000.tgz(r-4.5-arm64)
yardstick_1.4.0.9000.tar.gz(r-4.7-arm64)yardstick_1.4.0.9000.tar.gz(r-4.7-x86_64)yardstick_1.4.0.9000.tar.gz(r-4.6-arm64)yardstick_1.4.0.9000.tar.gz(r-4.6-x86_64)
yardstick_1.4.0.9000.tgz(r-4.6-emscripten)
manual.pdf |manual.html✨
DESCRIPTION |NEWS
card.svg |card.png
yardstick/json (API)

# Install 'yardstick' in R:
install.packages('yardstick', repos = c('https://tidymodels.r-universe.dev', 'https://cloud.r-project.org'))

Bug tracker:https://github.com/tidymodels/yardstick/issues

Pkgdown/docs site:https://yardstick.tidymodels.org

Datasets:

On CRAN:

Conda:

15.87 score 403 stars 70 packages 3.7k scripts 43k downloads 161 exports 17 dependencies

Last updated from:fa91f90cdd. Checks:13 OK. Indexed: yes.

TargetResultTimeFilesSyslog
linux-devel-arm64OK215
linux-devel-x86_64OK230
source / vignettesOK240
linux-release-arm64OK225
linux-release-x86_64OK216
macos-release-arm64OK142
macos-release-x86_64OK288
macos-oldrel-arm64OK150
macos-oldrel-x86_64OK319
windows-develOK189
windows-releaseOK183
windows-oldrelOK166
wasm-releaseOK169

Exports:accuracyaccuracy_vecaverage_precisionaverage_precision_vecbal_accuracybal_accuracy_vecbrier_classbrier_class_vecbrier_survivalbrier_survival_integratedbrier_survival_integrated_vecbrier_survival_veccccccc_veccheck_class_metriccheck_dynamic_survival_metriccheck_linear_pred_survival_metriccheck_numeric_metriccheck_ordered_prob_metriccheck_prob_metriccheck_quantile_metriccheck_static_survival_metricclass_metric_summarizerclassification_costclassification_cost_vecconcordance_survivalconcordance_survival_vecconf_matcurve_metric_summarizercurve_survival_metric_summarizerdemographic_paritydetection_prevalencedetection_prevalence_vecdots_to_estimatedynamic_survival_metric_summarizerequal_opportunityequalized_oddsf_measf_meas_vecfall_outfall_out_vecfinalize_estimatorfinalize_estimator_internalgain_capturegain_capture_vecgain_curveget_metricsget_weightsgini_coefgini_coef_vechuber_losshuber_loss_pseudohuber_loss_pseudo_vechuber_loss_veciiciic_vecj_indexj_index_veckapkap_veclift_curvelinear_pred_survival_metric_summarizermaemae_vecmapemape_vecmarkednessmarkedness_vecmasemase_vecmccmcc_vecmetric_setmetric_summarizermetric_tweakmetric_vec_templatemetricsmiss_ratemiss_rate_vecmn_log_lossmn_log_loss_vecmpempe_vecmsdmsd_vecmsemse_vecnew_class_metricnew_dynamic_survival_metricnew_groupwise_metricnew_integrated_survival_metricnew_linear_pred_survival_metricnew_numeric_metricnew_ordered_prob_metricnew_prob_metricnew_quantile_metricnew_static_survival_metricnpvnpv_vecnumeric_metric_summarizerordered_prob_metric_summarizerpoisson_log_losspoisson_log_loss_vecppvppv_vecpr_aucpr_auc_vecpr_curveprecisionprecision_vecprob_metric_summarizerquantile_metric_summarizerranked_prob_scoreranked_prob_score_vecrecallrecall_vecrmsermse_relativermse_relative_vecrmse_vecroc_aucroc_auc_survivalroc_auc_survival_vecroc_auc_vecroc_aunproc_aunp_vecroc_aunuroc_aunu_vecroc_curveroc_curve_survivalroc_distroc_dist_vecroyston_survivalroyston_survival_vecrpdrpd_vecrpiqrpiq_vecrsqrsq_tradrsq_trad_vecrsq_vecsedisedi_vecsenssens_vecsensitivitysensitivity_vecsmapesmape_vecspecspec_vecspecificityspecificity_vecstatic_survival_metric_summarizertidyvalidate_estimatorweighted_interval_scoreweighted_interval_score_vecyardstick_any_missingyardstick_remove_missing

Dependencies:clidplyrgenericsgluehardhatlifecyclemagrittrpillarpkgconfigR6rlangsparsevctrstibbletidyselectutf8vctrswithr

Metric types
Example | Metrics
Rendered frommetric-types.Rmdusingknitr::rmarkdown

Last update: 2026-01-16
Started: 2018-11-01

Grouping behavior in yardstick
Group-awareness | Groupwise metrics
Rendered fromgrouping.Rmdusingknitr::rmarkdown

Last update: 2025-04-24
Started: 2023-11-02

Multiclass averaging
Introduction | Macro averaging | Micro averaging | Specialized multiclass implementations
Rendered frommulticlass.Rmdusingknitr::rmarkdown

Last update: 2025-04-24
Started: 2018-11-01

Readme and manuals

Help Manual

Help pageTopics
Accuracyaccuracy accuracy.data.frame accuracy_vec
Area under the precision recall curveaverage_precision average_precision.data.frame average_precision_vec
Balanced accuracybal_accuracy bal_accuracy.data.frame bal_accuracy_vec
Brier score for classification modelsbrier_class brier_class.data.frame brier_class_vec
Time-Dependent Brier score for right censored databrier_survival brier_survival.data.frame brier_survival_vec
Integrated Brier score for right censored databrier_survival_integrated brier_survival_integrated.data.frame brier_survival_integrated_vec
Concordance correlation coefficientccc ccc.data.frame ccc_vec
Developer function for checking inputs in new metricscheck_class_metric check_dynamic_survival_metric check_linear_pred_survival_metric check_metric check_numeric_metric check_ordered_prob_metric check_prob_metric check_quantile_metric check_static_survival_metric
Costs function for poor classificationclassification_cost classification_cost.data.frame classification_cost_vec
Concordance index for right-censored dataconcordance_survival concordance_survival.data.frame concordance_survival_vec
Confusion Matrix for Categorical Dataconf_mat conf_mat.data.frame conf_mat.default conf_mat.table tidy.conf_mat
Demographic paritydemographic_parity
Detection prevalencedetection_prevalence detection_prevalence.data.frame detection_prevalence_vec
Developer helpersdeveloper-helpers dots_to_estimate finalize_estimator finalize_estimator_internal get_weights validate_estimator
Equal opportunityequal_opportunity
Equalized oddsequalized_odds
F Measuref_meas f_meas.data.frame f_meas_vec
Fall-out (False Positive Rate)fall_out fall_out.data.frame fall_out_vec
Gain capturegain_capture gain_capture.data.frame gain_capture_vec
Gain curvegain_curve gain_curve.data.frame
Get all metrics of a given typeget_metrics
Normalized Gini coefficientgini_coef gini_coef.data.frame gini_coef_vec
Multiclass Probability Predictionshpc_cv
Huber losshuber_loss huber_loss.data.frame huber_loss_vec
Psuedo-Huber Losshuber_loss_pseudo huber_loss_pseudo.data.frame huber_loss_pseudo_vec
Index of ideality of correlationiic iic.data.frame iic_vec
J-indexj_index j_index.data.frame j_index_vec
Kappakap kap.data.frame kap_vec
Lift curvelift_curve lift_curve.data.frame
Survival Analysis Resultslung_surv
Mean absolute errormae mae.data.frame mae_vec
Mean absolute percent errormape mape.data.frame mape_vec
Markednessmarkedness markedness.data.frame markedness_vec
Mean absolute scaled errormase mase.data.frame mase_vec
Matthews correlation coefficientmcc mcc.data.frame mcc_vec
Combine metric functionsmetric_set
Tweak a metric functionmetric_tweak
Developer function for summarizing new metricsclass_metric_summarizer curve_metric_summarizer curve_survival_metric_summarizer dynamic_survival_metric_summarizer linear_pred_survival_metric_summarizer metric-summarizers numeric_metric_summarizer ordered_prob_metric_summarizer prob_metric_summarizer quantile_metric_summarizer static_survival_metric_summarizer
General Function to Estimate Performancemetrics metrics.data.frame
Miss rate (False Negative Rate)miss_rate miss_rate.data.frame miss_rate_vec
Mean log loss for multinomial datamn_log_loss mn_log_loss.data.frame mn_log_loss_vec
Mean percentage errormpe mpe.data.frame mpe_vec
Mean signed deviationmsd msd.data.frame msd_vec
Mean squared errormse mse.data.frame mse_vec
Create groupwise metricsnew_groupwise_metric
Construct a new metric functionnew-metric new_class_metric new_dynamic_survival_metric new_integrated_survival_metric new_linear_pred_survival_metric new_numeric_metric new_ordered_prob_metric new_prob_metric new_quantile_metric new_static_survival_metric
Negative predictive valuenpv npv.data.frame npv_vec
Liver Pathology Datapathology
Mean log loss for Poisson datapoisson_log_loss poisson_log_loss.data.frame poisson_log_loss_vec
Positive predictive valueppv ppv.data.frame ppv_vec
Area under the precision recall curvepr_auc pr_auc.data.frame pr_auc_vec
Precision recall curvepr_curve pr_curve.data.frame
Precisionprecision precision.data.frame precision_vec
Ranked probability scores for ordinal classification modelsranked_prob_score ranked_prob_score.data.frame ranked_prob_score_vec
Recallrecall recall.data.frame recall_vec
Root mean squared errorrmse rmse.data.frame rmse_vec
Relative root mean squared errorrmse_relative rmse_relative.data.frame rmse_relative_vec
Area under the receiver operator curveroc_auc roc_auc.data.frame roc_auc_vec
Time-Dependent ROC AUC for Censored Dataroc_auc_survival roc_auc_survival.data.frame roc_auc_survival_vec
Area under the ROC curve of each class against the rest, using the a priori class distributionroc_aunp roc_aunp.data.frame roc_aunp_vec
Area under the ROC curve of each class against the rest, using the uniform class distributionroc_aunu roc_aunu.data.frame roc_aunu_vec
Receiver operator curveroc_curve roc_curve.data.frame
Time-Dependent ROC surve for Censored Dataroc_curve_survival roc_curve_survival.data.frame
Distance to ROC cornerroc_dist roc_dist.data.frame roc_dist_vec
Royston-Sauerbei D statisticroyston_survival royston_survival.data.frame royston_survival_vec
Ratio of performance to deviationrpd rpd.data.frame rpd_vec
Ratio of performance to inter-quartilerpiq rpiq.data.frame rpiq_vec
R squaredrsq rsq.data.frame rsq_vec
R squared - traditionalrsq_trad rsq_trad.data.frame rsq_trad_vec
Symmetric Extremal Dependence Indexsedi sedi.data.frame sedi_vec
Sensitivitysens sens.data.frame sensitivity sensitivity.data.frame sensitivity_vec sens_vec
Symmetric mean absolute percentage errorsmape smape.data.frame smape_vec
Solubility Predictions from MARS Modelsolubility_test
Specificityspec spec.data.frame specificity specificity.data.frame specificity_vec spec_vec
Summary Statistics for Confusion Matricessummary.conf_mat
Two Class Predictionstwo_class_example
Compute weighted interval scoreweighted_interval_score weighted_interval_score.data.frame weighted_interval_score_vec
Developer function for handling missing values in new metricsyardstick_any_missing yardstick_remove_missing