7
Supplementary Fig. 1. Statistical Classification Analysis Results. Box and whisker plots displaying mean performance metrics returned in the assessment of in vitro AC 50 values and dosimetry-adjusted oral equivalent values in the prediction of the 40 discretized in vivo toxicity endpoints. Metrics assessed: AUC, balanced accuracy, sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV). Eighty-four SAS statistical classification models were used.* Detailed descriptions and parameters of the SAS models are provided in Supplementary Table 8; full names for the in vivo endpoints are provided in Supplementary Table 7. * RatCast_OE endpoints CHR_Rat_SpleenPathology and MGR_Rat_LitterSize only include 83 models in the CVMC (both are missing Discriminant Analysis model #7 as it produced floating point errors which caused the CVMC to fail).

Supplementary Fig. 1. Statistical Classification Analysis Results. Box and whisker plots displaying mean performance metrics returned in the assessment

Embed Size (px)

Citation preview

Page 1: Supplementary Fig. 1. Statistical Classification Analysis Results. Box and whisker plots displaying mean performance metrics returned in the assessment

Supplementary Fig. 1. Statistical Classification Analysis Results.Box and whisker plots displaying mean performance metrics returned in the assessment of in vitro AC50 values and dosimetry-adjusted oral equivalent values in the prediction of the 40 discretized in vivo toxicity endpoints.

Metrics assessed: AUC, balanced accuracy, sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV). Eighty-four SAS statistical classification models were used.* Detailed descriptions and parameters of the SAS models are provided in Supplementary Table 8; full names for the in vivo endpoints are provided in Supplementary Table 7.

* RatCast_OE endpoints CHR_Rat_SpleenPathology and MGR_Rat_LitterSize only include 83 models in the CVMC (both are missing Discriminant Analysis model #7 as it produced floating point errors which caused the CVMC to fail).

Page 2: Supplementary Fig. 1. Statistical Classification Analysis Results. Box and whisker plots displaying mean performance metrics returned in the assessment

AU

C

0.40.450.50.550.60.650.70.750.80.850.90.95 In Vitro Oral Equivalent Dose – Discretized In Vivo Response Data (Yes/No)

AU

C

0.40.450.50.550.60.650.70.750.80.850.90.95

D_Rat_M

at

C_Rat_Liver_H

ypertrophy

D_Rat_M

at_G

enMat

D_Rat_M

at_G

enMat_Systemic

C_Rat_Tum

origen

D_Rat_Dev_Skel

M_Rat_Liver

C_Rat_Liver_N

ecrosis

C_Rat_Liver_A

nyLes

C_Rat_Liver_PreneoplastLes

D_Rat_Dev_Skel_Axial

C_Rat_K

idney_Nephropathy

D_Rat_Dev_GenFetal_WghtRed

M_Rat_OffspringSurvival

M_Rat_ViabilityPND4

D_Rat_Dev_GenFetal

M_Rat_Reproduct_Perform

M_Rat_Kidney

M_Rat_Reproduct_O

utcome

C_Rat_Thyroid_Tum

ors

D_Rat_M

at_PregRel

D_Rat_M

at_PregRel_PregLoss

D_Rat_Prenatal_Loss

M_Rat_LitterSize

C_Rat_Lung_AnyLes

C_Rat_Eye_AnyLes

C_Rat_Liver_Tum

ors

C_Rat_Liver_N

eoplasLes

C_Rat_ThyroidGlnd_AnyLes

C_Rat_ThyrGl_PreneoplastLes

C_Rat_Thyroid_N

eoplasLes

C_Rat_Thyroid_ProliferatLes

M_Rat_Fem_ReproductTract

C_Rat_K

idney_AnyLes

C_Rat_Liver_ProliferatLes

C_Rat_Spleen_Path

C_Rat_Spleen_AnyLes

C_Rat_Testes_AnyLes

M_Rat_Gestat_Interval

M_Rat_LactationPND21

In Vitro Nominal AC50 and LEC Concentrations – Discretized In Vivo Response Data (Yes/No)

Page 3: Supplementary Fig. 1. Statistical Classification Analysis Results. Box and whisker plots displaying mean performance metrics returned in the assessment

Bal

ance

d A

ccur

acy

0.35

0.45

0.55

0.65

0.75

0.85

0.95

Bal

ance

d A

ccur

acy

0.35

0.45

0.55

0.65

0.75

0.85

0.95

D_Rat_M

atC_Rat_Liver_A

nyLes

D_Rat_M

at_G

enMat_Systemic

D_Rat_M

at_G

enMat

C_Rat_Tum

origen

D_Rat_D

ev_Skel

M_Rat_Liver

C_Rat_Liver_H

ypertrophy

C_Rat_Liver_PreneoplastLes

C_Rat_Liver_ProliferatLes

D_Rat_D

ev_Skel_Axial

C_Rat_K

idney_AnyLes

D_Rat_D

ev_G

enFetal

M_Rat_O

ffspringSurvival

M_Rat_ViabilityPND4

D_Rat_D

ev_G

enFetal_W

ghtRed

M_Rat_Reproduct_Perform

M_Rat_K

idney

M_Rat_Reproduct_O

utcome

C_Rat_ThyroidGlnd_AnyLes

D_Rat_M

at_PregRel_PregLoss

D_Rat_M

at_PregRel

D_Rat_Prenatal_Loss

M_Rat_LitterSize

C_Rat_Lung_AnyLes

C_Rat_Eye_A

nyLes

C_Rat_Liver_N

eoplasLes

C_Rat_Liver_Tum

ors

C_Rat_ThyrGl_PreneoplastLes

C_Rat_Thyroid_N

eoplasLes

C_Rat_Thyroid_ProliferatLes

C_Rat_Thyroid_Tum

ors

M_Rat_Fem_ReproductTract

C_Rat_K

idney_Nephropathy

C_Rat_Liver_N

ecrosis

C_Rat_Spleen_AnyLes

C_Rat_Spleen_Path

C_Rat_Testes_AnyLes

M_Rat_G

estat_Interval

M_Rat_LactationPND21

In Vitro Oral Equivalent Dose – Discretized In Vivo Response Data (Yes/No)

In Vitro Nominal AC50 and LEC Concentrations – Discretized In Vivo Response Data (Yes/No)

Page 4: Supplementary Fig. 1. Statistical Classification Analysis Results. Box and whisker plots displaying mean performance metrics returned in the assessment

Sen

sitiv

ity

00.10.20.30.40.50.60.70.80.91

Sen

sitiv

ity

00.10.20.30.40.50.60.70.80.91

D_Rat_M

atC_Rat_Liver_A

nyLes

D_Rat_M

at_G

enMat_Systemic

D_Rat_M

at_G

enMat

C_Rat_Tum

origen

D_Rat_D

ev_Skel

M_Rat_Liver

C_Rat_Liver_H

ypertrophy

C_Rat_Liver_PreneoplastLes

C_Rat_Liver_ProliferatLes

D_Rat_D

ev_Skel_Axial

C_Rat_K

idney_AnyLes

D_Rat_D

ev_G

enFetal

M_Rat_O

ffspringSurvival

M_Rat_ViabilityPND4

D_Rat_D

ev_G

enFetal_W

ghtRed

M_Rat_Reproduct_Perform

M_Rat_K

idney

M_Rat_Reproduct_O

utcome

C_Rat_ThyroidGlnd_AnyLes

D_Rat_M

at_PregRel_PregLoss

D_Rat_M

at_PregRel

D_Rat_Prenatal_Loss

M_Rat_LitterSize

C_Rat_Lung_AnyLes

C_Rat_Eye_A

nyLes

C_Rat_Liver_N

eoplasLes

C_Rat_Liver_Tum

ors

C_Rat_ThyrGl_PreneoplastLes

C_Rat_Thyroid_N

eoplasLes

C_Rat_Thyroid_ProliferatLes

C_Rat_Thyroid_Tum

ors

M_Rat_Fem_ReproductTract

C_Rat_K

idney_Nephropathy

C_Rat_Liver_N

ecrosis

C_Rat_Spleen_AnyLes

C_Rat_Spleen_Path

C_Rat_Testes_AnyLes

M_Rat_G

estat_Interval

M_Rat_LactationPND21

In Vitro Nominal AC50 and LEC Concentrations – Discretized In Vivo Response Data (Yes/No)

In Vitro Oral Equivalent Dose – Discretized In Vivo Response Data (Yes/No)

Page 5: Supplementary Fig. 1. Statistical Classification Analysis Results. Box and whisker plots displaying mean performance metrics returned in the assessment

Spe

cific

ity

00.10.20.30.40.50.60.70.80.91

Spe

cific

ity

00.10.20.30.40.50.60.70.80.91

D_Rat_M

atC_Rat_Liver_A

nyLes

D_Rat_M

at_G

enMat_Systemic

D_Rat_M

at_G

enMat

C_Rat_Tum

origen

D_Rat_D

ev_Skel

M_Rat_Liver

C_Rat_Liver_H

ypertrophy

C_Rat_Liver_PreneoplastLes

C_Rat_Liver_ProliferatLes

D_Rat_D

ev_Skel_Axial

C_Rat_K

idney_AnyLes

D_Rat_D

ev_G

enFetal

M_Rat_O

ffspringSurvival

M_Rat_ViabilityPND4

D_Rat_D

ev_G

enFetal_W

ghtRed

M_Rat_Reproduct_Perform

M_Rat_K

idney

M_Rat_Reproduct_O

utcome

C_Rat_ThyroidGlnd_AnyLes

D_Rat_M

at_PregRel_PregLoss

D_Rat_M

at_PregRel

D_Rat_Prenatal_Loss

M_Rat_LitterSize

C_Rat_Lung_AnyLes

C_Rat_Eye_A

nyLes

C_Rat_Liver_N

eoplasLes

C_Rat_Liver_Tum

ors

C_Rat_ThyrGl_PreneoplastLes

C_Rat_Thyroid_N

eoplasLes

C_Rat_Thyroid_ProliferatLes

C_Rat_Thyroid_Tum

ors

M_Rat_Fem_ReproductTract

C_Rat_K

idney_Nephropathy

C_Rat_Liver_N

ecrosis

C_Rat_Spleen_AnyLes

C_Rat_Spleen_Path

C_Rat_Testes_AnyLes

M_Rat_G

estat_Interval

M_Rat_LactationPND21

In Vitro Oral Equivalent Dose – Discretized In Vivo Response Data (Yes/No)

In Vitro Nominal AC50 and LEC Concentrations – Discretized In Vivo Response Data (Yes/No)

Page 6: Supplementary Fig. 1. Statistical Classification Analysis Results. Box and whisker plots displaying mean performance metrics returned in the assessment

PP

V

00.10.20.30.40.50.60.70.80.91

PP

V

00.10.20.30.40.50.60.70.80.91

D_Rat_M

atC_Rat_Liver_A

nyLes

D_Rat_M

at_GenMat_Systemic

D_Rat_M

at_GenMat

C_Rat_Tum

origen

D_Rat_Dev_Skel

M_Rat_Liver

C_Rat_Liver_H

ypertrophy

C_Rat_Liver_PreneoplastLes

C_Rat_Liver_ProliferatLes

D_Rat_Dev_Skel_Axial

C_Rat_Kidney_AnyLes

D_Rat_Dev_GenFetal

M_Rat_OffspringSurvival

M_Rat_ViabilityPND4

D_Rat_Dev_GenFetal_W

ghtRed

M_Rat_Reproduct_Perform

M_Rat_Kidney

M_Rat_Reproduct_Outcome

C_Rat_ThyroidGlnd_AnyLes

D_Rat_M

at_PregRel_PregLoss

D_Rat_M

at_PregRel

D_Rat_Prenatal_Loss

M_Rat_LitterSize

C_Rat_Lung_AnyLes

C_Rat_Eye_AnyLes

C_Rat_Liver_N

eoplasLes

C_Rat_Liver_Tum

ors

C_Rat_ThyrGl_PreneoplastLes

C_Rat_Thyroid_N

eoplasLes

C_Rat_Thyroid_ProliferatLes

C_Rat_Thyroid_Tum

ors

M_Rat_Fem_ReproductTract

C_Rat_Kidney_Nephropathy

C_Rat_Liver_N

ecrosis

C_Rat_Spleen_AnyLes

C_Rat_Spleen_Path

C_Rat_Testes_AnyLes

M_Rat_Gestat_Interval

M_Rat_LactationPND21

In Vitro Oral Equivalent Dose – Discretized In Vivo Response Data (Yes/No)

In Vitro Nominal AC50 and LEC Concentrations – Discretized In Vivo Response Data (Yes/No)

Page 7: Supplementary Fig. 1. Statistical Classification Analysis Results. Box and whisker plots displaying mean performance metrics returned in the assessment

NP

V

00.10.20.30.40.50.60.70.80.91

NP

V

00.10.20.30.40.50.60.70.80.91

D_Rat_M

atC_Rat_Liver_A

nyLes

D_Rat_M

at_GenMat_Systemic

D_Rat_M

at_GenMat

C_Rat_Tum

origen

D_Rat_Dev_Skel

M_Rat_Liver

C_Rat_Liver_H

ypertrophy

C_Rat_Liver_PreneoplastLes

C_Rat_Liver_ProliferatLes

D_Rat_Dev_Skel_Axial

C_Rat_Kidney_AnyLes

D_Rat_Dev_GenFetal

M_Rat_OffspringSurvival

M_Rat_ViabilityPND4

D_Rat_Dev_GenFetal_W

ghtRed

M_Rat_Reproduct_Perform

M_Rat_Kidney

M_Rat_Reproduct_Outcome

C_Rat_ThyroidGlnd_AnyLes

D_Rat_M

at_PregRel_PregLoss

D_Rat_M

at_PregRel

D_Rat_Prenatal_Loss

M_Rat_LitterSize

C_Rat_Lung_AnyLes

C_Rat_Eye_AnyLes

C_Rat_Liver_N

eoplasLes

C_Rat_Liver_Tum

ors

C_Rat_ThyrGl_PreneoplastLes

C_Rat_Thyroid_N

eoplasLes

C_Rat_Thyroid_ProliferatLes

C_Rat_Thyroid_Tum

ors

M_Rat_Fem_ReproductTract

C_Rat_Kidney_Nephropathy

C_Rat_Liver_N

ecrosis

C_Rat_Spleen_AnyLes

C_Rat_Spleen_Path

C_Rat_Testes_AnyLes

M_Rat_Gestat_Interval

M_Rat_LactationPND21

In Vitro Oral Equivalent Dose – Discretized In Vivo Response Data (Yes/No)

In Vitro Nominal AC50 and LEC Concentrations – Discretized In Vivo Response Data (Yes/No)