Skip to main content

Table 3 Nine different algorithms' model performance metrics

From: Predicting quetiapine dose in patients with depression using machine learning techniques based on real-world evidence

Model

label

precision

recall

f1-score

support

AUROC

sensitivity

specificity

accuracy

XGBoost

        

0.69 ± 0.03

 

0

0.91 ± 0.07

0.68 ± 0.1

0.78 ± 0.09

11.4 ± 1.71

0.93 ± 0.04

0.68 ± 0.1

0.98 ± 0.01

 
 

1

0.67 ± 0.05

0.76 ± 0.09

0.71 ± 0.03

22.8 ± 2.25

0.77 ± 0.04

0.76 ± 0.09

0.78 ± 0.05

 
 

2

0.67 ± 0.17

0.47 ± 0.09

0.54 ± 0.1

13.3 ± 2.58

0.77 ± 0.08

0.47 ± 0.09

0.93 ± 0.04

 
 

3

0.64 ± 0.1

0.79 ± 0.08

0.7 ± 0.07

14.5 ± 2.32

0.86 ± 0.06

0.79 ± 0.08

0.86 ± 0.05

 

LGBM

        

0.6 ± 0.05

 

0

0.86 ± 0.1

0.75 ± 0.1

0.8 ± 0.09

11.4 ± 1.71

0.93 ± 0.05

0.75 ± 0.1

0.97 ± 0.02

 
 

1

0.59 ± 0.07

0.62 ± 0.1

0.6 ± 0.06

22.8 ± 2.25

0.75 ± 0.03

0.62 ± 0.1

0.75 ± 0.05

 
 

2

0.45 ± 0.18

0.41 ± 0.14

0.42 ± 0.14

13.3 ± 2.58

0.72 ± 0.1

0.41 ± 0.14

0.87 ± 0.05

 
 

3

0.59 ± 0.11

0.63 ± 0.07

0.61 ± 0.07

14.5 ± 2.32

0.85 ± 0.05

0.63 ± 0.07

0.86 ± 0.06

 

RF

        

0.55 ± 0.05

 

0

0.81 ± 0.06

0.75 ± 0.12

0.77 ± 0.08

11.4 ± 1.71

0.92 ± 0.05

0.75 ± 0.12

0.96 ± 0.02

 
 

1

0.54 ± 0.07

0.54 ± 0.1

0.54 ± 0.06

22.8 ± 2.25

0.7 ± 0.04

0.54 ± 0.1

0.73 ± 0.05

 
 

2

0.42 ± 0.13

0.47 ± 0.14

0.43 ± 0.1

13.3 ± 2.58

0.73 ± 0.09

0.47 ± 0.14

0.82 ± 0.05

 
 

3

0.53 ± 0.14

0.5 ± 0.12

0.51 ± 0.11

14.5 ± 2.32

0.81 ± 0.05

0.5 ± 0.12

0.86 ± 0.05

 

GBDT

        

0.54 ± 0.05

 

0

0.77 ± 0.11

0.73 ± 0.13

0.75 ± 0.1

11.4 ± 1.71

0.92 ± 0.04

0.73 ± 0.13

0.95 ± 0.03

 
 

1

0.56 ± 0.1

0.54 ± 0.09

0.54 ± 0.06

22.8 ± 2.25

0.7 ± 0.04

0.54 ± 0.09

0.75 ± 0.06

 
 

2

0.34 ± 0.13

0.39 ± 0.16

0.36 ± 0.13

13.3 ± 2.58

0.68 ± 0.1

0.39 ± 0.16

0.8 ± 0.05

 
 

3

0.56 ± 0.14

0.54 ± 0.12

0.54 ± 0.1

14.5 ± 2.32

0.8 ± 0.05

0.54 ± 0.12

0.87 ± 0.05

 

SVM

        

0.64 ± 0.06

 

0

0.94 ± 0.07

0.78 ± 0.11

0.85 ± 0.07

11.4 ± 1.71

0.94 ± 0.05

0.78 ± 0.11

0.99 ± 0.01

 
 

1

0.63 ± 0.08

0.8 ± 0.09

0.7 ± 0.06

22.8 ± 2.25

0.79 ± 0.03

0.8 ± 0.09

0.72 ± 0.07

 
 

2

0.52 ± 0.19

0.2 ± 0.1

0.26 ± 0.09

13.3 ± 2.58

0.74 ± 0.08

0.2 ± 0.1

0.95 ± 0.03

 
 

3

0.57 ± 0.14

0.69 ± 0.08

0.62 ± 0.1

14.5 ± 2.32

0.85 ± 0.06

0.69 ± 0.08

0.83 ± 0.08

 

LR

        

0.65 ± 0.07

 

0

0.88 ± 0.11

0.74 ± 0.12

0.8 ± 0.11

11.4 ± 1.71

0.94 ± 0.04

0.74 ± 0.12

0.98 ± 0.02

 
 

1

0.63 ± 0.08

0.77 ± 0.11

0.69 ± 0.07

22.8 ± 2.25

0.8 ± 0.03

0.77 ± 0.11

0.74 ± 0.06

 
 

2

0.52 ± 0.15

0.3 ± 0.17

0.36 ± 0.11

13.3 ± 2.58

0.76 ± 0.06

0.3 ± 0.17

0.92 ± 0.05

 
 

3

0.62 ± 0.13

0.71 ± 0.1

0.66 ± 0.1

14.5 ± 2.32

0.86 ± 0.06

0.71 ± 0.1

0.86 ± 0.06

 

ANN

        

0.59 ± 0.04

 

0

0.94 ± 0.08

0.63 ± 0.13

0.74 ± 0.09

11.4 ± 1.71

0.94 ± 0.04

0.63 ± 0.13

0.99 ± 0.01

 
 

1

0.55 ± 0.06

0.82 ± 0.12

0.65 ± 0.03

22.8 ± 2.25

0.73 ± 0.08

0.82 ± 0.12

0.61 ± 0.1

 
 

2

0.51 ± 0.27

0.21 ± 0.17

0.26 ± 0.14

13.3 ± 2.58

0.74 ± 0.06

0.21 ± 0.17

0.95 ± 0.05

 
 

3

0.6 ± 0.15

0.62 ± 0.08

0.6 ± 0.07

14.5 ± 2.32

0.83 ± 0.05

0.62 ± 0.08

0.86 ± 0.08

 

TabNet

        

0.51 ± 0.06

 

0

0.59 ± 0.28

0.49 ± 0.23

0.51 ± 0.21

11.4 ± 1.71

0.82 ± 0.06

0.49 ± 0.23

0.93 ± 0.07

 
 

1

0.57 ± 0.1

0.54 ± 0.13

0.54 ± 0.1

22.8 ± 2.25

0.68 ± 0.06

0.54 ± 0.13

0.75 ± 0.13

 
 

2

0.31 ± 0.16

0.28 ± 0.15

0.28 ± 0.14

13.3 ± 2.58

0.61 ± 0.13

0.28 ± 0.15

0.84 ± 0.08

 
 

3

0.52 ± 0.13

0.67 ± 0.13

0.58 ± 0.1

14.5 ± 2.32

0.8 ± 0.07

0.67 ± 0.13

0.8 ± 0.08

 

DT

        

0.56 ± 0.07

 

0

0.73 ± 0.16

0.66 ± 0.16

0.68 ± 0.12

11.4 ± 1.71

0.86 ± 0.06

0.66 ± 0.16

0.94 ± 0.04

 
 

1

0.56 ± 0.1

0.65 ± 0.11

0.59 ± 0.07

22.8 ± 2.25

0.72 ± 0.08

0.65 ± 0.11

0.69 ± 0.12

 
 

2

0.38 ± 0.15

0.28 ± 0.18

0.3 ± 0.15

13.3 ± 2.58

0.66 ± 0.08

0.28 ± 0.18

0.89 ± 0.07

 
 

3

0.58 ± 0.11

0.61 ± 0.17

0.59 ± 0.13

14.5 ± 2.32

0.81 ± 0.06

0.61 ± 0.17

0.86 ± 0.07

 
  1. Label 0 indicates patients with daily dose of 100 mg, Label 1 indicates patients with daily dose of 200 mg, Label 2 indicates patients with daily dose of 300 mg, and Label 3 indicates patients with daily dose of 400 mg