Skip to content

Final Results

Jump to bottom
Brian Pho edited this page Jun 22, 2022 · 68 revisions

Table of Contents

Final Results

'*' = significant

Within-Prediction

ADHD

PLS

All Ages (n=373) Bin 1 (n=114) Bin 2 (n=147) Bin 3 (n=112)
WISC Primary Index r p-value r p-value r p-value r p-value
Intelligence Quotient (FSIQ) 0.3733 0.0020* 0.2382 0.0240* 0.3683 0.0020* 0.0934 0.2136
Visual Spatial (VSI) 0.2813 0.0020* 0.2453 0.0140* 0.2007 0.0259* 0.1165 0.1677
Verbal Comprehension (VCI) 0.3658 0.0020* 0.2208 0.0220* 0.3959 0.0020* 0.0267 0.4112
Fluid Reasoning (FRI) 0.2978 0.0020* 0.0597 0.3034 0.3037 0.0060* 0.0279 0.4012
Working Memory (WMI) 0.1661 0.0120* 0.0816 0.2814 0.2691 0.0100* 0.0985 0.1697
Processing Speed (PSI) 0.0570 0.2275 -0.0984 0.7764 0.0431 0.3134 0.0703 0.3134

Ridge

All Ages (n=373) Bin 1 (n=114) Bin 2 (n=147) Bin 3 (n=112)
WISC Primary Index Alpha r p-value Alpha r p-value Alpha r p-value Alpha r p-value
Intelligence Quotient (FSIQ) 9901 0.3765 0.0020* 701 0.2653 0.0200* 5701 0.3517 0.0020* 1 0.1055 0.1776
Visual Spatial (VSI) 9901 0.3112 0.0020* 9901 0.2449 0.0180* 9901 0.2085 0.0220* 9901 0.0878 0.2295
Verbal Comprehension (VCI) 9601 0.3859 0.0020* 1 0.2233 0.0279* 9901 0.3520 0.0020* 7101 0.0373 0.4032
Fluid Reasoning (FRI) 9901 0.2984 0.0020* 2301 0.0475 0.3473 8401 0.3143 0.0040* 1 -0.0130 0.5190
Working Memory (WMI) 5501 0.2082 0.0040* 1 0.0484 0.3573 4401 0.2886 0.0040* 9901 0.1041 0.1836
Processing Speed (PSI) 9901 0.0463 0.2575 9901 -0.0941 0.7924 4401 0.0618 0.2635 1 0.0902 0.2575

Healthy

PLS

All Ages (n=106)
WISC Primary Index r p-value
Intelligence Quotient (FSIQ) 0.0413 0.3886
Visual Spatial (VSI) 0.1445 0.1299
Verbal Comprehension (VCI) 0.2252 0.0360*
Fluid Reasoning (FRI) -0.0683 0.7373
Working Memory (WMI) 0.0778 0.2597
Processing Speed (PSI) -0.1000 0.7912

Ridge

All Ages (n=106)
WISC Primary Index Alpha r p-value
Intelligence Quotient (FSIQ) 1 0.0398 0.4172
Visual Spatial (VSI) 1 0.1618 0.1078
Verbal Comprehension (VCI) 9901 0.1967 0.0519
Fluid Reasoning (FRI) 1 -0.0728 0.7345
Working Memory (WMI) 9901 0.1170 0.2136
Processing Speed (PSI) 1 -0.0561 0.6986

ICC

The following results are for the ADHD dataset. All ICC results have p-value < 0.00001.

Between Models

ICC
WISC Primary Index All Ages Bin 1 Bin 2 Bin 3
Intelligence Quotient (FSIQ) 0.959 0.974 0.979 0.973
Visual Spatial (VSI) 0.961 0.949 0.938 0.934
Verbal Comprehension (VCI) 0.960 0.968 0.955 0.960
Fluid Reasoning (FRI) 0.959 0.985 0.961 0.971
Working Memory (WMI) 0.948 0.963 0.982 0.931
Processing Speed (PSI) 0.955 0.923 0.980 0.980

Between Age Bin

All connections

WISC Primary Index All, Bin 1 All, Bin 2 All, Bin 3 Bin 1, Bin 2 Bin 1, Bin 3 Bin 2, Bin 3
Intelligence Quotient (FSIQ) 0.512 0.582 0.596 0.107 0.079 0.076
Visual Spatial (VSI) 0.440 0.565 0.501 0.127 0.053 0.085
Verbal Comprehension (VCI) 0.566 0.533 0.526 0.097 0.112 0.088
Fluid Reasoning (FRI) 0.498 0.553 0.589 0.059 0.045 0.097
Working Memory (WMI) 0.484 0.463 0.477 0.025 0.056 0.046
Processing Speed (PSI) 0.435 0.499 0.535 0.009 -0.006 -0.044

Network connections

WISC Primary Index All, Bin 1 All, Bin 2 All, Bin 3 Bin 1, Bin 2 Bin 1, Bin 3 Bin 2, Bin 3
Intelligence Quotient (FSIQ) 0.559* 0.455* 0.666* 0.050 0.097 0.125
Visual Spatial (VSI) 0.420* 0.543* 0.582* 0.068 -0.061 0.181*
Verbal Comprehension (VCI) 0.466* 0.541* 0.626* 0.064 0.028 0.140
Fluid Reasoning (FRI) 0.520* 0.487* 0.651* -0.019 0.099 0.265*
Working Memory (WMI) 0.625* 0.384* 0.519* 0.025 0.324* 0.169
Processing Speed (PSI) 0.400* 0.509* 0.639* 0.040 -0.019 0.113

Cross-Prediction

Age

KMeans

Number of Clusters Hyperparameter Search

Silhouette analysis suggests two clusters while Bayesian information criterion suggests four clusters. Going with four clusters. 

 
 Num clusters: 2 | Silhouette score: 0.1171
 Num clusters: 3 | Silhouette score: 0.0571
 Num clusters: 4 | Silhouette score: 0.0297
 Num clusters: 5 | Silhouette score: 0.0171
 Num clusters: 6 | Silhouette score: 0.0071
 Num clusters: 7 | Silhouette score: 0.0192
 Num clusters: 8 | Silhouette score: 0.0034
 Num clusters: 9 | Silhouette score: 0.0037
 ---
 Largest silhouette score 0.11708091199398041 with 2 clusters
 

 
 Num clusters: 2 | BIC: 35516822.41
 Num clusters: 3 | BIC: 35151110.59
 Num clusters: 4 | BIC: 35002616.40
 Num clusters: 5 | BIC: 35280269.71
 Num clusters: 6 | BIC: 35526656.92
 Num clusters: 7 | BIC: 35742988.85
 Num clusters: 8 | BIC: 35939913.72
 Num clusters: 9 | BIC: 35759025.07
 ---
 Smallest BIC 35002616.400843374 with 4 clusters

Results

Cluster
WISC Primary Index 1 2 3 4
Intelligence Quotient (FSIQ) 100.43 (15.38) 99.35 (17.93) 94.58 (14.36) 102.99 (15.40)
Visual Spatial (VSI) 101.90 (15.78) 101.18 (17.90) 97.11 (14.86) 106.13 (17.57)
Verbal Comprehension (VCI) 105.44 (14.80) 104.06 (17.13) 101.22 (12.66) 107.32 (16.24)
Fluid Reasoning (FRI) 101.77 (15.73) 99.49 (17.66) 97.76 (15.37) 104.40 (14.65)
Working Memory (WMI) 99.51 (13.99) 98.71 (16.35) 94.40 (14.56) 99.16 (14.94)
Processing Speed (PSI) 93.14 (15.27) 95.68 (15.81) 91.62 (14.99) 92.79 (14.84)

Dataset Statistics

mean(standard deviation) | lowest to highest

ADHD 

n=373
Sex: {'Male': 274, 'Female': 99}
Age: 10.57 (2.53) | 6.03 to 15.98
WISC_FSIQ: 100.13 (16.31) | 70.00 to 147.00
WISC_VSI: 102.32 (17.12) | 57.00 to 155.00
WISC_VCI: 105.04 (15.87) | 70.00 to 155.00
WISC_FRI: 101.33 (16.19) | 67.00 to 144.00
WISC_WMI: 98.54 (15.18) | 62.00 to 138.00
WISC_PSI: 93.65 (15.35) | 53.00 to 148.00
---
Bin 1 Statistics
n=114
Sex: {'Male': 77, 'Female': 37}
Age: 7.73 (0.76) | 6.03 to 8.98
WISC_FSIQ: 104.13 (15.47) | 73.00 to 138.00
WISC_VSI: 106.38 (16.64) | 67.00 to 147.00
WISC_VCI: 108.53 (16.06) | 70.00 to 146.00
WISC_FRI: 104.58 (15.40) | 67.00 to 140.00
WISC_WMI: 99.53 (14.83) | 67.00 to 138.00
WISC_PSI: 97.33 (15.29) | 56.00 to 148.00
---
Bin 2 Statistics
n=147
Sex: {'Male': 118, 'Female': 29}
Age: 10.34 (0.88) | 9.04 to 11.96
WISC_FSIQ: 98.56 (15.90) | 70.00 to 141.00
WISC_VSI: 100.73 (16.69) | 64.00 to 144.00
WISC_VCI: 104.44 (15.34) | 70.00 to 155.00
WISC_FRI: 99.14 (15.75) | 67.00 to 134.00
WISC_WMI: 97.21 (14.04) | 65.00 to 138.00
WISC_PSI: 93.12 (13.94) | 56.00 to 123.00
---
Bin 3 Statistics
n=112
Sex: {'Male': 79, 'Female': 33}
Age: 13.75 (1.13) | 12.03 to 15.98
WISC_FSIQ: 98.11 (16.94) | 71.00 to 147.00
WISC_VSI: 100.28 (17.46) | 57.00 to 155.00
WISC_VCI: 102.29 (15.71) | 70.00 to 142.00
WISC_FRI: 100.90 (16.98) | 67.00 to 144.00
WISC_WMI: 99.29 (16.77) | 62.00 to 135.00
WISC_PSI: 90.59 (16.38) | 53.00 to 132.00
---

TD 

n=106
Sex: {'Male': 62, 'Female': 44}
Age: 10.12 (2.78) | 6.05 to 16.50
WISC_FSIQ: 108.58 (14.20) | 76.00 to 145.00
WISC_VSI: 105.21 (15.01) | 64.00 to 141.00
WISC_VCI: 110.58 (13.93) | 78.00 to 155.00
WISC_FRI: 107.42 (15.11) | 69.00 to 155.00
WISC_WMI: 103.92 (14.29) | 72.00 to 135.00
WISC_PSI: 106.55 (15.80) | 66.00 to 155.00
Clone this wiki locally