Supplemental Material

Supplement 1

An Overview of the Primary Reason for Referral or Counseling

Primary reason for referral or counseling / percentage
Anxiety symptoms / 20.7
Depressive symptoms / 14.5
Grief or emotional problems due to parental divorce / 11.3
Behavioral problems / 10.7
Personality or identity problems / 7.6
Developmental disorders / 6.9
Psychosomatic symptoms / 5.0
Study problems / 5.0
Social problems / 3.8
Attention or concentration problems / 2.5
Sleeping problems / 1.9
Eating problems / 1.3
Incontinence problems / 1.3
Automutilization/suicide attempts / 0.6
Other reason or reason not known / 6.9

Supplement 2

Omitted HiPIC and CBCL Items Based on Conceptual Evaluation of Item Overlap

Measure / Item
HiPIC
quick to argue
burst out in a rage at setbacks
has a limited vocabulary
goes to school against his/her will
finds it hard to sit still
CBCL
easily jealous
bragging, boasting
secretive, keeps things to self
would rather be alone than with others
self-conscious or easily embarrassed
shy or timid


Supplement 3

Omitted HiPIC and CBCL Items Based on Empirical Evaluation of Item Overlap

Measure / Item
HiPIC
defends the weak
is concerned about what happens to others
sympathises with anyone who is sad
shows concern for other children
follows the one who takes the lead
takes the lead in games with peers
readily gives in to peers
goes to school against his/her will
has plenty of nerve
feels at ease with him/herself
needs a lot of room to play in
avoids physical effort
finds it hard to sit still
makes people feel good
does not mince words
likes a lot of attention
has a limited vocabulary
has little imagination
lacks creativity
likes to draw
CBCL
argues a lot
hangs around with children who get in trouble
runs away from home
sets fires
truancy, skips school
uses alcohol or drugs
feels he/she has to be perfect
feels dizzy
aches or pains
problems with eyes
rashes or other skin problems
vomiting, throwing up
stares blankly
underactive, slow moving, or lacks energy

Supplement 4

Fit Indices for the Latent Change Models and Completely Standardized Parameter Estimates for the Structural Paths Estimated in the Total Sample (N=717) After Removing Problematic Items According to Conceptual Procedure

PE / PP / χ2 / df / SRMR / CFI / Continuity model / Complication model / Pathoplasty model
PET1−PP T1 / PE∆12−PP∆12 / PE∆23−PP∆23 / PPT1→PE∆12 / PP∆12→PE∆23 / PET1→PP∆12 / PE∆12→PP∆23

ES

/ 477.82 / 13 / .07 / .95
/ INT / -.51*** / -.35*** / -.36*** / -.16*** / -.17*** / .06 / .03
/ EXT / -.02 / -.14*** / -.17*** / .03 / .10** / .15*** / -.04

E

/ 486.57 / 13 / .07 / .94
INT / -.18*** / -.17*** / -.12*** / -.05 / .01 / -.07 / -.00
EXT / .05 / -.04 / -.01 / -.03 / .03 / -.01 / .02
B / 370.20 / 13 / .06 / .96
INT / -.28*** / -.28*** / -.28*** / -.00 / .02 / -.09** / -.14***
EXT / -.24*** / -.33*** / -.26*** / -.14*** / -.01 / .03 / -.09*
C / 370.94 / 13 / .06 / .96
INT / -.08* / .03 / -.07 / -.02 / .02 / -.02 / -.04
EXT / -.14*** / -.11** / -.10** / .04 / -.02 / -.03 / -.00
I / 722.34 / 13 / .07 / .93
/ INT / .08* / -.04 / -.05 / .08 / .09* / -03 / .06
/ EXT / -.05 / -.14*** / -.10** / -.01 / -.06 / -.04 / .03

Note. χ2=chi-square statistic; df=degrees of freedom; SRMR=Standardized Root Mean Square Residual; CFI=Comparative Fit Index; PE=Personality trait; PP=Psychopathology dimension; ES=Emotional stability; E=Extraversion; B=Benevolence; C=Conscientiousness; I=Imagination; INT=Internalizing Problems; EXT=Externalizing Problems.

* p<.05, ** p<.01, *** p<.001.


Supplement 5

Fit Indices for the Latent Change Models and Completely Standardized Parameter Estimates for the Structural Paths Estimated in the Total Sample (N=717) After Removing Problematic Items According to Empirical Procedure

PE / PP / χ2 / df / SRMR / CFI / Continuity model / Complication model / Pathoplasty model
PET1−PP T1 / PE∆12−PP∆12 / PE∆23−PP∆23 / PPT1→PE∆12 / PP∆12→PE∆23 / PET1→PP∆12 / PE∆12→PP∆23

ES

/ 291.28 / 13 / .06 / .97
/ INT / -.55*** / -.37*** / -.37*** / -.17*** / -.15*** / .02 / .02
/ EXT / .01 / -.12*** / -.16*** / .05 / .09** / .14*** / -.04

E

/ 372.10 / 13 / .08 / .95
INT / -.21*** / -.18*** / -.15*** / -.01 / -.01 / -.06 / -.01
EXT / .03 / -.06 / -.01 / .00 / .03 / -.04 / -.01
B / 210.51 / 13 / .05 / .98
INT / -.34*** / -.23*** / -.25*** / .00 / .01 / -.10** / -.14***
EXT / -.37*** / -.40*** / -.30*** / -.10** / -.04 / .05 / -.10**
C / 370.94 / 13 / .06 / .96
INT / -.08* / .03 / -.07 / -.02 / .02 / -.02 / -.04
EXT / -.14*** / -.11** / -.10** / .04 / .02 / -.03 / -.00
I / 405.32 / 13 / .06 / .96
/ INT / .06 / -.01 / -.05 / .08 / .09* / -.03 / .07
/ EXT / -.06 / -.18*** / -.11** / -.01 / -.05 / -.04 / .05

Note. χ2=chi-square statistic; df=degrees of freedom; SRMR=Standardized Root Mean Square Residual; CFI=Comparative Fit Index; PE=Personality trait; PP=Psychopathology dimension; ES=Emotional stability; E=Extraversion; B=Benevolence; C=Conscientiousness; I=Imagination; INT=Internalizing Problems; EXT=Externalizing Problems.

* p<.05, ** p<.01, *** p<.001.


Supplement 6

Fit indices for CFA models for T1, T2 and After Removing Problematic Items According to Conceptual Procedure

Model / T1 / T2 / T3
χ2 / df / CFI / TLI / χ2 / df / CFI / TLI / χ2 / df / CFI / TLI
INT + ES / 31.53*** / 5 / .99 / .98 / 28.45*** / 5 / .99 / .97 / 52.85*** / 5 / .97 / .94
INT + E / 125.94*** / 14 / .93 / .90 / 101.79*** / 14 / .94 / .90 / 116.03*** / 14 / .93 / .90
INT + B / 250.07*** / 20 / .91 / .88 / 136.89*** / 20 / .95 / .89 / 208.33*** / 20 / .92 / .88
EXT + ES / 36.22*** / 2 / .97 / .91 / 43.259*** / 2 / .96 / .87 / 78.42*** / 2 / .90 / .70
EXT + B / 60.89*** / 14 / .99 / .98 / 30.863** / 14 / .99 / .99 / 78.385*** / 14 / .97 / .96
EXT + C / 72.40*** / 9 / .97 / .95 / 117.00*** / 9 / .94 / .90 / 170.28*** / 9 / .91 / .84
EXT + I / 79.84*** / 5 / .90 / .80 / 106.45*** / 5 / .89 / .77 / 253.123*** / 5 / .61 / .21

Note.T1=first measurement occasion; T2=second measurement occasion; T3=third measurement occasion; χ2=chi-square statistic; df=degrees of freedom; CFI=Comparative Fit Index; TLI=Tucker Lewis Index; INT=Internalizing problems; EXT=Externalizing problems; ES=Emotional stability; E=Extraversion; B=Benevolence; C=Conscientiousness; I=Imagination. All HiPIC scales are reversed.

Supplement 7

Fit indices for CFA models for T1, T2 and After Removing Problematic Items According to Empirical Procedure

Model / T1 / T2 / T3
χ2 / df / CFI / TLI / χ2 / df / CFI / TLI / χ2 / df / CFI / TLI
INT + ES / 55.92*** / 5 / .98 / .96 / 52.18*** / 5 / .97 / .94 / 36.03*** / 5 / .98 / .96
INT + E / 176.78*** / 14 / .93 / .90 / 111.24*** / 14 / .95 / .92 / 91.65*** / 14 / .95 / .93
INT + B / 349.35*** / 20 / .90 / .86 / 221.84*** / 20 / .93 / .89 / 214.89*** / 20 / .92 / .88
EXT + ES / 96.38*** / 2 / .93 / .79 / 56.28*** / 2 / .96 / .88 / 78.36*** / 2 / .94 / .82
EXT + B / 79.70*** / 14 / .99 / .98 / 34.03*** / 14 / .99 / .99 / 62.08*** / 14 / .99 / .98
EXT + C / 150.06*** / 9 / .94 / .91 / 170.26*** / 9 / .91 / .95 / 182.84*** / 9 / .91 / .84
EXT + I / 264.33*** / 5 / .76 / .53 / 532.44*** / 5 / .50 / .00 / 330.51*** / 5 / .73 / .46

Note.T1=first measurement occasion; T2=second measurement occasion; T3=third measurement occasion; χ2=chi-square statistic; df=degrees of freedom; CFI=Comparative Fit Index; TLI=Tucker Lewis Index; INT=Internalizing problems; EXT=Externalizing problems; ES=Emotional stability; E=Extraversion; B=Benevolence; C=Conscientiousness; I=Imagination. All HiPIC scales are reversed.

Supplement 8

Mean Item Response Theory Model Parameter Estimates for T1, T2 and T3 After Removing Problematic Items According to Conceptual Procedure

Model / Measurement occasion / Discrimination / Difficulty
Threshold 1 / Threshold 2
M / SE / M / SE / M / SE
INT + ES / T1 / CBCL_INT / .80 / .04 / .38 / 1.50 / 2.93 / 3.5
HiPIC_ES / .85 / .03 / -.27 / 1.33 / 1.11 / 2
1.05 / .35 / .45
T2 / CBCL_INT / .80 / .05 / 2.38 / 1.60 / 3.16 / 4.6
HiPIC_ES / .84 / .03 / -.31 / 2 / 1.20 / 2.33
.69 / 1.24 / .37
T3 / CBCL_INT / .79 / .04 / 1.66 / 2 / 3.41 / 6.75
HiPIC_ES / .79 / .03 / -.39 / 2 / 1.34 / 2.33
0 / .81 / .27
INT + E / T1 / CBCL_INT / .78 / .04 / 1.53 / 1.5 / 3 / 3.5
HiPIC_E / .63 / .04 / -2.22 / 1.75 / -.17 / 1.25
2.34 / 1.4 / .87
T2 / CBCL_INT / .79 / .05 / 1.61 / 1.60 / 3.20 / 4.6
HiPIC_E / .64 / .04 / -2.03 / 2 / -.11 / 1.5
2.15 / 1.21 / .71
T3 / CBCL_INT / .76 / .05 / 1.72 / 1.6 / 3.55 / 5.4
HiPIC_E / .64 / .04 / -2.08 / 2 / -.06 / 1.5
1.72 / 1.26 / .67
EXT + ES / T1 / CBCL_EXT / .87 / .07 / 1.67 / 1.86 / 2.75 / 2.14
HiPIC_ES / .87 / .05 / -.26 / 1 / 1.08 / 1.2
0 / 1.29 / .96
EXT + B / T1 / CBCL_EXT / .80 / .05 / 1.81 / 1.6 / 2.99 / 3
HiPIC_B / .72 / .03 / -2 / 2.33 / -.14 / 1.67
1.4 / .95 / .96
T2 / CBCL_EXT / .98 / .02 / 1.68 / 5.5 / 2.72 / 12
HiPIC_B / .74 / .03 / -1.96 / 3 / -.26 / 2
4.63 / .62 / .41
T3 / CBCL_EXT / .91 / .03 / 1.55 / 2.67 / 2.81 / 7.33
HiPIC_B / .78 / .03 / -1.90 / 3 / -.33 / 2
2.44 / .65 / .61
EXT + C / T1 / CBCL_EXT / .57 / .07 / 2.54 / 1.14 / 4.19 / 2.14
HiPIC_C / .75 / .03 / -1.19 / 2 / .80 / 1.67
3.07 / 1.28 / 1.27
T2 / CBCL_EXT / .84 / .06 / 1.96 / 1.83 / 3.18 / 4
HiPIC_C / .75 / .03 / -1.28 / .43 / .31 / 2
.73 / 2.66 / .79

Note.T1=first measurement occasion; T2=second measurement occasion; T3=third measurement occasion; INT=Internalizing problems; EXT=Externalizing problems; ES=Emotional stability; E=Extraversion; B=Benevolence; C=Conscientiousness; I=Imagination. All HiPIC scales are reversed. Effect sizes are printed in italic.

Supplement 9

Mean Item Response Theory Model Parameter Estimates for T1, T2 and T3 After Removing Problematic Items According to Empirical Procedure

Model / Measurement occasion / Discrimination / Difficulty
Threshold 1 / Threshold 2
M / SE / M / SE / M / SE
INT + ES / T1 / CBCL_INT / .76 / .03 / 1.15 / 1.67 / 3.16 / 5
HiPIC_ES / .84 / .02 / -.27 / 2.5 / 1.04 / 2.50
2.27 / .59 / .37
T2 / CBCL_INT / .75 / .04 / 1.32 / 1.75 / 3.28 / 4.75
HiPIC_ES / .84 / .03 / -.30 / 2 / 1.14 / 2.33
1.88 / .71 / .40
T3 / CBCL_INT / .66 / .04 / 1.59 / 1.75 / 3.82 / 5.5
HiPIC_ES / .82 / .03 / -.39 / 2 / 1.20 / 2.33
3.35 / .86 / .42
INT + E / T1 / CBCL_INT / .75 / .03 / 1.16 / 1.67 / 3.2 / 5
HiPIC_E / .65 / .03 / -2.02 / 2.33 / -.18 / 1.67
2.18 / .93 / .91
T2 / CBCL_INT / .77 / .04 / 1.29 / 1.75 / 3.19 / 4.75
HiPIC_E / .64 / .04 / -1.94 / 1.75 / -.11 / 1.25
2.13 / 1.21 / 1.81
T3 / CBCL_INT / .73 / .04 / 1.44 / 1.75 / 3.45 / 5.5
HiPIC_E / .67 / .04 / -1.88 / 2 / -.07 / 1.5
.98 / 1.11 / .92
EXT + B / T1 / CBCL_EXT / .85 / .03 / 1.41 / 2 / 3.16 / 7.67
HiPIC_B / .78 / .02 / -1.82 / 3.5 / -.31 / 2.5
1.87 / .54 / .59
T2 / CBCL_EXT / .92 / .03 / 1.45 / 2.67 / 3.14 / 10.33
HiPIC_B / .80 / .03 / -1.85 / 3 / -.36 / 2
2.26 / .63 / .54
T3 / CBCL_EXT / .91 / .03 / 1.55 / 3 / 2.81 / 7.33
HiPIC_B / .78 / .03 / -1.90 / 3 / -.33 / 2
2.44 / .65 / .61
EXT + C / T1 / CBCL_EXT / .69 / .04 / 1.74 / 1.5 / 3.90 / 5.75
HiPIC_C / .74 / .03 / -1.24 / 2 / .43 / 1.67
1.04 / 1.01 / .85
T2 / CBCL_EXT / .82 / .05 / 1.62 / 1.6 / 3.52 / 6.2
HiPIC_C / .73 / .03 / -1.08 / 2.33 / .29 / 2
1.75 / .79 / .71

Note.T1=first measurement occasion; T2=second measurement occasion; T3=third measurement occasion; INT=Internalizing problems; EXT=Externalizing problems; ES=Emotional stability; E=Extraversion; B=Benevolence; C=Conscientiousness; I=Imagination. All HiPIC scales are reversed. Effect sizes are printed in italic.