The Reliability of the SASSI-3; A
Summary
February 10, 2000
Sample
These
findings are based on the results of 2,646 respondents.
All of these participants had scored satisfactorily on a
measure designed to identify individuals who did not
respond to the SASSI-3 items in a meaningful manner
(i.e., the "Random Answering Pattern" [RAP]
scale of the SASSI-3). The majority of this sample (74%)
consisted of clients from a variety of treatment programs
throughout the country, including addictions treatment
centers, a psychiatric hospital, a dual diagnosis
hospital (substance abuse and psychological), a sex
offender treatment program and a vocational
rehabilitation program. A small percentage of these
subjects (2%) were prisoners in a country detention
center or members of a group who responded to newspaper
ad requesting subjects with a family history of alcohol
use. The remaining participants (24%) were from a number
of non-treatment settings, such as colleges and nursing
schools. Sixty-two percent of the total sample was male.
Fifty-nine percent of the sample was Caucasian, 22% was
African-American, and 11% was Native American. Forty-four
percent reported never being married, whereas 29% were
married and 23% divorced. The average age of this group
was 32, and the average educational level was twelfth
grade. Thirty-four percent of the sample (n = 888) had
been interviewed and diagnosed by a trained clinician. Of
those interviewed, 80% were diagnosed as having some type
of substance use disorder.
Overall
and Scale Reliability
Table
1 displays alpha coefficients for the SASSI-3 and its
subscales. The coefficient alpha value for the SASSI-3
inventory was found to be .94 (see table 1). Test-retest
coefficients obtained with a sample of 40 other
respondents ranged from .92 to 1.00 (see table 2). The
time between administrations of the test ranged from one
to two weeks. It is important to recognize that the
scales of the SASSI-3 were developed with the primary
purpose of maximizing security. Items that contributed
substantially to the accuracy of the SASSI-3 were
incorporated into the questionnaire regardless of their
impact on traditional measures of internal consistency
(e.g., coefficient alpha) or on the dimensionality (i.e.,
the number of general characteristics assessed by a
measure) of the scales. The coefficient alpha statistic
(a statistic based on the average correlation among items
and the number of items that is used to estimate the
internal consistency of a unidimensional measure) is
therefore of little importance for the scales of the
SASSI-3 that were not designed to be unidimensional in
nature.
Validity
of Classifications on the SASSI-3
The
results of the SASSI-3 were compared to the diagnoses
obtained from clinicians. A correspondence rate (i.e.,
accuracy rate) of 93.8% was obtained (see table 3). The
sensitivity rate of the SASSI-3 (i.e., the percentage of
respondents diagnosed as having a substance-related
disorder who were identified as such by the SASSI-3) was
94.1% (see table 3). The specificity rate (i.e., the
percentage of respondents diagnosed as not having this
type of disorder who were classified as such by the
questionnaire) was 92.7% (see table 3).
To
further evaluate the construct validity of the SASSI-3,
the relationships of the inventory with a number of other
criteria were examined. These analyses generally
supported the premise that the SASSI-3 measures the
likelihood of having a substance use disorder. For
example, the SASSI-3 was found to be related to clinical
diagnoses of substance abuse history. Ninety-nine percent
of those testing positive on the SASSI-3 were evaluated
by a clinician as having abused alcohol and/or one or
more illicit drugs (although not necessarily currently
having a substance-related disorder). In contrast, only
20% of those testing negative on the SASSI-3 were
diagnosed as having abused some substance (chi-squared
(1) = 185.53,p<.001). The SASSI-3 was also
associated with self reports of alcohol and drug-related
arrests (t = 3.96,p<.001), the number of
illicit drugs used (t = 3.51,p<.001),
the number of drinks typically consumed per occasion (t
= 5.96,p<.001), and the frequency of
intoxication in a typical month (t = 5.61,p<.001)
(see table 4). Furthermore, participants identified by
the SASSI-3 as being at high risk of having a substance
use disorder reported feeling significantly more
depressed and suicidal than others (ts =
3.88 and 3.35 respectively, ps ¸.001, see
table 4). Conversely, classifications on the SASSi-3 were
found to be disassociated with a number of theoretically
unrelated variables such as scores on intelligence,
reading, verbal comprehension and arithmetic tests (see
table 4).
Conclusion
These
results indicate that the SASSI-3 is a reliable and valid
measurement tool and support its use for clinical
assessment. The SASSI-3 demonstrated acceptable internal
consistency and test-retest reliability, and was found to
correspond highly with independent clinical diagnoses.
The SASSI-3 was also associated with theoretically
related criteria (e.g., substance-related arrests and the
number of illicit drugs used) but disassociated with
theoretically unrelated criteria (e.g., intelligence,
reading and arithmetic tests).
The S.A.S.S.I. Institute
SASSI-3 Accuracy In Identifying Use
Disorders As A Function Of Ethnic Group
| Data
Source |
Prevalence
Of Disorder |
Sensitivity |
Specificity |
PPP |
NPP
|
Overall
Accuracy |
| Combined
Sample (n=839) |
80 |
94 |
94 |
98 |
80 |
94 |
| Caucasian
(n=428) |
76 |
92 |
96 |
99 |
79 |
93 |
| African
American (n=151) |
86 |
93 |
90 |
98
|
68 |
93 |
| Hispanic
(n=50) |
78 |
92 |
91 |
97 |
77 |
92 |
| Other/Unknown
Ethnicity (n=210) |
81 |
98 |
92 |
98 |
92 |
97 |
Note: All figures are percentages.
- Prevalence
= Rate of clinically diagnosed substance use
disorders in the given sample;
- Sensitivity
= Percentage of those diagnosed with a substance
use disorder who tested positive on the SASSI-3;
- Specificity
= Percentage of those diagnosed as not having a
substance use disorder who tested negative on the
SASSI-3;
- PPP
= Positive Predictive Power = Percentage of
those who tested positive, who also were
diagnosed with a substance use disorder;
- NPP
= Negative Predictive Power = Percentage of
those who tested negative, who were also
diagnosed as not having a substance use disorder;
- Overall
Accuracy = Rate of correctly classifying both
those who were and those who were not diagnosed
with a substance use disorder.
A
logistic regression analysis revealed that the
racial/ethnic group did not have a statistically
significant impact on the accuracy of the SASSI-3.
(Improvement X2 = .13,p = .99)
Table
1
Alpha Coefficients for the SASSI-3 and its Subscales
Scale or Measure
SASSI-3 overall
FVA
FVOD
SYM
OAT
SAT
DEF
SAM
FAM*
COR*
N = 2.646
|
Alpha
.94
.94
.96
.85
.73
.29
.63
.58
.42
.79
|
*Scale is not used to
classify respondents
|
Table
2
Test-Retest Coefficients for the Subscales of the
SASSI-3*
Scale
FVA
FVOD
OAT
SAT
DEF
SAM
FAM*
COR*
|
Test-Retest
Coefficient
1.00
1.00
.94
.92
.97
.95
.94
.96
|
N = 40
*The SYM scale is not included in this table
because some of the SYM items were not included
in the version of the SASSI completed by the 40
respondents.
*Scale is not used to classify respondents |
FVA = Face Valid
Alcohol; FVOD = Face Valid Other Drugs; SYM
= Symptoms; OAT = Obvious Attributes
SAT = Subtle Attributes; DEF
= Defensiveness; SAM = Supplemental
Addiction Measure
FAM = Family Versus Controls; COR
= Correctional
Table 3
The Correspondence of Classifications on the SASSI-3 to
Clinical
Diagnosis of the Presence of a Substance Use Disorder
Clinical Diagnosis
|
Classification on the
SASSI-3
|
| Likely to have a substance use
disorder |
Not likely to have a substance
use disorder |
| Substance
use disorder |
668 |
42 |
| No
substance use disorder |
13 |
165 |
| Correspondence Rate = |
____668+165___
668+42+13+165
|
=
93.8% |
| Sensitivity Rate = |
___668___
668+42
|
=
94.1% |
| Specificity Rate = |
___165___
13+165
|
=
92.7% |
Table 4
T-Tests: Means on Theoretically Related and Unrelated
Criteria
by Classification Status on the SASSI-3
SASSI-3 Positive
|
|
SASSI-3 Negative |
Theoretically
Related Criterion
|
Mean
|
SD
|
N
|
Mean
|
SD
|
N
|
t
|
| Number of times arrested for
incidents related to drugs and/or alcohol |
3.29
|
3.27
|
153
|
1.80
|
1.20
|
20
|
3.96*
|
| Total
number of times arrested as an adult |
9.22
|
14.05
|
253
|
1.86
|
1.22
|
7
|
7.39* |
| Number of illicit drugs used |
3.38
|
4.66
|
114
|
1.43
|
1.28
|
14
|
3.51* |
| Number
of drinks typically consumed per occasion |
6.70
|
3.94
|
50
|
3.05
|
2.21
|
75
|
5.96*
|
| Number of times drunk in a typical
month |
5.04
|
3.97
|
50
|
1.46
|
2.64
|
76
|
5.61*
|
Frequency
of feelings of depression in the past year
(1=not at all;5=all the time) |
3.66
|
1.21
|
290
|
2.85
|
1.41
|
40
|
3.88*
|
| Extent to which person sees self as
suicidal (1=not at all;5=extremely suicidal) |
1.66
|
1.08
|
287
|
1.22
|
.73
|
41
|
3.35*
|
| |
|
SASSI-3 Positive
|
SASSI-3 Negative |
Theoretically
Unrelated Criterion
|
Mean
|
SD
|
N
|
Mean
|
SD
|
N
|
t
|
| WAIS-R Total IQ |
87.94
|
9.88
|
115
|
87.47
|
12.60
|
89
|
.30
|
| WRAT-3 Reading |
91.03
|
10.66
|
98
|
91.01
|
12.10
|
82
|
.01
|
| WAIS-R Verbal Comprehension |
6.54
|
2.19
|
112
|
6.69
|
2.34
|
89
|
-.47
|
| WRAT-3 Spelling |
93.16
|
14.91
|
102
|
93.08
|
15.91
|
84
|
.03
|
| WAIS-R Verbal Arithmetic |
8.09
|
2.57
|
109
|
7.71
|
3.02
|
90
|
.96
|
| WAIS-R Performance IQ |
90.27
|
11.48
|
113
|
88.39
|
13.54
|
90
|
1.07
|
*p < .001
WAIS-R = Revised Wechsler Adult Intelligence
Scale IQ =
Intelligence Quotient
WRAT-3 = Wide Range Achievement Test (3rd
Version)
|
|