Data-Based Decision Making and Accountability · 3 min read
Foundations of Assessment in School Psychology · Psychometric Principles · Cognitive Assessment
School psychologists function as assessment specialists within educational settings. Data-based decision making represents the cornerstone of effective school psychology practice, requiring practitioners to collect, analyze, and interpret multiple data sources to inform educational and psychological decisions.
Assessment serves several primary purposes in school psychology: screening and identification, diagnosis and classification, intervention planning, progress monitoring, and program evaluation. Each purpose demands different assessment approaches, tools, and interpretive frameworks.
The assessment process begins with clearly defined referral questions. Vague referral concerns such as "not performing well" must be operationalized into measurable, observable terms. Effective school psychologists translate broad concerns into specific hypotheses that can be tested through systematic data collection.
Reliability refers to the consistency of measurement across time, raters, items, or forms. Test-retest reliability examines score stability over time. Inter-rater reliability measures agreement between different scorers. Internal consistency reliability assesses the homogeneity of items within a test. Alternate forms reliability compares scores across equivalent test versions.
Reliability coefficients range from 0 to 1.0, with values of .80 or higher generally considered adequate for individual decision making. Standard error of measurement (SEM) quantifies the expected variability in scores due to measurement error and is essential for constructing confidence intervals around obtained scores.
Validity addresses whether a test measures what it purports to measure. Content validity examines whether test items adequately sample the construct domain. Criterion-related validity assesses the relationship between test scores and external criteria, either concurrently or predictively. Construct validity evaluates whether the test measures the theoretical construct it claims to measure, incorporating convergent and discriminant evidence.
Test bias occurs when systematic differences in test performance exist between groups that are unrelated to the construct being measured. Bias can manifest in item content, test structure, or predictive relationships. School psychologists must evaluate tests for potential bias when assessing diverse populations.
Cognitive assessment measures intellectual functioning, processing abilities, and related cognitive constructs. Contemporary cognitive assessment reflects theoretical advances in understanding intelligence as multidimensional rather than unitary.
The Cattell-Horn-Carroll (CHC) theory represents the dominant framework for understanding cognitive abilities. CHC theory organizes cognitive abilities hierarchically, with general intelligence (g) at the apex, broad abilities at the second stratum, and narrow abilities at the third stratum. Broad abilities include fluid reasoning (Gf), crystallized intelligence (Gc), short-term memory (Gsm), long-term storage and retrieval (Glr), visual processing (Gv), auditory processing (Ga), processing speed (Gs), and quantitative knowledge (Gq).
Major cognitive assessment instruments include the Wechsler Intelligence Scale for Children (WISC-V), Stanford-Binet Intelligence Scales (SB5), Kaufman Assessment Battery for Children (KABC-II), Woodcock-Johnson Tests of Cognitive Abilities (WJ-IV COG), and Differential Ability Scales (DAS-II). Each instrument reflects different theoretical orientations and provides varying composite structures.
Interpretation of cognitive assessment results requires integration of quantitative scores with qualitative observations, background information, and other data sources. Score interpretation should consider confidence intervals, base rates, and clinical significance rather than relying solely on standard scores.
Finished reading?
Lock it in with a quick Data-Based Decision Making and Accountability quiz.