Resources - CEA
Software
HSGen | Hierarchical Score Generator |
IRTEQ | Windows application that implements IRT scaling and equating |
IRT Software | Reference list of software for IRT analyses with descriptions and features |
IRT Software - non-commercial | Reference list of non-commercial software for IRT analyses |
Test Dimensionality Software | Reference list of software packages for assessing test dimensionality |
MSTGen | Simulated data generator for multistage testing |
ResidPlots2 | Software for IRT graphical residual analysis |
SimulCAT | Windows application that simulates computerized adaptive test administration |
STDIF | Program to compute standardization DIF indices (User Guide) |
WinGen3 | Windows software that generates IRT parameters and responses |
SAS | Commercial software |
SPSS | Commercial software |
Scientific Software International | Commercial software |
Lahey Fortran | Commercial software |
MAPT-CCR Technical Manual
Over the 13-year history of the operational MAPT testing program, the test has undergone several critical iterations, presently culminating in the MAPT-CCR. The MAPT-CCR for Mathematics and for Reading are assessments that are directly targeted to the instruction that adult learners in Massachusetts receive, and learners' proficiency is evaluated against national proficiency standards developed by the U.S. Department of Education (DAEL, 2016).
In this Technical Manual, we have compiled psychometric evidence - drawn from a wide variety of sources and data analysis methods including surveys, studies involving expert judgment, simulations, and other qualitative and quantitative analyses - to make a convincing argument for the high technical quality of the MAPT-CCR as a measure of AE learners' knowledge and skills in mathematics and reading, relative to their progress in meeting educational goals. The data and processes presented here illustrate the ways in which the content of the MAPT-CCR is aligned to the College and Career Readiness Standards for Adult Education (CCRSAE; Pimentel, 2013) and the NRS EFLs, and that the utmost care is taken in test construction and maintenance procedures, from item development and review, through calibration and scaling, to standard setting and operational procedures and score interpretation. The MAPT-CCR adheres to the very best practices in testing as defined by the Standards for Educational and Psychological Testing (AERA et al., 2014)
At the same time, educational test development and test evaluation are dynamic processes. As more adult learners take these assessments and we continue to evaluate the MAPT-CCR, we will continue to study the data and learn more about the MAPT-CCR's utility for instructional and accountability purposes. Our goal, as it has always been, is to continuously improve the MAPT-CCR to help serve the assessment needs of adult learners and educators in Massachusetts.
The MAPT-CCR assessments are important components of the curriculum, instruction, assessment, and accountability activities in Massachusetts that are key to learners' success in reaching their educational goals. By keeping the assessment process collaborative among the field of AE educators, the Massachusetts Department of Elementary and Secondary Education, the test developers, and the learners themselves, it is our belief that these exams will continue to meet the assessment needs of adult educators throughout the commonwealth.
Citation: Zenisky, A. L., Sireci, S. G., Lewis, J., Lim, H., O'Donnell, F., Wells, C. S., Padellaro, F., Jung, H. J., Banda, E., Pham, D., Hong, S. E., Park, Y., Botha, S., Lee, M., & Garcia, A. (2018). Massachusetts Adult Proficiency Tests for College and Career Readiness: Technical Manual. Center for Educational Assessment research report No. 974. Amherst, MA: Center for Educational Assessment.
Statistical Consulting Services
Students and faculty from the UMass Center for Educational Assessment (Psychometric Methods, Educational Statistics, and Research Methods degree programs) are available for consultation free of charge.
Visit Statistical Consulting Services for more information.
Areas of Expertise:
- Research Design
- Drawing Samples
- Modes of Data Collection
- Reliability & Validity studies
- Survey Development
- Interpretation and Presentation of Results
- Regression or ANOVA Analysis
- Multivariate Analysis
- Factor Analysis
- Power Analysis
- Longitudinal and Multi-Level Data Analysis
- Structural Equation Models
- Statistical Software Support including Excel, SPSS, SAS, Mplus, and R