Assessment Commons

Assessment Commons

General Resources

Association for the Assessment of Learning in Higher Education (AALHE)

AALHE (Association for the Assessment of Learning in Higher Education)

  • A professional association for higher education assessment practitioners, AALHE became available to the assessment community in spring 2010.
  • Some website features are restricted to AALHE members, some are available to the public (the list below indicates which features are restricted). The site includes:
    • Information about AALHE and about joining AALHE.
    • Links to other assessment resources and to presentations from previous AALHE conferences. (See the Resource Room.)
    • Opportunities for interaction about assessment issues, via topic-specific webinars, and on the ASSESS discussion list. (Webinar participation is restricted to AALHE members. The ASSESS list is available to the public in the Resource Room.)
    • Intersection, a quarterly online publication, is restricted to members.
    • Information about & from AALHE’s events (annual conferences, Twitter chats, & webinars. Twitter chats & webinars are restricted to AALHE members. Presentations from previous conferences are open to the public in the Resource Room.)

ACT

ACT

  • Surveys and assessment tools for colleges & universities.
  • Links to information about other ACT tools for higher education.

American Evaluation Association

American Evaluation Association

  • Resources for and information about assessment & evaluation in many contexts, including education & higher education. See About Us.
  • Community resources
    • EVALTALK online discussion list.
    • The public e-library includes a daily blog and (pdf and Powerpoint files) materials from AEA conference presentations.
    • Discussion forums for AEA members.

American Society for Quality: Education Division

American Society for Quality: Education Division

  • A division of ASQ, the national organization for the application of quality control in business and industry.
  • K-12 as well as higher education.
  • Some articles in the Division’s online journal Quality Approaches in Higher Education deal with assessing student learning outcomes. Some issues of its Higher Education Brief focus on assessment & accountability; recent issues are available to the public.

Assessing Administrative and Support Units

Assessing Administrative and Support Units

Assessing Assessment: In Academe

Assessing Assessment: In Academe, from AAUP.

  • The first four feature articles in this issue deal with assessment.

Assessing Online Education

Assessing Online Education

  • In the ASSESS discussion-list archive, see the
    • January thread CAAP test for online and other students, initiated by Cyndi Walljasper.
    • January 2016 thread Online Course Evaluations, initiated by Lynne Crosby.
    • April 2016 thread Online Course Evaluation Platforms, initiated by Crystal Braden.
  • College Choices for Adults
    • Note: The College Choices for Adults project ended early in 2013 and the website was closed.
    • The website included data from institutions that stress online programs, including engagement (NSSE) and alumni satisfaction results. Program-level information included learning outcomes and assessment methods.
    • From the Transparency By  Design initiative.
  • NILOA Occasional Paper: Assessing Learning in Online Education: The Role of Technology in Improving Student Outcomes (pdf file).
  • Quality Matters rubric for online & blended courses. Access to the full rubric requires a subscription (see subscriptions in the right-hand menu).
  • SmarterMeasure’s assessment of readiness for online learning.

Assessing Service Learning

Assessing Service Learning

Assessment Committees

Assessment Committees

  • ASSESS discussion-list threads on committee structure and function (see the list archive):
    • March 1999 thread Faculty Committees, initiated by Suzanne Decamp.
    • September 2003 thread Course Releases for Faculty on Assessment Committees? initiated by Tiffany Phagan.
    • October 2005 thread Committee Structure, initiated by David Gordon.
    • November 2007 thread Institutional Assessment Committee, initiated by Erin Frew. Note Erin’s 11/22/07 summary of responses.
    • February 2009 thread Assessment Committees? initiated by Charles Patrick.
    • May 2010 thread University Assessment Committee, initiated by Jerald Henderson.
    • September 2010 thread Relationship of Assessment Committee and Academic Policies Committee, initiated by David Knopp.
    • March 2013 thread An Organizational Question, initiated by Daryl Stevenson, and the associated threads An Organizational Question–Larger Institutions? and Organizational Question.
    • July 2013 thread Assessment Committees, initiated by Leah Adams-Curtis, and her follow-up posts Summary of Responses for Assessment Committee and Summary of Assessment Committee Information.
    • July 2015 thread Assessment Committees initiated by Kimberly Fath.
    • May 2016 thread Overseeing Assessment at the Institutional Level, initiated by Kristin Buscher.
  • Periodic assessment reports (often received and responded to by an assessment committee).
    • In the ASSESS discussion-list archive, see the
      • October 2010 thread Rubrics to Evaluate Quality of Assessment, initiated by Keston Fulcher.
      • September 2011 thread Faculty Evaluation of Annual Assessment Reports, initiated by Donna Vinton.
      • January 2012 thread Dean’s Role in Reviewing Assess Reports, initiated by Kathleen Morley.
      • May 2012 thread Assessment Report Review Process, initiated by Erin Frew.
      • July 2012 thread Administrative Responses to Annual Assessment Reports and Program Review, initiated by Shawna Lafreniere.
      • February 2013 thread Rubric for Evaluating the Quality of Assessment Plans, initiated by Shawna Lafreniere.
      • July 2013 thread Discovering Plagiarism During Juried Evaluations? initiated by Chris Duke.
      • June 2014 thread Timing of Assessment Reporting, initiated by Leah Adams-Curtis.
      • September 2014 thread External Review of Program Assessment Plans/Annual Reports, initiated by Ying Xiong.
      • May 2016 thread Dark Assessment, initiated by Mary Herrington-Perry.
    • What should departments report, and to whom? In the ASSESS discussion-list archive, see the:
      • October 1999 thread Who Collects Reports? initiated by Jane Thayer.
      • July 2009 thread What’s in Your Annual Assessment Reports? initiated by Pat Williams.
      • March 2010 thread Posting Assessment Docs, initiated by Jayne Swanson.
      • January 2014 thread Trend of Sharing Assessment Results/Reports Online, initiated by Norma Mora¡n.
      • September 2014 thread Program Assessment Outcomes and Objectives, initiated by Deborah Armstrong.
      • November 2015 thread Assessment versus Accreditation Compliance, initiated by Sharon Walters.
      • December 2015 thread Program Learning Outcomes, initiated by Susan Warner.
      • December 2015 thread Is ‘Earn a passing score on the national exam’ really a student learning outcome?, initiated by Mary Herrington-Perry.

Assessment Grants

Assessment Grants

Assessment Humor

Assessment Humor

Assessment Information for Students

Assessment Information for Students

  • Use your browser’s (F)ind function to search the individual institutions’ assessment sites for the phrase “for students”.
  • In the ASSESS discussion-list archive, see the
    • May 2012 thread Feedback for Students, initiated by Allison Ostrowski.
    • May 2012 thread Informational Assessment Statements and Student Consent Procedures, initiated by Elise Martin.
    • July 2013 thread How Do You Get Students Interested in Assessment, initiated by Christopher Childs.
    • June 2015 thread Information for Students initiated by Elizabeth Prude.

Assessment and Institutional Review Boards (IRBs)

Assessment and Institutional Review Boards (IRBs)

  • How IRBs interpret the federal regulations on research with human subjects varies from campus to campus.
    • In the ASSESS discussion-list archive, see the:
      • November 1999 thread IRB Letters, initiated by Jamie Young.
      • October 2001 thread IRB Approval, initiated by Kevin Kinser.
      • January 2002 thread  IRB Approval and Assessment Instruments, initiated by Barry Jenkins.
      • August 2004 thread IRB is, initiated by Edward Grandpre.
      • September 2004 threads External Survey Requests and Passions Aside, IRB is Necessary, initiated by Karen Widbin and Mark Davenport.
      • September 2005 threads Policy About Use of Assessment Results for Personal Research Activities and Use of Assessment Results, initiated by Karen Widbin and Alan DuPont.
      • April 2007 thread On Assessment and IRB, initiated by Marsha Watson.
      • August 2009 thread IRB, initiated by Valerie Taylor.
      • April 2010 thread IRB’s and Educational Research, initiated by Curt Naser.
      • November 2010 thread Institutional Review Board & Assessment, initiated by Melanie Booth.
      • February 2011 thread An Bit of Friday Afternoon Diversion, initiated by Lea Campbell, and the follow-up threads An Bit of Friday Afternoon Diversion…Which has Spilled Over in to the Weekend and Monday Morning as well… and An Bit of Friday Afternoon Diversion – Now Bleeding into Tuesday. This request for information about institutions’ assessment climate became an extended discussion of assessment & IRBs.
      • October 2011 thread Asmt Ethics, initiated by Joan Hawthorne, and the related post Further Consideration Regarding Assessment Ethics. The main thread includes discussions of ethical standards for assessment and how institutional review boards (IRBs) deal with assessment activities.
      • September 2012 thread Student Services Assessment for Decision Making and IRB Approval, initiated by Brad Patterson.
      • May 2013 thread Assessment Data and Permissions, initiated by Vanessa Vacchiano.
      • May 2014 thread Publishing Assessment Results, initiated by Susan Warner.
      • June 2014 thread Request for Raw Student Engagement Survey Data, initiated by Laura Massell.
      • September 2014 thread IRB and Assessment of Student Learning, initiated by Carrie Nepstad.
      • November 2014 thread Survey Question, initiated by Susan Warner.
      • July 2015 thread Coordinating Survey Research with IRB, initiated by Vennessa Walker.
  • Related policy issues
    • In the ASSESS discussion-list archive, see the December 2010 thread Policy Language: Collecting Student Work for Program Assessment, initiated by Melanie Booth.

Assessment Journals

Assessment Journals

Assessment and Learning: State of the Field Review

Assessment and Learning: State of the Field Review

  • About educational assessment in general, K-12 as well as higher ed and in UK, European, & far eastern education systems as well as in the U.S. (the review was written to inform Norwegian policy context).
    • A good source of information about “assessment” terminology & concepts — how terms & concepts developed, how they’re used in various theoretical & educational systems, and confusions that can result from overlapping usages.
    • Most of the theoretical & definitional literature reviewed deals with the theoretical underpinnings of various approaches to assessment and to relationships among assessment, learning, pedagogy, & policy.
    • Most of the research literature reviewed deals either with small-scale action-oriented studies in K-12 situations or with the large-scale OECD international tests; these parts of the review emphasize impacts on learning/pedagogy policy & practice rather than detailed research methods or results.
  • A large pdf file, 174pp including 20 pages of references.

Assessment and Liberal Arts Education: Research on the Outcomes of Liberal Arts Education

Assessment and Liberal Arts Education: Research on the Outcomes of Liberal Arts Education

Assessment Resource Centre

Assessment Resource Centre

  • A joint project of Hong Kong Polytechnic University and the University of Hong Kong.
  • Information about, guidelines for, and issues in assessment and assessment-based pedagogy.
  • Bibliography and links to other resources. Includes resources not usually found in U.S.-based lists.
  • User-contributed assessment-practice examples were not available when last checked.

Assessment Resources

Assessment Resources

Assessment Rubrics

Assessment Rubrics

Association for Educational Assessment – Europe

Association for Educational Assessment – Europe

  • Not limited to higher education.
  • Professional development includes a framework for Standards for Assessment (pdf file).

Association for Institutional Research

Association for Institutional Research

Association of American Colleges & Universities (AACU)

Association of American Colleges & Universities

Automated Essay Scoring

Automated Essay Scoring

Baldridge National Quality Program: Education Criteria

Baldridge National Quality Program: Education Criteria

  • See the National Institute of Standards and Technology (NIST) National Quality Program site for more information about the Malcolm Baldridge National Quality Awards.

Bloom’s Taxonomy

Bloom’s Taxonomy

Centro Nacional de Evaluación para la Educación Superior (Mexico)

Centro Nacional de Evaluación para la Educación Superior (Mexico)

  • Ceneval develops and administers performance exams for college entrance and assessment and for licensing/certification programs.
  • The website includes information about Ceneval’s exams and administration sites. Students can register and view their own results online.
  • Note: Ceneval’s website is in Spanish. Thanks to Phil Schmidt from Western Governors University for translation assistance.

College Portrait

College Portrait, see Voluntary System of Accountability (VSA)

Collegiate Learning Assessment (CLA, CLA+)

Collegiate Learning Assessment (CLA, CLA+)

  • Standardized assessment of general education skills & abilities.
  • Reports emphasize institutional value-added.
  • From the Council for Aid to Education (CAE).
  • CLA+ replaces the CLA and CCLA (Community College Learning Assessment). See supporting materials for a comparison of the old & new versions (pdf file).
  • Catalyst for Change, from the Council of Independent Colleges CLA Consortium, reports CIC members’ experience with the CLA.
  • Information from and about a multi-institution CLA-based longitudinal study of undergraduate learning are available from the Social Science Research Council. The study was the basis for Richard Arum & Josipa Roska’s book Academically Adrift.

Commission on the Future of Higher Education

Commission on the Future of Higher Education 

  • The Commission met during 2005-2006, charged by the U.S. Secretary of Education to develop a national strategy for postsecondary education.
  • Some parts of the final report and some of the issue papers deal with assessment, accountability, and accreditation (pdf files).

Common Education Data Standards (CEDS)

Common Education Data Standards (CEDS)

  • Proposed data definitions for (voluntary) intersystem sharing.
  • A project of the National Center for Education Statistics (NCES). See About CEDS.
  • Select Elements, then Version 3 or Version 4 (Draft). In search, set the domain filter to postsecondary and the change status filter to all.

Community College Survey of Student Engagement (CCSSE)

Community College Survey of Student Engagement (CCSSE)

  • Nationally-normed survey of students’ exposure to good practices in undergraduate education.
  • Information about the project and the survey.
  • About the survey has pdf demonstration versions of the survey.
  • National results summaries.
  • CCSSE is designed for two-year institutions. The National Survey of Student Engagement (NSSE) is a similar project for four-year institutions.
  • Some institutions’ assessment sites include CCSSE reports.

Conferences, Institutes, and Workshops

Conferences: Lists of National, Regional, and International Assessment Conferences, Institutes, and Workshops

Consultants

Consultants

These individuals and groups offer consulting, workshops, etc. to help colleges & universities plan and implement outcomes assessment. Some also offer other services related to assessment. Many of them consult in other higher-education areas as well. This is just a list. It’s not exhaustive and it doesn’t imply a recommendation or evaluation.

Context for Success: Measuring Colleges’ Impact

Context for Success: Measuring Colleges’ Impact

  • Reviews of methods and findings on input-adjusted measurement of college/university effectiveness. Papers and briefs are pdf files.
  • For an overview of the project, and summaries of the reports, select Papers, then Synopsis Paper.
  • Most of the reports focus on enrollment, persistence, graduation, & employment measures. Using student learning as a measure of quality in higher education discusses standardized instruments (CAAP, MAPP, CLA, NSSE).
  • From HCM Strategists, with support from the Bill and Melinda Gates Foundation.

Council for the Advancement of Standards in Higher Education

Council for the Advancement of Standards in Higher Education

  • Information about standards, guidelines, and assessment guides for Student Affairs programs and for graduate & professional programs. The CAS guides/standards can be purchased as books, CDs, or downloadable pdf and RTF files (see the CAS Store).

Council for Christian Colleges & Universities

Council for Christian Colleges & Universities

  • Overview of the Comprehensive Assessment Project.

Course-Based Assessment

Course-Based Assessment

  • In the ASSESS discussion-list archive, see the:
    • September-October 2013 thread Challenges with Course-Embedded Assessment, initiated by Mary Kay Fleming.
    • January 2014 thread Assessment Thresholds and Course Thresholds for Student Performance, initiated by  Peggy Schmidt.
    • May 2016 thread Reporting Course Evaluation Results, initiated by Regina Warfel
  • Classroom Assessment Techniques (CATS)
    • Online version of the Teaching Goals Inventory, from the University of Iowa.
      • See Classroom Assessment Techniques: A Handbook for College Teachers (Angelo & Cross, 1988, 1993, Jossey-Bass) for details on the TGI. The online version was created with the authors’ permission.
  • TooFAST, the current version of the Free Assessment Summary Tool  from Bruce Ravelli at Mt. Royal College.
    • Web survey for student feedback, for classroom assessment during the course of a term.
    • Fully anonymous, no way to tell who has submitted an evaluation, or how often. Not intended as an end-of-term course evaluation whose data become part of the salary, promotion, and tenure process.

Educational Benchmarking, Inc. (EBI)

EBI: Educational Benchmarking, Inc

  • Surveys for assessment in a variety of academic and student services areas. Analyses include comparisons with other participating institutions.
  • When last checked:
    • Academic areas included business/management, engineering, nursing, and teacher education.
    • Student-services areas included diversity, the first-year experience, fraternities/sororities, student housing, and student unions/centers.

Education Commission of the States (ECS)

Education Commission of the States (ECS)

  • This page has abstracts of publications and information about ECS projects in higher education and K-12 assessment, accountability, workplace preparation, and other topics. For publications, select assessment from the list of topics on the reports & databases page.

Educational Testing Service (ETS)

Educational Testing Service (ETS)

  • Information about ETS assessment instruments.
  • Test Link lets you search ETS’s test collection for information about thousands of test and research instruments.

Enrollment, Completion, & Earnings Data

Enrollment, Completion, & Earnings Data

  • Enrollment & Completion
    • California Community Colleges: Student Success Scorecard
      • Statewide or individual community colleges’ demographic profiles and persistence & completion rates.
      • See documentation (in the bottom menu) for methodology & details (pdf files).
    • College Completion
      • Interactive charts & tables of completion rates by sector, state, demographics, & institution characteristics, and for individual institutions.
      • Find a state (or start with the overview & click on a state) & compare with other states’ data.
      • Find a college & compare with other institutions’ data.
      • Data are downloadable as Excel-compatible files. For data sources & definitions, select About this project, then scroll down to About the data.
      • From the Chronicle of Higher Education with support from the Bill and Melinda Gates Foundation.
    • College Results Online
      • Searchable database of graduation rates for four-year colleges and universities. From the Education Trust; based on NCES data.
      • 4, 5, and 6-year rates, plus trends over time and freshman-to-sophomore retention, outbound transfer rates, and gender/ethnicity breakdowns.
      • User-selected group of institutions or individual institution + database-generated comparison group based on institutional characteristics.
    • Complete College America
      • Analyses of completion rates, time to degree, etc. from data provided by 32 participating states plus the District of Columbia.
      • State data: Interactive map of state summaries, with links to (pdf files) detailed reports.
        • The Time is the Enemy report has background, methodology, results, & policy implications (pdf files).
      • Links to related resources.
    • Council of Graduate Schools (CGS)
    • Department of Education/White House College Scorecard posted September 2015.
    • Gates Foundation report on higher education performance measures focus’ on the areas of attendance, persistence and graduation, and post-graduation employment and earnings; learning outcomes “still to be developed”.
    • Lumina Issue Paper: It’s Not Just the Money: The Benefits of College Education to Individuals and to Society.  Mentioned in Teri Lyn Hinds 1-20-16 ASSESS post “Re: [ASSESS:] Inside Higher Ed Article – Psych!”
    • National Student Clearinghouse
      • Chronicle of Higher Education interactive state-by-state breakdown of UG 6-yr graduation rates, from National Student Clearinghouse data.  Unlike IPEDS, NSC data includes both graduated from starting institution and graduated elsewhere: State Graduation Rates.  You will need to be a Chronicle of Higher Ed subscriber to access the report
      • Uses participating institutions’ enrollment data. Services include enrollment verification, Federal enrollment reports, and tracking students’ enrollment across institutions regardless of state and college/university-system boundaries.
      • More than 3,500 institutions participate, ranging from community colleges to Ivy League doctoral/research-extensive universities.
      • The May/June 2009 issue of Assessment Update includes an article on using NSC data as a proxy for a “national enrollment database.”
      • NSC research reports are available to the public (pdf files, see About the Clearinghouse).
        • Starting with the 6th Signature Report (December 2013) includes “nontraditional” persistence/completion rates (part-time enrollment and enrollment at multiple institutions). This InsideHigherEd article has an overview. The state-by-state supplement to the 8th Signature Report was released in February 2015; Chronicle of Higher Education’s interactive table summarizes its data (the online Chronicle article is restricted to subscribers; most college/university libraries subscribe).
      • Signature Report 9 – Transfer & Mobility: A National View of Student Movement in Postsecondary Institutions, Fall 2008 Cohort.
    • The Voluntary Institutional Metrics Project
      • A work in progress, designing measures & dashboard displays for institutional effectiveness.
      • Progress reports and sample dashboard displays are pdf files. Measures developed so far focus on educational cost and on student progress, completion, & employment. Learning outcomes measures are still to come.
      • Current participants are primarily community colleges and/or institutions emphasizing distance education.
      • From HCM Strategists, with support from the Bill and Melinda Gates Foundation.
    • VSA College Portraits include the institution’s enrollment and completion data.
  • Employment & Earnings
    • The Baccalaureate and Beyond Longitudinal Study, from the National Center for Educational Statistics (NCES).
      • Employment and further education, four years after graduation. The most recent reports are based on surveys of the 2008 graduating cohort.
      • Reports & methodology descriptions (pdf files) and some data files are available to the public.
    • Community College Research Center at Columbia University’s Teachers College.
      • A report on community college’s impact on employment and earnings. The report includes data on dropouts, while other reports focus on completers; it’s one state’s data and not a nationwide analysis (it uses 2002-2005 transcript data from North Carolina CC system and the NC unemployment office).
    • Department of Education (DOE) Scorecard
      • The Economist’s rankings of college value (defined as the difference between how much its graduates earn and how much they might have earned if they had studied elsewhere).
      • The Economist 10/31/2015 article includes a summary of results.
      • Georgetown University McCourt School of Public Policy, Center on Education and the Workforce-Rankings adjusted for major and student participation/graduate training.
        • There is a link to the full report which as three tables for median earnings 10 years after graduation; rankings for deviation from expected based on composition of majors in the institution’s undergraduate population; rankings for major adjusted deviation from expected further adjusted for median ACT and likelihood that student would go on to graduate/professional training.
      • Chronicle of Higher Education interview with GU’s center director.
    • Economic Success Metrics, from CollegeMeasures.org, a joint project of the American Institutes for Research and the Matrix Knowledge Group.
      • First-year salaries of graduates from public colleges/universities employed in that state, by institution & program. (See the data limitations and caveats.)
      • Results from Arkansas, Colorado, Florida, Tennessee, Texas, and Virginia are available. CollegeMeasures is working on similar projects with other states.
        • Summaries of the Arkansas and Tennessee results, and a link to Florida’s Beyond Education data site are on the ESM site. AIR has a summary and analysis of Virginia’s results.
    • Florida Education & Training Placement Information Program (FETPIP)
      • First-year quarterly earnings for Florida community college and public university graduates employed in Florida (pdf files).
    • Launch My Career Colorado shows potential earnings (starting, later-career, and median) and job availability by job and career category as well as by institution.
    • National Association of Colleges and Employers (NACE) First-Destination Survey.   The survey captures information regarding how new college graduates fare in their careers within six months of graduation. Contact ekoc@naceweb.org. The executive summary is available now (pdf).  Review of the survey findings is detailed in Ellen Wexler’s June 2016 Inside Higher Ed article, “Class of 2015 Is Finding Work.”
    • National Association of Colleges and Employers (NACE) survey regarding post-college outcomes.  The NACE survey is reviewed by Jacqueline Thomsen in the June 5, 2015 article in InsideHigherEd.  The article has since been archived.
    • Salary Surfer, from the California Community Colleges Chancellor⬔s Office.
      • Earnings of CCC-system graduates employed in California, two years before, two years after, & five years after earning a community college certificate or degree.
      • By program, for the CCC system as a whole rather than for individual colleges.
      • Documentation about measures & methodology.
    • Seek UT (University of Texas system)
      • First- & fifth-year earnings & student debt of UT-system graduates employed full-time in Texas or by the U.S. government, by major area & UT institution.
      • The seekUT tool loads slowly; be patient.
    • State Council of Higher Education for Virginia (SCHEV) Mid-Career Wages Reports
      • Median and mid-range wages up to 20 years after graduation (depending on graduation year) by degree level and discipline category.
      • The summary for 1992-93 graduates is a pdf file; the other reports are html pages.
  • The Economic Benefit of Postsecondary Degrees (pdf files).
    • From the State Higher Education Executive Officers Association (SHEEO).
  • Facilitating Development of a Multistate Longitudinal Data Exchange
  • Issues in Using Enrollment, Completion, & Earnings Data
  • First Destination Survey Standards & Protocols, from the National Association of Colleges and Employers (pdf & Excel files).
    • For colleges & universities to use in collecting & reporting graduating student career outcomes.

Establishing Degree Qualifications

Establishing Degree Qualifications

Establishing Degree Qualifications

Ethical Standards for Assessment

Ethical Standards for Assessment

(Some of these are from a January 2002 Assess-L discussion. Thanks to Suzanne Garrison at Meredith College for initiating this thread.)

ERIC (Education Resources Information Center)

ERIC (Education Resources Information Center)

  • Searchable database with:
    • Bibliographic information for hundreds of articles on assessment, evaluation, statistics, and educational research.
    • Downloadable full text (pdf files) of many non-journal articles.
  • A project of the US Department of Education’s Institute of Education Sciences.
  • See:
    • General search tips.
    • The Thesaurus of search terms.
    • FAQs about the ERIC program.
  • Includes material that was added while the database was closed during 2004.

Faculty Attitudes Towards Outcomes Assessment

Faculty Attitudes Towards Outcomes Assessment

  • In the ASSESS discussion-list archive, see the
    • March 2005 thread Faculty Attitudes Toward Student Learning Outcomes Assessment, initiated by Reuel Barksdale.
    • April 2012 thread Searching for Survey of Faculty Knowledge of Assessment Basics and/or Faculty Attitudes Towards Assessment of Student Learning Outcomes, initiated by Allen Butt.
    • March 2013 thread Chronicle Point of View Piece, initiated by Zaneeta Daver. The online version of the 3/11/13 Chronicle of Higher Education article to which this refers, “Who’s Assessing the Assessors’ Assessors?,” includes readers’ comments that illustrate a wide range of faculty attitudes towards outcomes assessment. The online version of the article is available to Chronicle subscribers and through most college/university libraries.
    • August 2015 thread Chronicle Article-Does Assessment Make Colleges Better? Who Knows?, initiated by Catherine Wehlburg. The online version of the 8/14/15 Chronicle of Higher Education commentary where Erik Gilbert was curious about college’s assessment programs. The online version of the article is available to Chronicle subscribers and through most college/university libraries.
    • October 2015 thread Overcoming Faculty Resistance to Sharing Results, initiated by Marylee Demeter.
  • Developing/fostering positive attitudes and a “culture of assessment”
  • Faculty unions’ statements on outcomes assessment
  • Frequently-encountered objections to outcomes assessment
    • In the ASSESS discussion-list archive, see the discussion Logical Fallacies and Assessment, initiated by Stephen Zerwas.
      • April 2009, Logical Fallacies and Assessment – Straw Dog/Straw Man and the associated threads Assessment and Philosophical Issues (initiated by Steve RiCharde) and Logical Fallacies and Assessment – “red herrings” arguments (initiated by Stephen Zerwas). Posts include philosophical/theoretical discussion, examples of fallacious arguments, and suggestions for dealing with fallacious arguments.
      • August 2009, Logical Fallacies – Kill the Messenger and Kill the Messenger ?? Ad Hominum? Continued, initiated by Stephen Zerwas.
      • November 2015 thread Outcomes vs Outcomes, initiated by JaneMarie Souza.
  • “Our assessment says we’re doing just fine!”

Focus Groups: Methods & Tools

Focus Groups: Methods & Tools

  • In the ASSESS discussion-list archive, see the:
    • April 2010 thread Transcription Services, initiated by Cindy Shedd.
    • February 2012 thread Virtual Focus Groups and Blogs, initiated by Lea Campbell.
    • March 2013 thread Focus Group Resources, initiated by Elizabeth Carney.
    • July 2014 thread Transcription Software, initiated by Susan Warner.

Glossaries: Assessment Terms

Grades as Outcomes Assessment

Grades as Outcomes Assessment

Graduate Program Assessment

Graduate Program Assessment

Graduate Training in Outcomes Assessment

Graduate Training in Outcomes Assessment

Higher Education Resource Hub

Higher Education Resource Hub

  • For assessment resources, select Higher Education Assessment.

Higher Education Research Institute (HERI)

Higher Education Research Institute (HERI)

  • A project of the Graduate School of Education & Information Studies at UCLA.
  • CIRP Surveys: Information about nationally-standardized student surveys.
    • CIRP Freshman Survey: profile of entering freshman class.
    • CSS College Senior Survey: follow-up of CIRP cohorts.
    • YFCY Your First College Year

Impact of Assessment

Impact of Assessment

  • A bibliography of articles about program assessment that include results, from the University of Hawaii at Manoa (pdf file).
    • From Monica Stitt-Bergh’s original July 2013 ASSESS post program assessment articles: sharing and a request: “[Published articles or conference papers with] examples of degree program assessment involving direct assessment of student learning…, preferably peer-reviewed, that include some direct assessment of an academic degree program, include at least one assessment result, and are not only a ‘how-to’ or not just ‘what-we-plan-to-do.’ Completed assessments are what I⬔d like to find.”
    • Some of the articles include descriptions of how assessment results informed program planning.
  • Engineering Change: ABET study of how EC2000 standards and assessment requirements affect Engineering programs and students (executive summary available as pdf file, full report purchasable).
  • ASSESS discussion-list threads on this topic (see the list archive):
    • October 2006 thread Resources on Impact of Assessment on Learning and Teaching, initiated by Sean McKitrick of Binghampton University.
    • August 2007 threads Outcomes to the Assessment Process? initiated by Ken Weiner at Montgomery College, and Assessment in Higher Education, contributed by Richard Hake.
    • April 2008 threads Evidence of Impact of Student Learning Assessment? and Evidence of Impact of Student Learning Assessment, initiated by Lois Myers.
    • September 2009 threads Assessment, Budgeting, & Strategic Planning and [Spam] Re: [ASSESS:] Assessment, Budgeting, & Strategic Planning, initiated by Erin Frew.
    • November 2009 thread 404: Learning Outcomes, initiated by David Eubanks, and David’s blog entry on the topic.
    • March 2010 thread Evidence-Based Studies of Learning Goals, initiated by Mindy McWilliams.

Institutional Support for Outcomes Assessment

Institutional Support for Outcomes Assessment

International Association for Educational Assessment (IAEA)

International Association for Educational Assessment (IAEA)

  • Not limited to higher education.

K-12 Standards and College-Level Work

K-12 Standards and College-Level Work

  • The Common Core State Standards
    • A project of the National Governors Association Center for Best Practices (NGA Center) and the Council of Chief State School Officers (CCSSO), in partnership with the American Association of State Colleges & Universities (AASCU).
    • Objectives include:
      • Aligning K-12 standards with college admission & placement requirements.
      • Preparing K-12 teachers to help students meet the standards.

Knowing What Students Know: The Science and Design of Educational Assessment

Knowing What Students Know: The Science and Design of Educational Assessment

League for Innovation in the Community College

League for Innovation in the Community College: 21st Century Learning Outcomes Project

  • Information about a multi-institution project to define and document student learning outcomes.
  • Links to participating institutions’ project websites and to other resources. The project is no longer active, but some of the institutions’ websites are still available.

National Assessment Governing Board

National Assessment Governing Board

  • Information about the National Assessment of Educational Progress (NAEP). These are assessments of students in grades 4, 8, and 12, not college students. Relevant to assessment in higher education as illustration of a current national model for assessing student learning.
  • The NAEP site has details about and reports from assessments in various subject areas.
  • The U.S. also participates in multinational comparisons of K-12 students’ performance in various areas, sponsored by the International Association for the Evaluation of Educational Achievement (IEA). Recent & upcoming study areas include reading literacy, computer & information literacy, knowledge of math & science, and civic & citizenship education.
  • The Learning Curve, from Pearson and The Economist Intelligence Unit, analyzes a range of internationally-comparable K-12-level data.

National Association of Independent Colleges and Universities (NAICU)

National Association of Independent Colleges and Universities (NAICU)

  • Links to articles and other assessment resources.

The National Center for Higher Education Management Systems (NCHEMS)

The National Center for Higher Education Management Systems (NCHEMS) site has information about publications and services for assessment and other higher-education areas.

  • Assessing Assessment: Successes, Failures, and the Future overviews the state of higher education outcomes assessment (this pdf file will open in a separate window). Presentation by Peter Ewell, NCHEMS vice-president, at the 2007 IUPUI Assessment Institute. Ewell’s chapter An emerging scholarship: A brief history of assessment has details and references (in Banta, T.W. & Assoc. [2002], Building a scholarship of assessment. Jossey-Bass).
  • NCHEMS’ Information Center provides state-by-state comparisons of data related to higher-education issues. Some are outcomes assessment data, most are not.

The National Center for Research on Evaluation, Standards, and Student Testing (CRESST)

The National Center for Research on Evaluation, Standards, and Student Testing (CRESST)

  • UCLA’s Graduate School of Education & Information Studies has papers, technical reports, and links to related sites. Some higher education material; mostly K-12.

National Community College Benchmark Project

National Community College Benchmark Project

  • Participating institutions can compare outcomes results with those of other participants. The data are not available to non-participants.
  • The site includes:
    • A description of the project and the benchmarks used. Some of the benchmarks are outcomes assessment results, some are other institutional research data.
    • A description of the reports prepared for participating institutions.
    • A list of participating institutions and information about enrolling in the project.

National Institute for Learning Outcomes Assessment (NILOA)

National Institute for Learning Outcomes Assessment

  • NILOA’s Excellence in Assessment Designation
  • NILOA focuses on identifying & promoting effective assessment practices.
  • NILOA Resources include:
    • Reports from surveys of college/university outcomes assessment practices.
    • Assessment briefs: Introductions for faculty, student affairs staff, etc.
    • Occasional papers by assessment experts.
    • A transparency framework for institutions’ assessment websites and online presentation of assessment information.
      • The framework in the field section of the Transparency Framework page and the regularly-changing featured website available from the home page illustrate good “transparency” practice.
    • A link to the Measuring Quality inventory of assessment instruments.
  • Information about the Degree Qualifications Profile.
  • The searchable Resource Library includes links & bibliographies on a variety of assessment topics.
  • NILOA Occasional Paper: To Imagine a Verb: The Language and Syntax of Learning Outcomes Statements.
    • From the February NILOA Newsletter.

National Postsecondary Education Cooperative (NPEC)

National Postsecondary Education Cooperative (NPEC)

  • A project of the National Center for Education Statistics (NCES).
  • NPEC student outcomes projects focus on assessment policy, methods, coordination, and/or data use. pdf files of papers from some projects are available.
  • Definitions and assessment methods sourcebooks, for various general education areas.

National Survey of Student Engagement (NSSE)

National Survey of Student Engagement (NSSE)

Nationally Standardized Instruments

Nationally Standardized Instruments

New Leadership Alliance for Student Learning and Accountability

New Leadership Alliance for Student Learning and Accountability

  • The Alliance’s activities were suspended in summer 2013.
  • The documents Committing to Quality: Guidelines for Assessment and Accountability and Assuring Quality: An Institutional Self-Assessment Tool for Excellent Practice in Student Learning Outcomes Assessment are available from CHEA (pdf files).

Online Discussion

Online Discussion

  • Blogs about assessment
  • Discussion lists
    • Subscribing to email discussion lists
      • Send an email message to the list server for the list to which you want to subscribe. The message should say subscribe list-name your-first-name your-last-name (e.g.: subscribe assess John Smith) and have nothing in the Subject: line and no “signature” at the bottom.
      • After you’ve subscribed, send the one-word message help to get a list of commands you can use to suspend mail while you’re on vacation, unsubscribe from the list, etc.
    • ASSESS
      • From AALHE.
      • Topic: assessment in higher education.
      • Listserver: listserv@lsv.uky.edu (University of Kentucky).
      • The searchable archive also has online forms that you can use to join and post to the list.
    • EVALTALK
      • Topic: Assessing the strengths and weaknesses of programs, policies, personnel, products, and organizations to improve their effectiveness. Many threads relevant to outcomes assessment.
      • From the American Evaluation Association.
      • Lots of traffic. To avoid clogging your inbox, have your email program automatically put Evaltalk messages into a separate folder/mailbox.
      • The searchable archive (hosted at the University of Alabama) has an online form you can use to join and post to the list. Note: The UA listserver will ask for a login; registration is available to the general public and is free.
    • Other lists of assessment-related discussion lists <!– Assessment in Higher Education’s page of discussion lists has information about other assessment-related lists. –>
      • The Higher Education Resource Hub’s list of assessment resources has information about other assessment-related lists (select Higher Education Assessment from the menu at the left side of the Hub’s home page and scroll down to Assessment Electronic Discussion Lists).
      • NILOA’s Resources include some assessment discussion lists.

Portfolio Assessment

Portfolio Assessment

  • An extensive list of links to information about alternative assessment and electronic portfolios, from Helen Barrett at the University of Alaska, Anchorage. (Last updated in 2009. Some links are still good, some aren’t.)
  • In the ASSESS discussion-list archive, see the
    • April 2014 thread Best Resources RE: Pros/Cons of Large Scale Eportfolio Implementation, initiated by Kathleen Morley.
    • March 2016 thread ePortfolios, initiated by Beth-Ann Tek.
  • AAEEBL (The Association for Authentic, Experiential, and Evidence-Based Learning)
    • Links to e-portfolio resources.
    • Information about AAEEBL’s annual conference and other networking opportunities.
  • Diagnostic Digital Portfolio at Alverno College. Access to the DDP is restricted to Alverno students, faculty, & staff.
  • Inter/National Coalition for Electronic Portfolio Research: Campus-based research projects on whether & how the use of portfolios affects student learning.
  • International Journal of ePortfolio (IJeP) includes articles about using e-portfolios in assessment. Articles are available as pdf files.
  • Portfolio tips, guidelines, & examples from the University of Kentucky.
  • University of Minnesota’s ePortfolio. Development of the University of Minnesota’s ePortfolio system is described in the 2003 Educause article Electronic Portfolios Need Standards to Thrive (pdf file).
  • Truman State University portfolio project: FAQ, portfolio prompts with descriptors (rubrics, pdf files) for evaluation, and (pdf files) assessment results.
  • University of Minnesota Duluth ePortfolio. See the Getting Started tutorial and the User’s Guide (pdf files), and the link to download the open-source program.
  • Commercial products to manage on-line portfolios (this is just a list; it’s not exhaustive and inclusion doesn’t imply a recommendation or evaluation)
    • See A Survey of the Electronic Portfolio Market Sector by Trent Batson of AAEEBL.
    • Chalk & Wire’s e-Portfolio.
    • Digication’s Assessment Management System includes portfolio tools.
    • DigitalAssess Gain deeper insight by radically improving your understanding of learner’s knowledge with innovative assessment.
    • ePortfolio, from Epsilen.
    • iWebfolio, from Nuventive.
    • Mentor, from Axiom Education, includes a portfolio tool.
    • The PASS-PORT assessment-management system includes a portfolio tool.
    • RXOutcome assessment e-portfolio, for pharmacy programs.
    • Serensoft provides e-portfolio services.
    • TaskStream’s student assessment tools include e-portfolio assessment & management.
    • TK20’s CampusTools HigherEd and CampusWide have portfolio tools as part of a system to gather and organize assessment information. See Products.
    • See Helen Barrett’s list of commercial e-portfolio vendors (a 2009 list, some links will be out of date).
    • In the ASSESS discussion-list archive, select May 2005 and scroll down to Electronic Portfolio Software and Assessment, Renee Corbin’s list of e-portfolio products. Open the message and then click [text/html] at the bottom of the page for a version with “live” (clickable) links.

Principles of Good Outcomes Assessment Practice

Principles of Good Outcomes Assessment Practice 

Program Review and Outcomes Assessment

Program Review and Outcomes Assessment

  • In the ASSESS discussion-list archive, see:
    • The May & July 2009 thread Combining Program Review and Assessment, initiated by Erin Frew.
    • The September 2010 thread Program Reviews – Are They Worth It? initiated by Catherine Wehlburg.
    • The October 2011 thread Program Review Cycles, initiated by Leah Adams-Curtis.

Qualitative Data Analysis Methods and Tools

Qualitative Data Analysis Methods and Tools

  • In the ASSESS discussion-list archive, see the:
    • September 2007 thread Qualitative Data Analysis Question, initiated by Mitzi Lewis. In October 2007, scroll down to the thread Qualitative Data Analysis Question – Summary, for Mitzi’s summary of responses and some more discussion.
    • February 2010 thread Qualitative Software Reviews? initiated by Christopher Vinger.
    • September 2010 thread Question Regarding Qualitative Analysis, initiated by John Painter.
    • May 2012 thread Text Analysis Tools, initiated by Gavin Henning, the associated thread Text Analysis Tools, initiated by Lenny Shedletsky, and Gavin’s follow-up List of Text Analysis Tools.
    • July 2013 thread Seeking Recommendations on Qualitative Data Analysis Software, initiated by Jill Hirt.
  • Content-analysis.de’s annotated links to qualitative analysis software packages and other information about content-analysis methods.
  • See Crafton Hills College’s overview of Sampling for the Assessment of Student Learning Outcomes (pdf file).
  • NILOA Occasional Paper – Improving teaching, learning, and assessment by making evidence of achievement transparent.  From NILOA May newsletter.
    • The paper discusses concepts of validity, external credibility, and “authentic assessment.”

Quantitative Data Analysis Methods and Tools

Quantitative Data Analysis Methods and Tools

  • In the ASSESS discussion-list archive, see:
    • The February 2010 thread Inter-rater Reliability, initiated by Erica Cavanaugh. It developed into extended discussions of (a) statistical methods for evaluating inter-rater reliability and (b) the pros & cons of statistical precision in higher education outcomes assessment.
    • The related March 2010 thread Centering and Rasch Analysis, initiated by David Eubanks, which deals with several issues about using rubrics & analyzing rating-scale results.
    • The November 2010 thread Stats Packages Excel Add-ons, initiated by Kenneth Reaves.
    • The November & December 2010 thread Building Faculty Inter-rater Reliability of Graduate School Candidate Admissions Ratings, initiated by Barbara Shepperson. It developed into a discussion of inter-rater reliability methods & issues. See Jeremy Penn’s November 30 post for a Powerpoint presentation overviewing methods for evaluating inter-rater reliability.
    • The July 2011 thread Inter-rater Reliability, initiated by Daniel Mccollum.
    • The August 2011 thread Unequal Sample Size when Comparing Two Groups, initiated by Wenjun Chi. It developed into a comparison of parametric & nonparametric significance tests and a discussion of significance testing in general.
    • The November 2012 thread Logistical Questions Re: Institution-wide Assessment of Gen Ed Outcomes, initiated by Laura Henderson, which deals with several issues about analyzing rating-scale results & using rubrics.
    • July 2013 thread Course Evaluation Inter-rater Reliability, initiated by David Eubanks. The thread includes some general discussion of course evaluation questionnaires.
    • November 2014 thread Item Response Theory Software, initiated by M. Brooke Robertshaw.
    • March 2015 thread Significance Tests in Assessment (Are they even appropriate?), initiated by Kimberly Faith
    • March 2015 thread Case Study Assessment initiated by Karal Sanders.
    • April 2015 thread Assessing Common Reading Programs initiated by Karla Sanders.
    • April 2015 thread Evaluation/Assessment Plan initiated by Tracey Snyder
    • April 2015 thread Student Group Assessment Plan initiated by Alicia Betsinger.
    • April 2015 thread Assessment for Readiness for Online Courses and Computer Literacy initiated by Gave Estil.
    • April 2015 thread Assessment Day? initiated by Cathy Sanders.
    • April 2015 thread Transition to On-Line Course Surveys initiated by Annalisa Gramlich.
    • April 2015 thread Significance Tests in Assessment initiated by Kimberly Faith.
      • This thread includes discussion of whether statistical significance testing is appropriate for course and program level assessment at all.
    • May 2015 thread Theories or Models for Assessment  initiated by Michael Zuch.
    • May 2015 thread Help with Research initiated by Keri Turner.
    • October 2015 thread Survey Factors: Continuous or Categorical Variables and Implications on Sig Testing?, initiated by Beth Tek.
    • October 2015 thread Ordinal vs Ration/Interval, initiated by Mark Riddle.
    • February 2016 thread Analyzing large quantities of open-ended survey data, initiated by Beth-Ann Tek.
  • Context for Success papers discuss statistical & methodological issues in using enrollment, persistence, graduation rates, and employment data as measures of institution quality or effectiveness.
  • “Dashboard” display of assessment & accountability data
  • See Crafton Hills College’s overview of Sampling for the Assessment of Student Learning Outcomes (pdf file).
  • NILOA Occasional Paper -“Improving teaching, learning, and assessment by making evidence of achievement transparent.
    • From NILOA May Newsletter.
    • The occasional paper discusses concepts of validity, external credibility, and “authentic achievement.”
  • Setting performance targets / standards / expectations

Software for Web Surveys

Software for Web Surveys

  • Association for Survey Computing: Register of Software for Statistical and Social Survey Analysis
    • Well-annotated, easy to use listings from a regularly-updated database. Not limited to products for Web-based surveying. Start with the list of features, then go to “Data Capture” and then to “Web Interviewing.” (Note: The Register has not been updated since 2006 but many of its entries are still useful.You can download the 2006 version from ASC’s website [pdf file]. See the list of web interviewing packages on p. 7; then get individual software vendors’ website addresses from the list that starts on p. 30.)
      • Adaptex Assessment System, from James Madison University.
      • AskAnywhere, from Senecio.
      • Asset (Academic Survey System and Evaluation Tool), from the Mathematics and Computer Science Department at Seton Hall University.
      • Blue/Surveys, from Explorance.
      • Checkbox from Prezza Technologies has software for your own campus’ servers as well as a hosted version.
      • CoursEval, from ConnectEdu, is designed for course, faculty, and peer evaluations but can also be used for other small surveys.
      • EvalTools from Makteam Software.
      • EvaluationKIT.
      • LimeSurvey open-source survey application.
      • Qualtrics. Scroll down to the survey research suite for details.
      • PollCat. Free survey-creation, hosting, and summary reports for small surveys. There are fees for larger surveys, custom surveys, and detailed data.
      • SelectSurvey.NET, from ClassApps.
      • SmartEvals.
      • SurveyConnect.
      • SurveyDIG, from Runner Technologies.
      • SurveyMaker, from Griffith University. These software and survey hosting services were not in the Register when last checked. (Some of these are from ASSESS posts by Renee Corbin at Western Carolina University and Lib Pruden at Union Institute.) This is just a list. It’s not exhaustive, it doesn’t include items in ASC’s Register or ACPA’s list, and it doesn’t imply a recommendation or evaluation.
      • SurveyTracker Plus Email/Web from Scantron handles online surveys as well as scannable forms.
      • TestPilot, from ClearLearning.
      • TK20’s CampusTools HigherEd and CampusWide have survey tools as part of a system to gather and organize assessment information.
      • Business-oriented survey tools.such as those from Mindshare Technologies may also be appropriate for educational institutions.
  • Also, see Yahoo’s current links on the topic. Some of these are survey software, some are survey hosting services.
  • Some threads in the ASSESS discussion-list archive have users’ comments about web survey software or hosting services, or about using online surveys. See the:
    • December 2004 thread Question Web Survey Software, initiated by Ted Micceri.
    • October 2005 threads Online Survey Comparison Matrix and Online Survey hosts, which include Gavin Henning’s Excel file of information and user comments (thanks for compiling this, Gavin!).
    • July 2007 threads Electronic Survey and Thanks, initiated by Elizabeth Pruden.
    • August 2007 threads Consultant for Online Survey and Consultant for Online Survey: Listserv Feedback Compiled, initiated by Brian Bogert.
    • April 2011 threads Survey Software that Allows You to Store Your Own Data, initiated by Pat Williams, and Survey Software, initiated by Lea Campbell.
    • May 2011 thread Online Survey Policies, initiated by Kim Black.
    • October 2011 post, Survey Policies & Guidelines, from Betty Harper. The attached Word document has links to & information about college/universities’ policies for large (web or non-web) surveys.
    • September 2014 thread Alternatives to SurveyMonkey, initiated by Denise Bell.
    • May 2016 thread Survey Software, initiated by Nicole Tomasello.
  • Some online articles about Web-based surveying
  • In the ASSESS discussion-list archive, see the:
    • September 2010 threads Quick Poll: Typical Responses Rates to Web-based Surveys, initiated by Gavin Henning, and Achieving High Online Survey Rates of Completion, initiated by Timothy Metz.
    • February 2011 thread Just Sharing Something Fun… initiated by Zaneeta Davers, a discussion of getting students to take online surveys.
      • October 2012 thread Incentives for Student Participation in NSSE, initiated by Pat Williams. (Not limited to online surveys or to NSSE, this thread is a general discussion of using incentives to improve completion rates.)

SHEEO: State Higher Education Executive Officers

SHEEO: State Higher Education Executive Officers

State-by-State Reports on Accreditation, Assessment, and Higher Education

State-by-State Reports on Accreditation, Assessment, and Higher Education

    • Measuring Up “report card”
      • From the National Center for Public Policy and Higher Education. Scoring categories include preparation for and participation in higher education, affordability, completion, benefits, and student learning. All states received “grades” of Incomplete for student learning; current data did not allow meaningful state-by-state comparisons.
      • Executive summary (pdf file) plus individual state reports.
      • Reported biannually from 2000 through 2008.
    • NILOA report: Connecting State Policies on Assessment with Institutional Assessment Activity.
    • Ready to Assemble: About states’ higher education accountability systems
      • What information do states collect on their higher education institutions, and how do they use that information for institutional improvement?
      • Interactive map and individual state & scoring-category summaries, plus (pdf files) executive summary & individual reports.
      • From Education Sector.

State and Regional Assessment Organizations

State and Regional Assessment Organizations

  • Arkansas Association for the Assessment of Collegiate Learning (AAACL)
    • About AAACL.
    • Links to member institutions’ home pages.
    • Listserv.
    • Information about & from AAACL assessment workshops (presentations are mht files which require Internet Explorer; the registration form for the latest workshop is an Excel file).
    • Resources
      • Newsletter (pdf file).
      • Previous Conference (AAACL workshop) presentations
        • Spring 2008 (presentations are mht files which require Internet Explorer; the participant list is an Excel file).
        • Spring 2009 (Powerpoint & pdf files, Word documents).
  • Assessment Network of New York (ANNY)
    • About ANNY and network membership.
    • Materials from ANNY conferences & events (pdf & Powerpoint files).
    • Member resources, including a newsletter and links to other assessment resources, are restricted to ANNY members.
  • California Community Colleges Student Learning Outcome Coordinators
    • A community in the CCC Research & Planning Group.
    • Listserv for CCC SLO coordinators.
    • POWER awards for achievements in outcomes assessment and research in learner-centered teaching.
    • Links to other assessment resources (pdf files, Word documents).
  • Chicago Area Assessment Group (CAAG)
    • About CAAG.
    • Contact information and upcoming meetings.
  • Missouri Assessment Consortium
    • Information about MAC.
    • Guiding principles and assessment handbook.
    • Links to Missouri institutions’ assessment websites.
  • New England Educational Assessment Network
  • New Mexico Higher Education Assessment Association
    • Information about NMHEAA and statewide assessment conferences.
  • Virginia Assessment Group
    • About VAG.
    • Conferences, workshops, and session handouts (pdf, Powerpoint, and Word files).
    • Assessment-related employment notices from Virginia colleges & universities.
    • Online journal, Research & Practice in Assessment (RPA).
    • Links to other assessment resources. The list on the left has materials from VAG conferences & workshops (pdf, Powerpoint, and Word files).
  • Washington Area Student Learning Assessment Network (WASLAN)
    • About WASLAN, and contact information.
    • WASLAN member institutions.

Student Motivation for Assessment

Student Motivation for Assessment

  • In the ASSESS discussion-list archive, see the January 2014 threads Capstone Requirements and Motivation for Assessment (was Capstone Requirements), initiated by Catherine Wehlburg.
  • The Student Opinion Scale (pdf files)
    • Self-report scale of test-takers’ motivation, to help inform the interpretation of assessment results.
    • From James Madison University’s Center for Assessment & Research Studies (CARS).

The Value of Academic Libraries: A Comprehensive Research Review and Report

The Value of Academic Libraries: A Comprehensive Research Review and Report (pdf files)

Tools to Help Organize Assessment Information

  • Tools to Help Organize Assessment Information
      • ASSESS discussion-list threads on users’ experience with assessment management software (see the list archive)
        • February 2006 thread Assessment Tracking Systems, initiated by David Kale.
        • August 2006 thread Assessment Reporting Software, initiated by Margie Hobbs. Margie’s summary in the associated thread Assessment Management Software, includes a Word document with information from a number of vendors (thanks, Margie).
        • July 2008 thread Assessment Management Systems, initiated by Janine Vienna. Steve RiCharde’s July 11 posts include a draft chapter on things to consider when selecting assessment management software (Word document) and a partial list of vendors (Excel file) — thanks, Steve.
        • February 2012 thread Assessment Data Management System, initiated by Teresa Rothrock.
        • August 2012 thread Question about Assessment Software, initiated by Lisa Woodward.
        • October 2012 thread Assessment Systems, initiated by Michelle Todd, and the associated thread Re: Assessment Systems (Attachment), with an Excel file of information on various vendors’ systems, from Susan DeMatteo (thanks, Susan).
        • April 2013 thread Seeking Assessment Management System (AMS) Feedback, initiated by Susan DeMatteo.
        • April 2013 thread Curriculum Outcomes Mapping Software, initiated by Larry Peterson.
        • April 2013 thread LiveText, initiated by Kim Black, and the associated threads Kim Black – Adopting LiveText, initiated by Steven McDonald and LiveText (for Kim Black), initiated by Denise Moseley.
        • December 2013 thread Software to Store and Analyze Student Learning Outcomes and Progress in Institutional Goals? initiated by Susan Hayes.
        • December 2013 thread Assessment Support Software, initiated by Dan McCollum.
        • June 2014 thread Separate Systems for Strategic Plan Assessment and Institutional Assessment? initiated by Susan Hayes.
        • June 2014 thread Software for Assessment Reporting AND Faculty Activity Reporting? initiated by Donna Vinton.
        • September 2014 thread Assessment Software, initiated by Lisa Cota. Also see the associated thread Lisa Cota Request, initiated by Bobby Matthews.
        • November 2014 thread Feedback Requested on the Assessment Software Weave/Performance Cloud, initiated by Kimberly Gargiulo.
        • April 2016 thread Data roll-up for assessment of PLOs/ILOs, initiated by Anna Martinez.
        • May 2016 thread Assessment Management System, initiated by Karen M. Stokes.
      • This is just a list. It’s not exhaustive and inclusion doesn’t imply a recommendation or evaluation.
      • AEFIS (Academic Evaluation, Feedback and Intervention System) assessment management software. Developed at Drexel University for ABET self-studies, but flexible enough for other course-based assessment processes.
      • AMEE (Assessment Made Easy Everyday), from Midwest Social Science Research Associates (MSSRA).
      • aPlus+, from Cobek, for organizing & summarizing assignment details & grades.
      • Better Assessment organizes & manages faculty assessments of students’ written material.
      • Blackboard’s Learn Platform includes tools for for assessment processes, information, and reports. Integrated with tools for course information, surveys, document and portfolio management, and user-community interaction.
      • CampusLabs
        • Baseline management system for survey & rubric-based assessments.
          • Select Products, then Baseline.
          • This was formerly StudentVoice.
        • Compliance Assist manages assessment data as well as other information for accreditation, planning, and program review reports.
      • CurricUNET’s curriculum management system includes an assessment module.
      • Digication’s Assessment Management System for collecting and managing assessment information includes portfolio, rubric, and reporting tools.
      • eLumen Achievement database for assessment processes, rubrics, results, and reports.
      • ExamSoft’s tools create, administer, & score exams and other assignments, and include rubric-based scoring, student feedback, and reports for course, program, or institutional learning outcomes.
      • FASI-Online assessment documentation system.
      • iSocrates system for rubric-based grading and student feedback on individual assignments. For program or cross-program assessment, data can be exported to spreadsheets or class management systems for aggregation. Registered users can share rubrics they’ve generated for specific tasks or assignments.
      • LiveText Accreditation Management System for collecting data and organizing outcomes, rubrics, results, etc.
      • Maple T.A. from Maplesoft, for creating, presenting, grading, & organizing results from mathematics/science assignments & exams, can also be used for non-math/science courses.
      • Mentor, from Axiom Education.
      • OATS (Online Assessment Tracking System) from Georgia Institute of Technology’s Office of Assessment. OATS is available for download by other institutions.
      • openIGOR: A free Linux-based open-source program to manage information about program outcomes and assessment-related documents. From David Eubanks, now at Eckerd College.
      • PASS-PORT, from Innovative Learning Assessment Technologies. Includes versions specialized for business program, nursing program, and teacher-education program accreditation management.
      • rGrade, from Educational Informatics.
      • RXoutcome, for pharmacy programs, also includes portfolio tools.
      • Strategic Planning Online includes an assessment-management component.
      • TaskStream’s tools to organize, review, & summarize assessment information, and for assignment & e-portfolio assessment.
      • ThinkTank facilitates collaboration and can record and store information from assessment group meetings.
      • TK20’s CampusTools HigherEd and CampusWide include tools for electronic portfolios and online surveys.
      • TracDat tracks assessment processes & information and produces reports. From Nuventive.
      • WEAVEonline tracks assessment processes & information and produces reports.
        • WEAVE Technology’s PerformanceCloud integrates institutional research, institutional effectiveness, outcomes assessment, strategic planning, & accreditation processes.
  • WIDS (Worldwide Instructional Design System) curriculum-design software includes tools to monitor outcomes and associated rubrics and results. Select Products, then Read more….
  • The Programs module of Xitracs’ accreditation compliance tool includes assessment management.

TRIADS: Assessment of Learning Outcomes

TRIADS: Assessment of Learning Outcomes

  • TRIpartate Assessment Delivery System: A joint project of the University of Liverpool, the University of Derby, and the Open University.
  • TRIADS Engine: Authorware for developing online assessments.
  • Sample learning outcomes (for earth science programs).
  • TRIADS activities and implementations.

Voluntary Framework of Accountability (VFA)

Voluntary Framework of Accountability (VFA)

  • Project to develop VSA-like definitions and reporting templates for community colleges.
  • Project to develop VSA-like definitions and reporting templates for community colleges.
  • See About VFA for the project’s history and information about VFA’s measures (pdf files).
  • A joint project of AACC, ACCT, and the College Board.

Voluntary System of Accountability (VSA)

 Voluntary System of Accountability (VSA)

What Outcomes Assessment Misses

What Outcomes Assessment Misses

  • From the TLT Group, so it focuses on assessment about technology — but the general points apply to any assessment project.

General Resources

Discussion Lists, Forums, Archives of Articles, Lists of Links, etc.

A | B | C | D | E | F | G | H | I | J | K | L | M | N | O | P | Q | R | S | T | U | V | W | X | Y | Z

AALHE (Association for the Assessment of Learning in Higher Education)

  • A professional association for higher education assessment practitioners, AALHE became available to the assessment community in spring 2010.
  • Some website features are restricted to AALHE members, some are available to the public (the list below indicates which features are restricted). The site includes:
    • Information about AALHE and about joining AALHE.
    • Links to other assessment resources and to presentations from previous AALHE conferences. (See the Resource Room.)
    • Opportunities for interaction about assessment issues, via topic-specific webinars, and on the ASSESS discussion list. (Webinar participation is restricted to AALHE members. The ASSESS list is available to the public in the Resource Room.)
    • Intersection, a quarterly online publication, is restricted to members.
    • Information about & from AALHE’s events (annual conferences, Twitter chats, & webinars. Twitter chats & webinars are restricted to AALHE members. Presentations from previous conferences are open to the public in the Resource Room.)

ACT

  • Surveys and assessment tools for colleges & universities.
  • Links to information about other ACT tools for higher education.

American Evaluation Association

  • Resources for and information about assessment & evaluation in many contexts, including education & higher education. See About Us.
  • Community resources
    • EVALTALK online discussion list.
    • The public elibrary includes a daily blog and (pdf and Powerpoint files) materials from AEA conference presentations.
    • Discussion forums for AEA members.

American Society for Quality: Education Division

  • A division of ASQ, the national organization for the application of quality control in business and industry.
  • K-12 as well as higher education.
  • Some articles in the Division’s online journal Quality Approaches in Higher Education deal with assessing student learning outcomes. Some issues of its Higher Education Brief focus on assessment & accountability; recent issues are available to the public.

Assessing Academic Advising

  • National Academic Advising Association (NACADA)
    • General Principles of Assessment of Academic Advising
    • Implications for Assessment of Academic Advising (2011 National Survey Results)
    • Constructing Student Learning Outcomes in Academic Advising
    • Resources include:
      • Guidelines, handouts and materials (pdf files)
      • Institutional Examples
    • UC-Berkeley Center for Teaching and Learning 
      • Assessing Academic Advising
      • On the ASSESS discussion list see the May 2015 thread Learning Outcomes for Advising, initiated by Renee Hicks.

Assessing Administrative and Support Units

Assessing Assessment: In Academe, from AAUP.

  • The first four feature articles in this issue deal with assessment.

Assessing Online Education

Assessing Service Learning

Assessment Committees

  • ASSESS discussion-list threads on committee structure and function (see the list archive):
    • March 1999 thread Faculty Committees, initiated by Suzanne Decamp.
    • September 2003 thread Course Releases for Faculty on Assessment Committees? initiated by Tiffany Phagan.
    • October 2005 thread Committee Structure, initiated by David Gordon.
    • November 2007 thread Institutional Assessment Committee, initiated by Erin Frew. Note Erin’s 11/22/07 summary of responses.
    • February 2009 thread Assessment committees? initiated by Charles Patrick.
    • May 2010 thread University Assessment Committee, initiated by Jerald Henderson.
    • September 2010 thread Relationship of Assessment Committee and Academic Policies Committee, initiated by David Knopp.
    • March 2013 thread An Organizational Question, initiated by Daryl Stevenson, and the associated threads An Organizational Question–Larger Institutions? and Organizational Question.
    • July 2013 thread Assessment Committees, initiated by Leah Adams-Curtis, and her follow-up posts Summary of Responses for Assessment Committee and Summary of Assessment Committee Information.
    • May 2016 thread “Overseeing Assessment at the Institutional Level” (5-18-16, Kristin Buscher)
  • Periodic assessment reports (often received and responded to by an assessment committee).
    • In the ASSESS discussion-list archive, see the
      • October 2010 thread Rubrics to Evaluate Quality of Assessment, initiated by Keston Fulcher.
      • September 2011 thread Faculty Evaluation of Annual Assessment Reports, initiated by Donna Vinton.
      • January 2012 thread Dean’s Role in Reviewing Assess Reports, initiated by Kathleen Morley.
      • May 2012 thread Assessment Report Review Process, initiated by Erin Frew.
      • July 2012 thread Administrative Responses to Annual Assessment Reports and Program Review, initiated by Shawna Lafreniere.
      • February 2013 thread Rubric for Evaluating the Quality of Assessment Plans, initiated by Shawna Lafreniere.
      • July 2013 thread Discovering Plagiarism During Juried Evaluations? initiated by Chris Duke.
      • June 2014 thread Timing of Assessment Reporting, initiated by Leah Adams-Curtis.
      • September 2014 thread External Review of Program Assessment Plans/Annual Reports, initiated by Ying Xiong.
      • September 2015 thread Peer Review of Assessment Plans, initiated by Cynthia Louden.
    • What should departments report, and to whom? In the ASSESS discussion-list archive, see the:
      • October 1999 thread Who Collects Reports? initiated by Jane Thayer.
      • July 2009 thread What’s in Your Annual Assessment reports? initiated by Pat Williams.
      • March 2010 thread Posting Assessment Docs, initiated by Jayne Swanson.
      • January 2014 thread Trend of Sharing Assessment Results/Reports Online, initiated by Norma Morán.
      • September 2014 thread Program Assessment Outcomes and Objectives, initiated by Deborah Armstrong.

Assessment Grants

 

Assessment Humor

Assessment Information for Students

  • Use your browser’s (F)ind function to search the individual institutions’ assessment sites for the phrase “for students”.
  • In the ASSESS discussion-list archive, see the
    • May 2012 thread Feedback for Students, initiated by Allison Ostrowski.
    • May 2012 thread Informational Assessment Statements and Student Consent Procedures, initiated by Elise Martin.
    • July 2013 thread How do You get Students Interested in Assessment, initiated by Christopher Childs.

Assessment and Institutional Review Boards (IRBs)

  • How IRBs interpret the federal regulations on research with human subjects varies from campus to campus.
    • In the ASSESS discussion-list archive, see the:
      • November 1999 thread IRB letters, initiated by Jamie Young.
      • October 2001 thread IRB Approval, initiated by Kevin Kinser.
      • January 2002 thread  IRB Approval and Assessment Instruments, initiated by Barry Jenkins.
      • August 2004 thread IRB, is initiated by Edward Grandpre.
      • September 2004 threads External Survey Requests and Passions Aside, IRB is Necessary, initiated by Karen Widbin and Mark Davenport.
      • September 2005 threads Policy About Use of Assessment Results for Personal Research Activities and Use of Assessment Results, initiated by Karen Widbin and Alan DuPont.
      • April 2007 thread On Assessment and IRB, initiated by Marsha Watson.
      • August 2009 thread IRB, initiated by Valerie Taylor.
      • April 2010 thread IRB’s and Educational Research, initiated by Curt Naser.
      • November 2010 thread Institutional Review Board & Assessment, initiated by Melanie Booth.
      • February 2011 thread An bit of Friday Afternoon Diversion, initiated by Lea Campbell, and the follow-up threads An Bit of Friday Afternoon Diversion…which has Spilled Over in to the Weekend and Monday Morning as well… and An Bit of Friday Afternoon Diversion – Now Bleeding into Tuesday. This request for information about institutions’ assessment climate became an extended discussion of assessment & IRBs.
      • October 2011 thread Asmt Ethics, initiated by Joan Hawthorne, and the related post Further Consderation Regarding Assessment Ethics. The main thread includes discussions of ethical standards for assessment and how institutional review boards (IRBs) deal with assessment activities.
      • September 2012 thread Student Services Assessment for Decision Making and IRB Approval, initiated by Brad Patterson.
      • May 2013 thread Assessment Data and Permissions, initiated by Vanessa Vacchiano.
      • May 2014 thread Publishing Assessment Results, initiated by Susan Warner.
      • June 2014 thread Request for Raw Student Engagement Survey Data, initiated by Laura Massell.
      • September 2014 thread IRB and Assessment of Student Learning, initiated by Carrie Nepstad.
      • November 2014 thread Survey Question, initiated by Susan Warner.
  • Related policy issues
    • In the ASSESS discussion-list archive, see the December 2010 thread Policy Language: Collecting Student Work for Program Assessment, initiated by Melanie Booth.

Assessment Journals

Assessment and Learning: State of the Field Review

  • About educational assessment in general, K-12 as well as higher ed and in UK, European, & far eastern education systems as well as in the U.S. (the review was written to inform Norwegian policy context).
    • A good source of information about “assessment” terminology & concepts — how terms & concepts developed, how they’re used in various theoretical & educational systems, and confusions that can result from overlapping usages.
    • Most of the theoretical & definitional literature reviewed deals with the theoretical underpinnings of various approaches to assessment and to relationships among assessment, learning, pedagogy, & policy.
    • Most of the research literature reviewed deals either with small-scale action-oriented studies in K-12 situations or with the large-scale OECD international tests; these parts of the review emphasize impacts on learning/pedagogy policy & practice rather than detailed research methods or results.
  • A large pdf file, 174pp including 20 pages of references.

Assessment and Liberal Arts Education: Research on the Outcomes of Liberal Arts Education

Assessment at Minority Serving Institutions

Assessment Resource Centre

  • A joint project of Hong Kong Polytechnic University and the University of Hong Kong.
  • Information about, guidelines for, and issues in assessment and assessment-based pedagogy.
  • Bibliography and links to other resources. Includes resources not usually found in U.S.-based lists.
  • User-contributed assessment-practice examples were not available when last checked.

Assessment Resources

Assessment Rubrics

Association for Educational Assessment – Europe

  • Not limited to higher education.
  • Professional development includes a framework for Standards for Assessment (pdf file).

Association for Institutional Research

Association of American Colleges & Universities

  • AAC&U’s assessment initiatives: multi-institution research on assessment approaches and impacts.
    • The LEAP (Liberal Education & America’s Promise) and VALUE (Valid Assessment of Learning in Undergraduate Education) initiatives include general education learning outcomes, rubrics, and assessment activities.
  • AAC&U’s assessment-related publications, meetings, and institutes.
  • Links to other assessment resources.

Automated Essay Scoring

Baldridge National Quality Program: Education Criteria

  • See the National Institute of Standards and Technology (NIST) National Quality Program site for more information about the Malcolm Baldridge National Quality Awards.

Bloom’s Taxonomy

  • Bloom’s 1956 taxonomy of cognitive, affective, and psychomotor behaviors is often used or referred to in defining outcomes for assignments, courses, and curricula. Google Bloom’s Taxonomy for a long list of relevant websites. Some with definitions & examples of Bloom’s cognitive categories are:

    Centro Nacional de Evaluación para la Educación Superior (México)

    • Ceneval develops and administers performance exams for college entrance and assessment and for licensing/certification programs.
    • The website includes information about Ceneval’s exams and administration sites. Students can register and view their own results online.
    • Note: Ceneval’s website is in Spanish. Thanks to Phil Schmidt from Western Governors University for translation assistance.

    College Portrait, see Voluntary System of Accountability (VSA)

    Collegiate Learning Assessment (CLA, CLA+)

    • Standardized assessment of general education skills & abilities.
    • Reports emphasize institutional value-added.
    • From the Council for Aid to Education (CAE).
    • CLA+ replaces the CLA and CCLA (Community College Learning Assessment). See supporting materials for a comparison of the old & new versions (pdf file).
    • Catalyst for Change, from the Council of Independent Colleges CLA Consortium, reports CIC members’ experience with the CLA.
    • Information from and about a multi-institution CLA-based longitudinal study of undergraduate learning are available from the Social Science Research Council. The study was the basis for Richard Arum & Josipa Roska’s book Academically Adrift.

    Commission on the Future of Higher Education 

    • The Commission met during 2005-2006, charged by the U.S. Secretary of Education to develop a national strategy for postsecondary education.
    • Some parts of the final report and some of the issue papers deal with assessment, accountability, and accreditation (pdf files).

    Common Education Data Standards (CEDS)

    • Proposed data definitions for (voluntary) intersystem sharing.
    • A project of the National Center for Education Statistics (NCES). See About CEDS.
    • Select Elements, then Version 3 or Version 4 (Draft). In search, set the domain filter to postsecondary and the change status filter to all.

    Community College Survey of Student Engagement (CCSSE)

    • Nationally-normed survey of students’ exposure to good practices in undergraduate education.
    • Information about the project and the survey.
    • About the survey has pdf demonstration versions of the survey.
    • National results summaries.
    • CCSSE is designed for two-year institutions. The National Survey of Student Engagement (NSSE) is a similar project for four-year institutions.
    • Some institutions’ assessment sites include CCSSE reports.

    Conferences: Lists of National, Regional, and International Assessment Conferences, Institutes, and Workshops

    Consultants

    These individuals and groups offer consulting, workshops, etc. to help colleges & universities plan and implement outcomes assessment. Some also offer other services related to assessment. Many of them consult in other higher-education areas as well. This is just a list. It’s not exhaustive and it doesn’t imply a recommendation or evaluation.

    Grades as Outcomes Assessment

    Graduate Program Assessment

    Graduate Training in Outcomes Assessment

    Higher Education Resource Hub

    • For assessment resources, select Higher Education Assessment.

    Higher Education Research Institute (HERI)

    • A project of the Graduate School of Education & Information Studies at UCLA.
    • CIRP Surveys: Information about nationally-standardized student surveys.
      • CIRP Freshman Survey: profile of entering freshman class.
      • CSS College Senior Survey: follow up of CIRP cohorts.
      • YFCY Your First College Year

    Impact of Assessment

    • A bibliography of articles about program assessment that include results, from the University of Hawaii at Manoa (pdf file).
      •  From Monica Stitt-Bergh’s original July 2013 ASSESS post Program Assessment Articles: Sharing and a Request: “[Published articles or conference papers with] examples of degree program assessment involving direct assessment of student learning…, preferably peer-reviewed, that include some direct assessment of an academic degree program, include at least one assessment result, and are not only a ‘how-to’ or not just ‘what-we-plan-to-do.’ Completed assessments are what I⬔d like to find.”
      • Some of the articles include descriptions of how assessment results informed program planning.
    • Engineering Change: ABET study of how EC2000 standards and assessment requirements affect Engineering programs and students (executive summary available as pdf file, full report purchasable).
    • ASSESS discussion-list threads on this topic (see the list archive):
      • October 2006 thread Resources on Impact of Assessment on Learning and Teaching, initiated by Sean McKitrick of Binghampton University.
      • August 2007 threads Outcomes to the Assessment Process? initiated by Ken Weiner at Montgomery College, and Assessment in Higher Education, contributed by Richard Hake.
      • April 2008 threads Evidence of Impact of Student Learning Assessment? and Evidence of Impact of Student Learning Assessment, initiated by Lois Myers.
      • September 2009 threads Assessment, Budgeting, & Strategic Planning and [Spam] Re: [ASSESS:] Assessment, Budgeting, & Strategic Planning, initiated by Erin Frew.
      • November 2009 thread 404: Learning Outcomes, initiated by David Eubanks, and David’s blog entry on the topic.
      • March 2010 thread Evidence-Based Studies of Learning Goals, initiated by Mindy McWilliams.

    Institutional Support for Outcomes Assessment

    International Association for Educational Assessment (IAEA)

    • Not limited to higher education.

    K-12 Standards and College-Level Work

    • The Common Core State Standards
      • A project of the National Governors Association Center for Best Practices (NGA Center) and the Council of Chief State School Officers (CCSSO), in partnership with the American Association of State Colleges & Universities (AASCU).
      • Objectives include:
        • Aligning K-12 standards with college admission & placement requirements.
        • Preparing K-12 teachers to help students meet the standards.

    Knowing What Students Know: The Science and Design of Educational Assessment

    League for Innovation in the Community College: 21st Century Learning Outcomes Project

    • Information about a multi-institution project to define and document student learning outcomes.
    • Links to participating institutions’ project websites and to other resources. The project is no longer active, but some of the institutions’ websites are still available.

    National Academic Advising Association (NACADA)

    • General Principles of Assessment of Academic Advising
    • Implications for Assessment of Academic Advising (2011 National Survey Results)
    • Constructing Student Learning Outcomes in Academic Advising
    • Resources include:
      • Guidelines, handouts and materials (pdf files)
      • Institutional Examples

    National Assessment Governing Board

    • Information about the National Assessment of Educational Progress (NAEP). These are assessments of students in grades 4, 8, and 12, not of college students. Relevant to assessment in higher education as illustration of a current national model for assessing student learning.
    • The NAEP site has details about and reports from assessments in various subject areas.
    • The U.S. also participates in multinational comparisons of K-12 students’ performance in various areas, sponsored by the International Association for the Evaluation of Educational Achievement (IEA). Recent & upcoming study areas include reading literacy, computer & information literacy, knowledge of math & science, and civic & citizenship education.
    • The Learning Curve, from Pearson and The Economist Intelligence Unit, analyzes a range of internationally-comparable K-12-level data.

    National Association of Independent Colleges and Universities (NAICU): Links to articles and other assessment resources.

    The National Center for Higher Education Management Systems (NCHEMS) site has information about publications and services for assessment and other higher-education areas.

    • Assessing Assessment: Successes, Failures, and the Future overviews the state of higher education outcomes assessment (this pdf file will open in a separate window). Presentation by Peter Ewell, NCHEMS vice-president, at the 2007 IUPUI Assessment Institute. Ewell’s chapter An emerging scholarship: A brief history of assessment has details and references (in Banta, T.W. & Assoc. [2002], Building a scholarship of assessment. Jossey-Bass).
    • NCHEMS’ Information Center provides state-by-state comparisons of data related to higher-education issues. Some are outcomes assessment data, most are not.

    The National Center for Research on Evaluation, Standards, and Student Testing (CRESST) page at UCLA’s Graduate School of Education & Information Studies has papers, technical reports, and links to related sites. Some higher education material; mostly K-12.

    National Community College Benchmark Project

    • Participating institutions can compare outcomes results with those of other participants. The data are not available to non-participants.
    • The site includes:
      • A description of the project and the benchmarks used. Some of the benchmarks are outcomes assessment results, some are other institutional-research data.
      • A description of the reports prepared for participating institutions.
      • A list of participating institutions and information about enrolling in the project.

    National Institute for Learning Outcomes Assessment

    • NILOA focuses on identifying & promoting effective assessment practices.
    • NILOA Resources include:
      • Viewpoints: Short articles from assessment experts.
      • Reports from surveys of college/university outcomes assessment practices.
      • Assessment briefs: Introductions for faculty, student affairs staff, etc.
      • Occasional papers by assessment experts.
      • A transparency framework for institutions’ assessment websites and online presentation of assessment information.
        • The framework in the field section of the Transparency Framework page and the regularly-changing featured website available from the home page illustrate good “transparency” practice.
      • A link to the Measuring Quality inventory of assessment instruments.
    • Information about the Degree Qualifications Profile.
    • The searcheable Resource Library includes links & bibliographies on a variety of assessment topics.

    National Postsecondary Education Cooperative (NPEC)

    • A project of the National Center for Education Statistics (NCES).
    • NPEC student outcomes projects focus on assessment policy, methods, coordination, and/or data use. pdf files of papers from some projects are available.
    • Definitions and assessment methods sourcebooks, for various general-education areas.

    National Survey of Student Engagement (NSSE)

    Nationally Standardized Instruments

    New Leadership Alliance for Student Learning and Accountability

    • The Alliance’s activities were suspended in summer 2013.
    • The documents Committing to Quality: Guidelines for Assessment and Accountability and Assuring Quality: An Institutional Self-Assessment Tool for Excellent Practice in Student Learning Outcomes Assessment are available from CHEA (pdf files).

    Online Discussion

    • Blogs about assessment
    • Discussion Lists
      • Subscribing to email discussion lists
        • Send an email message to the listserver for the list to which you want to subscribe. The message should say subscribe list-name your-first-name your-last-name (e.g.: subscribe assess John Smith) and have nothing in the Subject: line and no “signature” at the bottom.
        • After you’ve subscribed, send the one-word message help to get a list of commands you can use to suspend mail while you’re on vacation, unsubscribe from the list, etc.
      • ASSESS
        • From AALHE.
        • Topic: assessment in higher education.
        • Listserver: listserv@lsv.uky.edu (University of Kentucky).
        • The searchable archive also has online forms that you can use to join and post to the list.
      • EVALTALK
        • Topic: Assessing the strengths and weaknesses of programs, policies, personnel, products, and organizations to improve their effectiveness. Many threads relevant to outcomes assessment.
        • From the American Evaluation Association.
        • Lots of traffic. To avoid clogging your inbox, have your email program automatically put Evaltalk messages into a separate folder/mailbox.
        • The searcheable archive (hosted at the University of Alabama) has an online form you can use to join and post to the list. Note: The UA listserver will ask for a login; registration is available to the general public and is free.
      • Other lists of assessment-related discussion lists <!– Assessment in Higher Education’s page of discussion lists has information about other assessment-related lists. –>
        • The Higher Education Resource Hub’s list of assessment resources has information about other assessment-related lists (select Higher Education Assessment from the menu at the left side of the Hub’s home page and scroll down to Assessment Electronic Discussion Lists).
        • NILOA’s Resources include some assessment discussion lists.

    Portfolio Assessment

    Principles of Good Outcomes Assessment Practice 

    Program Review and Outcomes Assessment

    • In the ASSESS discussion-list archive, see:
      • The May & July 2009 thread Combining Program Review and Assessment, initiated by Erin Frew.
      • The September 2010 thread Program Reviews – Are They Worth It? initiated by Catherine Wehlburg.
      • The October 2011 thread Program Review Cycles, initiated by Leah Adams-Curtis.

    Qualitative Data Analysis Methods and Tools

    • In the ASSESS discussion-list archive, see the:
      • September 2007 thread Qualitative Data Analysis Question, initiated by Mitzi Lewis. In October 2007, scroll down to the thread Qualitative Data Analysis Question – Summary for Mitzi’s summary of responses and some more discussion.
      • February 2010 thread Qualitative Software Reviews? initiated by Christopher Vinger.
      • September 2010 thread Question Regarding Qualitative Analysis, initiated by John Painter.
      • May 2012 thread Text Analysis Tools, initiated by Gavin Henning, the associated thread Text Analysis Tools, initiated by Lenny Shedletsky, and Gavin’s follow-up List of Text Analysis Tools.
      • July 2013 thread Seeking Recommendations on Qualitative Data Analysis Software, initiated by Jill Hirt.
    • Content-analysis.de’s annotated links to qualitative analysis software packages and other information about content-analysis methods.
    • See Crafton Hills College’s overview of Sampling for the Assessment of Student Learning Outcomes (pdf file).

    Quantitative Data Analysis Methods and Tools

    • In the ASSESS discussion-list archive, see:
      • The February 2010 thread Inter-Rater Reliability, initiated by Erica Cavanaugh. It developed into extended discussions of (a) statistical methods for evaluating inter-rater reliability and (b) the pros & cons of statistical precision in higher education outcomes assessment.
      • The related March 2010 thread Centering and Rasch analysis, initiated by David Eubanks, which deals with several issues about using rubrics & analyzing rating-scale results.
      • The November 2010 thread Stats Packages Excel Add-ons, initiated by Kenneth Reaves.
      • The November & December 2010 thread Building Faculty Inter-Rater Reliability of Graduate School Candidate Admissions Ratings, initiated by Barbara Shepperson. It developed into a discussion of inter-rater reliability methods & issues. See Jeremy Penn’s November 30 post for a Powerpoint presentation overviewing methods for evaluating inter-rater reliability.
      • The July 2011 thread Inter-Rater Reliability, initiated by Daniel Mccollum.
      • The August 2011 thread Unequal Sample Size when Comparing Two Groups, initiated by Wenjun Chi. It developed into an comparison of parametric & nonparametric significance tests and a discussion of significance testing in general.
      • The November 2012 thread Logistical Questions Re: Institution-Wide Assessment of Gen Ed Outcomes, initiated by Laura Henderson, which deals with several issues about analyzing rating-scale results & using rubrics.
      • July 2013 thread Course Evaluation Inter-Rater Reliability, initiated by David Eubanks. The thread includes some general discussion of course-evaluation questionnaires.
      • November 2014 thread Item Response Theory Software, initiated by M. Brooke Robertshaw.
      • March 2015 thread Significance Tests in Assessment (Are they even appropriate?) initiated by Kimberly Faith
    • Context for Success papers discuss statistical & methodological issues in using enrollment, persistence, graduation rates, and employment data as measures of institution quality or effectiveness.
    • “Dashboard” display of assessment & accountability data
    • See Crafton Hills College’s overview of Sampling for the Assessment of Student Learning Outcomes (pdf file).
    • Setting performance targets / standards / expectations

    Software for Web Surveys

    • Association for Survey Computing: Register of Software for Statistical and Social Survey Analysis
      • Well-annotated, easy to use listings from a regularly-updated database. Not limited to products for Web-based surveying. Start with the list of features, then go to “Data Capture” and then to “Web Interviewing.” (Note: The Register has not been updated since 2006 but many of its entries are still useful.You can download the 2006 version from ASC’s website [pdf file]. See the list of web interviewing packages on p. 7; then get individual software vendors’ website addresses from the list that starts on p. 30.)
        • Adaptex Assessment System, from James Madison University.
        • AskAnywhere, from Senecio.
        • Asset (Academic Survey System and Evaluation Tool), from the Mathematics and Computer Science Department at Seton Hall University.
        • Blue/Surveys, from Explorance.
        • Checkbox from Prezza Technologies has software for your own campus’ servers as well as a hosted version.
        • CoursEval, from ConnectEdu, is designed for course, faculty, and peer evaluations but can also be used for other small surveys.
        • EvalTools from Makteam Software.
        • EvaluationKIT.
        • LimeSurvey open-source survey application.
        • Qualtrics. Scroll down to the survey research suite for details.
        • PollCat. Free survey-creation, hosting, and summary reports for small surveys. There are fees for larger surveys, custom surveys, and detailed data.
        • SelectSurvey.NET, from ClassApps.
        • SmartEvals.
        • SurveyConnect.
        • SurveyDIG, from Runner Technologies.
        • SurveyMaker, from Griffith University.These software and survey-hosting services were not in the Register when last checked. (Some of these are from ASSESS posts by Renee Corbin at Western Carolina University and Lib Pruden at Union Institute.) This is just a list. It’s not exhaustive, it doesn’t include items in ASC’s Register or ACPA’s list, and it doesn’t imply a recommendation or evaluation.
        • SurveyTracker Plus Email/Web from Scantron handles online surveys as well as scannable forms.
        • TestPilot, from ClearLearning.
        • TK20’s CampusTools HigherEd and CampusWide have survey tools as part of a system to gather and organize assessment information.
        • Business-oriented survey tools.such as those from Mindshare Technologies may also be appropriate for educational institutions.
    • Also see Yahoo’s current links on the topic. Some of these are survey software, some are survey-hosting services.
    • Some threads in the ASSESS discussion list archive have users’ comments about web survey software or hosting services, or about using online surveys. See the:
      • December 2004 thread Question Web Survey Software, initiated by Ted Micceri.
      • October 2005 threads Online Survey Comparison Matrix and Online Survey Hosts, which include Gavin Henning’s Excel file of information and user comments (thanks for compiling this, Gavin!).
      • July 2007 threads Electronic Survey and Thanks, initiated by Elizabeth Pruden.
      • August 2007 threads Consultant for Online Survey and Consultant for Online Survey: Listserv Feedback Compiled, initiated by Brian Bogert.
      • April 2011 threads Survey Software that Allows You to Store Your Own Data, initiated by Pat Williams, and Survey Software, initiated by Lea Campbell.
      • May 2011 thread Online Survey Policies, initiated by Kim Black.
      • October 2011 post Survey Policies & Guidelines, from Betty Harper. The attached Word document has links to & information about college/universities’ policies for large (web or non-web) surveys.
      • September 2014 thread Alternatives to SurveyMonkey, initiated by Denise Bell.
      • May 2016 thread “Survey Software” (5-13-16, Nicole Tomasello)
    • Some online articles about Web-based surveying
    • In the ASSESS discussion list archive, see the:
      • September 2010 threads Quick Poll: Typical Responses Rates to Web-Based Surveys, initiated by Gavin Henning, and Achieving High Online Survey Rates of Completion, initiated by Timothy Metz.
      • February 2011 thread Just Sharing Something Fun… initiated by Zaneeta Davers, a discussion of getting students to take online surveys.
        • October 2012 thread Incentives for Student Participation in NSSE, initiated by Pat Williams. (Not limited to online surveys or to NSSE, this thread is a general discussion of using incentives to improve completion rates.)

    SHEEO: State Higher Education Executive Officers

    State-by-State Reports on Accreditation, Assessment, and Higher Education

     

      • Measuring Up “report card”
        • From the National Center for Public Policy and Higher Education. Scoring categories include preparation for and participation in higher education, afforadbility, completion, benefits, and student learning. All states received “grades” of Incomplete for student learning; current data did not allow meaningful state-by-state comparisons.
        • Executive summary (pdf file) plus individual state reports.
        • Reported biannually from 2000 through 2008.
      • NILOA report: Connecting State Policies on Assessment with Institutional Assessment Activity.
      • Ready to Assemble: About states’ higher education accountability systems
        • What information do states collect on their higher education institutions, and how do they use that information for institutional improvement?
        • Interactive map and individual state & scoring-category summaries, plus (pdf files) executive summary & individual reports.
        • From Education Sector.

      State and Regional Assessment Organizations

      • Arkansas Association for the Assessment of Collegiate Learning (AAACL)
        • About AAACL.
        • Links to member institutions’ home pages.
        • Listserv.
        • Information about & from AAACL assessment workshops (presentations are mht files which require Internet Explorer; the registration form for the latest workshop is an Excel file).
        • Resources
          • Newsletter (pdf file).
          • Previous Conference (AAACL workshop) presentations
            • Spring 2008 (presentations are mht files which require Internet Explorer; the participant list is an Excel file).
            • Spring 2009 (Powerpoint & pdf files, Word documents).
      • Assessment Network of New York (ANNY)
        • About ANNY and network membership.
        • Materials from ANNY conferences & events (pdf & Powerpoint files).
        • Member resources, including a newsletter and links to other assessment resources, are restricted to ANNY members.
      • California Community Colleges Student Learning Outcome Coordinators
        • A community in the CCC Research & Planning Group.
        • Listserv for CCC SLO coordinators.
        • POWER awards for achievements in outcomes assessment and research in learner-centered teaching.
        • Links to other assessment resources (pdf files, Word documents).
      • Chicago Area Assessment Group (CAAG)
        • About CAAG.
        • Contact information and upcoming meetings.
      • Missouri Assessment Consortium
        • Information about MAC.
        • Guiding principles and assessment handbook.
        • Links to Missouri institutions’ assessment websites.
      • New England Educational Assessment Network
      • New Mexico Higher Education Assessment Association
        • Information about NMHEAA and statewide assessment conferences.
      • Virginia Assessment Group
        • About VAG.
        • Conferences, workshops, and session handouts (pdf, Powerpoint, and Word files).
        • Assessment-related employment notices from Virginia colleges & universities.
        • Online journal, Research & Practice in Assessment (RPA).
        • Links to other assessment resources. The list on the left has materials from VAG conferences & workshops (pdf, Powerpoint, and Word files).
      • Washington Area Student Learning Assessment Network (WASLAN)
        • About WASLAN, and contact information.
        • WASLAN member institutions.

      Student Motivation for Assessment

      • In the ASSESS discussion list archive, see the January 2014 threads Capstone Requirements and Motivation for Assessment (was Capsone Requirements), initiated by Catherine Wehlburg.
      • The Student Opinion Scale (pdf files)
        • Self-report scale of test-takers’ motivation, to help inform interpretation of assessment results.
        • From James Madison University’s Center for Assessment & Research Studies (CARS).

      The Value of Academic Libraries: A Comprehensive Research Review and Report (pdf files)

       Tools to Help Organize Assessment Information

        • ASSESS discussion-list threads on users’ experience with assessment management software (see the list archive)
          • February 2006 thread Assessment Tracking Systems, initiated by David Kale.
          • August 2006 thread Assessment Reporting Software, initiated by Margie Hobbs. Margie’s summary in the associated thread Assessment Management Software includes a Word document with information from a number of vendors (thanks, Margie).
          • July 2008 thread Assessment Management Systems, initiated by Janine Vienna. Steve RiCharde’s July 11 posts include a draft chapter on things to consider when selecting assessment management software (Word document) and a partial list of vendors (Excel file) — thanks, Steve.
          • February 2012 thread Assessment Data Management System, initiated by Teresa Rothrock.
          • August 2012 thread Question About Assessment Software, initiated by Lisa Woodward.
          • October 2012 thread Assessment Systems, initiated by Michelle Todd, and the associated thread Re: Assessment Systems (Attachment) with an Excel file of information on various vendors’ systems, from Susan DeMatteo (thanks, Susan).
          • April 2013 thread Seeking Assessment Management System (AMS) Feedback, initiated by Susan DeMatteo.
          • April 2013 thread Curriculum Outcomes Mapping Software, initiated by Larry Peterson.
          • April 2013 thread LiveText, initiated by Kim Black, and the associated threads Kim Black – Adopting LiveText, initiated by Steven McDonald and LiveText (for Kim Black), initiated by Denise Moseley.
          • December 2013 thread Software to Store and Analyze Student Learning Outcomes and Progress in Institutional Goals? initiated by Susan Hayes.
          • December 2013 thread Assessment Support Software, initiated by Dan McCollum.
          • June 2014 thread Separate Systems for Strategic Plan Assessment and Institutional Assessment? initiated by Susan Hayes.
          • June 2014 thread Software for Assessment Reporting AND Faculty Activity Reporting? initiated by Donna Vinton.
          • September 2014 thread Assessment Software, initiated by Lisa Cota. Also see the associated thread Lisa Cota Request, initiated by Bobby Matthews.
          • November 2014 thread Feedback Requested on the Assessment Software Weave/Performance Cloud, initiated by Kimberly Gargiulo.
        • This is just a list. It’s not exhaustive and inclusion doesn’t imply a recommendation or evaluation.
        • AEFIS (Academic Evaluation, Feedback and Intervention System) assessment management software. Developed at Drexel University for ABET self-studies, but flexible enough for other course-based assessment processes.
        • AMEE (Assessment Made Easy Everyday), from Midwest Social Science Research Associates (MSSRA).
        • aPlus+, from Cobek, for organizing & summarizing assignment details & grades.
        • Better Assessment organizes & manages faculty assessments of students’ written material.
        • Blackboard’s Learn Platform includes tools for for assessment processes, information, and reports. Integrated with tools for course information, surveys, document and portfolio management, and user-community interaction.
        • CampusLabs
          • Baseline management system for survey & rubric-based assessments.
            • Select Products, then Baseline.
            • This was formerly StudentVoice.
          • Compliance Assist manages assessment data as well as other information for accreditation, planning, and program review reports.
        • CurricUNET’s curriculum management system includes an assessment module.
        • Digication’s Assessment Management System for collecting and managing assessment information includes portfolio, rubric, and reporting tools.
        • eLumen Achievement database for assessment processes, rubrics, results, and reports.
        • ExamSoft’s tools create, administer, & score exams and other assignments, and include rubric-based scoring, student feedback, and reports for course, program, or institutional learning outcomes.
        • FASI-Online assessment documentation system.
        • iSocrates system for rubric-based grading and student feedback on individual assignments. For program or cross-program assessment, data can be exported to spreadsheets or class management systems for aggregation. Registered users can share rubrics they’ve generated for specific tasks or assignments.
        • LiveText Accreditation Management System for collecting data and organizing outcomes, rubrics, results, etc.
        • Maple T.A. from Maplesoft, for creating, presenting, grading, & organizing results from mathematics/science assignments & exams, can also be used for non-math/science courses.
        • Mentor, from Axiom Education.
        • OATS (Online Assessment Tracking System) from Georgia Institute of Technology’s Office of Assessment. OATS is available for download by other institutions.
        • openIGOR: A free Linux-based open-source program to manage information about program outcomes and assessment-related documents. From David Eubanks, now at Eckerd College.
        • PASS-PORT, from Innovative Learning Assessment Technologies. Includes versions specialized for business program, nursing program, and teacher-education program accreditation management.
        • rGrade, from Educational Informatics.
        • RXoutcome, for pharmacy programs, also includes portfolio tools.
        • Strategic Planning Online includes an assessment-management component.
        • TaskStream’s tools to organize, review, & summarize assessment information, and for assignment & e-portfolio assessment.
        • ThinkTank facilitates collaboration and can record and store information from assessment group meetings.
        • TK20’s CampusTools HigherEd and CampusWide include tools for electronic portfolios and online surveys.
        • TracDat tracks assessment processes & information and produces reports. From Nuventive.
        • WEAVEonline tracks assessment processes & information and produces reports.
          • Weave Technology’s PerformanceCloud integrates institutional research, institutional effectiveness, outcomes assessment, strategic planning, & accreditation processes.
    • WIDS (Worldwide Instructional Design System) curriculum-design software includes tools to monitor outcomes and associated rubrics and results. Select Products, then Read more….
    • The Programs module of Xitracs’ accreditation compliance tool includes assessment management.
    • TRIADS: Assessment of Learning Outcomes
      • TRIpartate Assessment Delivery System: A joint project of the University of Liverpool, the University of Derby, and the Open University.
      • TRIADS Engine: Authorware for developing online assessments.
      • Sample learning outcomes (for earth science programs).
      • TRIADS activities and implementations.

      Voluntary Framework of Accountability (VFA)

      • Project to develop VSA-like definitions and reporting templates for community colleges.
      • See About VFA for the project’s history and information about VFA’s measures (pdf files).
      • A joint project of AACC, ACCT, and the College Board.

       Voluntary System of Accountability (VSA)

      • College Portrait: Definitions and web-reporting template for college/university characteristics including retention & progress rates, general-education learning outcomes, and student experiences and engagement.
        • Innovations include reporting cross-institutional retention/progress, based on National Student Clearinghouse data, and common reporting formats for results from specific sets of standardized tests and surveys.
        • Individual institutions’ data (pdf files) are available at the College Portrait site. Search for Colleges by name or state.
      • A joint project of AASCU and APLU. Currently, only member institutions may participate.
      • NILOA⬔s report Transparency & Accountability: An Evaluation of the VSA College Portrait Pilot focuses on the student-learning outcomes assessment component. It summarizes how viewers use the College Portrait and how institutions see its utility, and makes recommendations for future versions (pdf file).

      What Outcomes Assessment Misses

      • From the TLT Group, so it focuses on assessment about technology — but the general points apply to any assessment project.

     

Most Recent Artifacts for Use

Stay connected. We're continuing to build & create new artifacts to use in your classroom.

Volume I Series I

Here is a short description area of this intervallum

View Artifact

Subscribe
Join Assessment Commons for the latest. Get updates when new links and content are added live straight to your inbox. It's free.
Don't worry, we don't send spam.
Never display this again