Institutional Effectiveness & Assessment:Assessment Guidelines
Establish clear, measurable expected outcomes of student learning.
The mission communicates the overarching purpose of the degree program. A brief statement about the general values, principles that guide the curriculum, and learning experiences provided by the program should be included. Indicate how the mission is aligned with the mission of the department, college, and university.
Use the following prompts as a guide:
- What is the degree program name?
- What is the educational purpose of the program?
- What is the primary function of the program?
- What are the primary activities or learning experiences provided by the program?
- Does the mission implicitly or explicitly align the program with the mission of the department, college, and university?
Learning outcomes convey the specific knowledge, skills, and abilities that students should be able to demonstrate at the end of the degree program. Well-written outcomes include concrete action verbs that appropriately specify the level of learning indicated by the program.
Use the following prompts as a guide:
- What level of learning (Blooms action verb) is taking place?
- What knowledge, skill, or ability should students demonstrate at the end of the program?
External Resources
What are the characteristics of well-stated learning outcomes? Blog post by Linda Suskie
Blooms Action Verbs, Resource by University of Nebraska
A learning outcome generator, Resource by Indiana University
Ensure that students have sufficient opportunities to achieve those outcomes.
A curriculum map makes visible how courses in a curriculum align to the program's learning outcomes. In its simplest version, the curriculum map is built on a two-dimensional matrix, with the outcomes arrayed across the top and courses listed down the left side. A mark is made in the box where a course addresses an outcome.
Use the following prompts to create a curriculum map:
- What are we mapping and why?
- What parts of the learning environment are included or left out by this approach?
- Who should be involved in the conversations?
External Resources
Example Curriculum Maps and Toolkit, Resource by the National Institute of Learning Outcomes Assessment (NILOA)
See an example of a graduate program curriculum map, Resource by University of Wyoming
See examples of undergraduate program curriculum maps, Resource by Washington State University
Best Way To Collect Information
Creating a curriculum map helps individual faculty connect the dots between their course and the goals of the program. It also helps determine where assessment information should be collected.
Use the following prompts to collect information from faculty:
- Which student learning outcomes are taught in this course?
- What assignments demonstrate each of these outcomes?
External Resources
Download a Curriculum Mapping Tool (excel) to share with faculty, Resource by Carnegie Mellon
Follow these steps to develop a curriculum map, Resource by Washington State University
An important part of creating or updating a curriculum map is talking with faculty about what is happening in their courses and within the curriculum. This exercise improves communication about curriculum and promotes program coherence.
Use the following prompts to guide a review of the curriculum map:
- How is this outcome taught in the course and to what level (introduced, reinforced, mastered)?
- What is happening in all course sections vs what is happening in some course sections?
External Resources
Curriculum Mapping Instructions and Examples, Resource by Texas A&M University
Levels of Emphasis Curriculum Mapping Scale, Resource by Wabash Center
Analyzing the curriculum map can help inform decisions about course offerings, sequencing, and scheduling. The map can also reveal strengths and weaknesses within the curriculum.
Use the following prompts to guide a programmatic discussion about the curriculum:
- In the key courses, are all outcomes addressed, in a logical order?
- Do all the key courses address at least one outcome?
- Do some outcomes get more coverage than others?
- Do students get practice on all the outcomes before being assessed?
- Do all students, regardless of which electives they choose, experience a coherent progression and coverage of all outcomes?
External Resources
Use the Curriculum Mapping Toolkit to guide departmental discussions and decision making, Resource by the National Institute of Learning Outcomes Assessment (NILOA)
Systematically gather, analyze, and interpret evidence to determine how well students are meeting our expectations.
Well-developed measures collect information that is relevant, meaningful, and actionable to the program. Two measures should be used to evaluate each student learning outcome and should include at least one direct measure.
Measures are opportunities for programs to collect information about how well students are demonstrating or performing the Student Learning Outcomes (SLOs).
Use the following prompts as a guide:
- Where and how are students demonstrating the learning outcome?
- What is the purpose of the measure and how does it relate to the outcome?
- How is the measure of student learning evaluated (rubric, faculty panel, answer key, survey, etc.)
- What scale, criteria, or standard is used to evaluate the student learning outcome?
- How is this consistently measured across administrations?
- What makes this measure trustworthy and useful?
External Resources
Choosing an assessment method, Resource by University of Hawai'i at Manoa
VALUE Rubrics, Valid Assessment of Learning in Undergraduate Education, Resource by Association of American Colleges & Universities
A Target is an established achievement level that states how well and how many students in the program should be able to demonstrate a particular knowledge or skill.
Use the following prompts as a guide:
- What is the expected standard of performance?
- How many students should be able to achieve this standard of performance?
Results simply report how well students are performing against the goals set by the program. The target achievement status (eg. exceeded, met, partially met, not met) should also be indicated.
Use the following prompts as a guide:
- Do the results report on the information described in the target?
- If using percentages or some other calculated final tally, what are the numbers involved in creating the final result? (e.g. 87/94=92.55%)
- Did the program clearly state achievement of the target (target status)?
Use the resulting information to understand and improve student learning (Suskie, 2014).
This is where programs answer the "so what?" question. This asks programs to extrapolate meaning from the results and provide additional detail or context to fully explain the results to an outside reader. Various levels of analysis could be conducted to make sense of the information. It is especially important to compare learning environments and analyze the results over time to look for trends. This is an opportunity for faculty to make sense of the results against the larger landscape of the program and factors impacting the student learning outcome.
Use the following prompts as a guide:
- What are the strengths and weaknesses of student learning in this area?
- For programs with both online and face-to-face degree options: how does the performance of these unique learning environments compare?
- How do the results compare to previous years?
- How do the results fit into the larger landscape of student learning in the program?
- How were results shared within the program?
This asks programs to follow up and describe completed action plans, modifications, or improvements made by the program. This is an opportunity for programs to tell their story and connect the dots between the student learning outcome, assessment results that prompted action, and the modifications that were made. The program should outline and determine the impact of their changes on student learning.
Use the following prompts as a guide:
- Why were the changes made? (e.g., the student learning outcome and the information that prompted action)
- What changes were made during the year or in previous years that impacted student learning?
- What impact did this have on student learning?
This is where programs answer the "now what?" question. Programs should explain their process for sharing and using assessment results to make decisions in areas such as curriculum, pedagogy, and other aspects that impact learning. The strength of assessment is not that it provides quick fixes for a problem, but that it promotes active, informed, and systematic improvement of a program through discussion among faculty. This is an opportunity to review student learning data and make decisions as a program.
Use the following prompts as a guide:
- How is assessment information about the quality of learning shared and used for program decision making in areas such as curriculum, pedagogy, and other aspects that impact learning?
- What actions do the results suggest need to be implemented?
- What concrete actions will the program take to sustain or improve this outcome? What is the timeframe of these actions?