“Effective assessment doesn’t just happen. It emerges over time as an outcome of thoughtful planning, and in the spirit of continuous improvement, it evolves as a reflection on the processes of implementing and sustaining assessment, suggests modifications.” – Banta, T. W., Jones, E. J., and Black, K. E. (2009). Designing Effective Assessment. Jossey-Bass: San Francisco, CA.
Many institutions use CIRP survey results in the accreditation process. Because CIRP surveys are comprehensive and designed to examine change over time, colleges and universities have found them flexible and useful tools in their institutional selfstudies. Participation in longitudinal CIRP surveys is also frequently cited as evidence of an institutional commitment to assessment and improvement efforts. Through collaborative ventures on campus, results from CIRP surveys are used to document assessment and improvement efforts, as well as to establish the need for and the effectiveness of initiatives aimed at improving the student experience.
Here are some examples of how colleges and universities are using CIRP surveys in accreditation.
Higher Learning Commission
2010 HLC Accreditation Guide | 2009 HLC Accreditation Guide
Grinnell developed a portfolio of indicators for their reaccreditation work, and used survey data to anchor their themes. Longitudinal CIRP data helped frame their special-emphasis study: “How Can the College Reinvigorate its Traditional Commitment to Educate Leaders for Public Service and Social Justice in the 21st Century?” CIRP survey data illuminated student goals, aspirations, and self-concept. This information provided a foundation to conduct a self-study that went beyond compliance and focused on a set of questions central to Grinnell’s mission.
An examination of CIRP Freshman Survey Data showed Grinnell students reported social commitment goals more often than the national average. Compared to the national population, students at Grinnell and peer colleges were more likely than the national population to want to participate in community action, be involved in environmental cleanup, keep up to date with political affairs, help promote racial understanding, and develop a meaningful philosophy of life. This data prompted further internal focus groups to examine the nature and expectations for leadership and public service among students. The resulting special emphasis serves as the foundation for campus initiatives that seek to be more intentional and explicit about training leaders for social justice and servants of the common, including making goals and models of leadership more explicit in coursework and co-curricular activities.
In Criterion Five of the HLC standards, Core Component 5b addresses the extent to which internal and external constituencies value the services the organization provides. Grinnell used HERI Faculty Survey data to demonstrate that the faculty value the services the college provides in measureable ways. For example, faculty were satisfied or very satisfied with their job, compared to the national average. In particular, Grinnell’s faculty cited office and lab space, quality of students, and salary and benefits as elements that were satisfying.
The Office of Institutional Research, as part of the Diversity & Achievement division and in consultation with the Office of Academic Affairs, plans and follows a schedule of surveys and assessment activities, ensuring that multiple complementary methods provide a holistic view—as well as specific information—for planning and budget priorities. Future objectives include organizing datasets in inter-connected inventories so that Grinnell can more frequently and flexibly validate findings, applying them in new ways to recognize and advance inclusive excellence and student achievement.
Southern Association of Schools and Colleges
2015 SACS Accreditation Guide | 2010 SACS Accreditation Guide
Agnes Scott’s Quality Enhancement Plan (QEP) for 2004–7, “Enhancing the Intellectual Climate Through Enhancing the Four-Year Experience”” focuses on a central element in each of the four years, including, a transition to college engaging student in the intellectual life of the college, participation in community activities outside campus, participation in study abroad or academic internships, and capstone experiences. Each element of the QEP contains a set of goals and student learning outcomes with action plans for assessing progress. Assessing the impact of the QEP includes participation in the CIRP Freshman Survey and College Senior Survey, along with other direct and indirect assessments, to be able to document how strategies outlined in the QEP have affected student learning.
Faculty have also used the analyses to explore possible changes to the curriculum and programming. For example, in the First Year Experience CIRP Freshman Survey and Your First College Year results informed efforts to improve student writing, and the college is working to ensure students in different sections of first year seminars report similar levels of engagement, satisfaction and gains in writing skills.
Wake Forest University highlighted CIRP Freshman Survey results and College Senior Survey results in support of SACS Core requirement 2.5: establishing an institution-wide research-based planning and evaluation process that makes use of assessment for institutional effectiveness. The paper, “Four Years Later: Qualitative and Quantitative Assessment of the Changes in the Class of 2001″” was one of the sources in the self-study and contained relevant results showing how Wake Forest students changed from the freshman to senior year. For example, Wake Forest found students demonstrated improvement in self-confidence, with 62% of seniors, compared to 52% of the same group as freshmen, reporting “above average or higher”” self-confidence. On the other hand, the results also indicated that seniors had less contact socially with students from other races, with 71% of the freshmen reporting they had socialized with other racial/ethnic groups (during the last year in high school) compared with only 40% as seniors at Wake Forest. Recognizing that providing diversity has been a challenge, Wake Forest has used these revealing survey results to take a number of positive steps to improve interaction of students with students of other racial/ ethnic groups.
More information can be found at http://www.wfu.edu/ir/docs/air_6_2002.pdf
Western Association of Schools and Colleges
2014 WSCUC Accreditation Guide | 2010 WASC Accreditation Guide | 2009 WASC Accreditation Guide
In preparing for its Educational Effectiveness Review, Santa Clara University, used matched CIRP Freshman Survey and College Senior Survey data to understand how its students’ beliefs and actions align with the Catholic, Jesuit university’s distinctive mission of educating for competence, conscience, and compassion. A longitudinal study of twelve survey items examined mission-related themes involving compassion, leadership for a just society, and respect for diversity. The analysis revealed that between the freshman and senior year students reported significant gains in the degree to which they value diverse cultures. It also revealed that students perceived compassion-related items, such as helping others in difficulty and participating in community action programs, to be significantly more important in their senior year than they did in their first year. Benchmarking data revealed that mission-related gains exceeded those at other private and four-year institutions. The analysis also showed, however, that despite appearing to value compassion more than they did as first year students, graduating seniors engaged in volunteer work less than they did when they came to Santa Clara.
Santa Clara also compared the findings from recent seniors with results from seniors ten years earlier, and found that, compared to the previous cohort, the more recent seniors said they valued compassion-related activities more highly, but engaged in volunteer work less frequently. Benchmark analysis revealed that this trend also extended beyond the Santa Clara campus to other private and four-year institutions.
At the same time that this analysis was underway Santa Clara implemented a Core (General Education) Curriculum focusing on educating students for “knowledge, habits of mind and heart, and engagement with the world.”” The Core includes requirements that directly address the findings related to the reported declines in volunteer work: an “Experiential Learning for Social Justice”” requirement that provides students with opportunities to work directly with underserved communities, and a Civic Engagement requirement that can be fulfilled with public service internships. Embedded in the Core Curriculum is a multi-year plan for direct assessment of student work in each Core area.
Santa Clara is planning to replicate the analysis, pairing it with direct assessments of student learning in related areas of the curriculum.
At Occidental College we have been participating in the Freshman Survey since 1966, the Faculty Survey since 2000, the College Student Survey since 2001, and Your First College Year since 2005. The data has helped us both in short and long-term decision making and planning. Some of the research questions we are currently investigating through CIRP surveys include: Why do students choose Occidental?; How have Occidental students changed in the last 20 years?; Has student satisfaction with advising improved since the opening of the new advising center?; and How, and to what extent does study aboard enhance student attitudes toward diverse values and beliefs?
We have also found CIRP survey results to be invaluable for our current accreditation process. CIRP questions map nicely to the WASC Standards, so selecting data to include as evidence of meeting specific Standard criteria is simple. And in some cases we also used the results to support decisions that needed to be made to address areas where we were not meeting criteria. In addition, the flexibility of the surveys has allowed us to add accreditation-related questions to an existing mechanism that will help us track issues in the years between formal reviews.
HERI is developing guides which align CIRP survey results with all 6 regional accrediting agencies. Does your institution use CIRP survey results in accreditation? If so, we want to know. Please contact HERI at heri@ucla.edu.