|
Portland State
University Research Update Office of Institutional Research and Planning Volume 4, Issue 4, Winter 2001
Portland State University (PSU) participated in a pilot implementation of the National Survey of Student Engagement (NSSE) during fall 1999. The purpose of NSSE is to assess the institutional learning environment for undergraduates. In order to represent students at the early and late stages of their college careers, the survey sample at each participating school included both sophomores and seniors. Institutional response rates for the NSSE ranged from 28% to 59%. The overall response rate across institutions was 43%. At PSU, 244 of the 677 students included in the sample responded to the survey resulting in a 36% response rate. This summary reports the PSU survey results for sophomores and seniors and compares them to results at other urban universities (UUs) and at large public research universities (LPRUs). All reported differences are statistically significant (p < .05). General Satisfaction Respondents used a 4-point scale (1 = poor to 4 = excellent)
to rate their overall satisfaction with their institution. PSU students
rated their experience as good (M = 2.90). Students also answered
the question, "If you could start over again, would you go to the
same institution you are now attending?" Using a scale
Frequency of Active Learning Experiences Respondents indicated how often they participate in active learning experiences using a 4-point scale (1 = never to 4 = very often). PSU students discussed ideas from their readings or classes with others outside of class most frequently (M = 2.86). Asking questions in class or contributing to class discussions (M = 2.76), making class presentations (M = 2.69), and using e-mail to communicate with instructors or other students (M = 2.67) were also frequent activities. PSU seniors, more often than sophomores, talked about career plans with a faculty member or advisor (M = 2.05 & 1.74 respectively) and participated more often in community-based projects as part of their regular courses (M = 1.70 & 1.31 respectively). Sophomores (M = 2.82) made class presentations more frequently than seniors (M = 2.58).
PSU sophomores talked with faculty members or advisors about career plans less frequently than LPRU sophomores (M = 1.74 & to 2.15 respectively). In addition, sophomores at PSU used E-mail to communicate with instructors or other students (M = 2.75 & 3.09 respectively) and electronic media (e.g., E-mail, list-serves, or chat groups) to discuss or complete assignments (M = 2.19 & 2.49 respectively) less frequently than those at LPRUs. A similar pattern held true for seniors at PSU and LPRUs. Also, PSU seniors, compared to LPRU seniors, had less frequent discussions about grades or assignments with instructors (M = 2.39 & 2.57 respectively) and less frequent serious conversations with students who hold different beliefs, opinions, or values from respondents’ own views (M = 2.31 & 2.63 respectively). PSU ratings of active learning experiences were generally similar to other UU student ratings; PSU students differed from other UU students on only four items. PSU seniors participated more frequently than other UU seniors in community-based projects as part of regular coursework (M = 1.70 & 1.37 respectively). PSU sophomores, compared to sophomores at other UUs, make more frequent class presentations (M = 2.82 & 2.44 respectively), and work more often with classmates outside of classes to prepare assignments (M = 2.63 & 2.33 respectively). PSU sophomores are less likely than other UU sophomores to talk about career plans with faculty members or advisors (M = 1.74 & 1.99 respectively). Reading and Writing Respondents rated the amount of reading and writing they accomplished during the previous academic year using a 5-point scale (1 = none), 2 = fewer than 5, 3 = between 5 and 10, 4 = between 11 and 20, and 5 = more than 20). On average, PSU students read between 11 and 20 assigned textbooks, books, or book-length packets of course readings (M = 3.66), whereas they read fewer than five unassigned books on their own (M = 2.40). PSU students wrote between 11 and 20 short papers or reports (i.e., less than 20 pages in length) (M = 3.59) and fewer than five long papers or reports (i.e., 20 or more pages) (M = 1.47). Seniors (M = 1.64) wrote more long papers than sophomores (M = 1.27).
Critical Thinking Respondents used a scale (1 = very little to 4 = very much) to estimate how much their coursework has emphasized five mental activities corresponding to levels of critical thinking skill. PSU students indicated that "quite a bit" of their coursework emphasizes analyzing the basic elements of an idea, experience, or theory (M = 2.97). They indicated that "some" of their coursework emphasizes making judgements about the value of information, arguments, or methods (M = 2.55). The coursework of PSU seniors (M = 2.81) compared to sophomores (M = 2.55) more heavily emphasized synthesizing and organizing ideas, information, or experiences. The critical thinking activities of PSU students did not differ from those of students at other UUs or LPRUs. Special Types of Coursework The survey items pertaining to special types of coursework asked students to report past or expected future participation. Therefore, seniors were more likely to report past actual behavior and sophomores were more likely to report a mix of past actual behavior and predicted future behavior on these items.
Use of Time Student use of time is likely to be related to the number of classes in which they enroll and the NSSE samples included both full- and part-time students. Possible differences in student load within groups, between class levels, and among PSU, other UUs and LPRUs are not factored into the reported responses, but should be kept in mind when interpreting the results. Students used a scale (1 = 5 or fewer hrs, 2 = 6 – 10 hrs, 3 = 11 – 15 hrs, 4 = 16 – 20 hrs, 5 = 21 – 25 hrs, 6 = 26 – 30 hrs, and 7 = more than 30 hrs) to estimate the hours they spend during a typical week engaging in a variety of activities. On average, PSU students spent the most hours working for pay off campus (M = 3.70) and preparing for class (M = 3.59). They spent the fewest hours working for pay on campus (M = 1.37) and participating in co-curricular activities (M = 1.31). PSU seniors and sophomores spent their time similarly to each other and to students at other UUs. PSU student use of time differed from LPRU student use of time. PSU students spent more hours than LPRU students caring for dependents who live with them (M = 2.39 & 1.31 respectively for seniors and M = 2.00 & 1.15 respectively for sophomores). PSU students also spent more hours than LPRU students spent working for pay off campus (M = 3.55 & 2.30 respectively for seniors and M = 3.87 & 1.53 respectively for sophomores). Seniors at LPRUs (M = 1.84) spent more hours than PSU seniors (M = 1.41) working for pay on campus. In contrast, PSU students spent less time on leisure activities such as participating in co-curricular activities (M = 1.31 & 1.90 respectively for seniors and M = 1.32 & 2.00 respectively for sophomores) or relaxing and socializing (M = 2.89 & 3.31 respectively for seniors and M = 2.87 & 3.41 respectively for sophomores). Learning Outcomes Respondents rated the extent to which their college education contributed to their knowledge, skills, and personal development on a 4-point scale (1 = very little to 4 = very much). PSU students indicated that their college education had contributed the most by helping them to think critically and analytically (M = 3.18) and acquire a broad, general education (M = 3.13). PSU seniors more than sophomores felt that their college education had contributed to their general education (M = 3.23 & 3.00 respectively) and their work-related knowledge and skills (M = 2.84 & 2.46 respectively). PSU students indicated that their college education had contributed the least to helping them fulfill their civic duty by voting in elections (M = 1.75), contribute to the welfare of their community (M = 2.16), and be honest and truthful (M = 2.41). These results do not mean that PSU students lack honesty, a sense of volunteerism or civic duty; instead these results indicate that students did not feel that PSU contributed to these aspects of their personal development, regardless of individual levels of growth in these areas.
College Support Environment PSU students used a 4-point scale (1 = very little to 4 = very much) to rate the extent to which PSU emphasized a supportive college environment. PSU seniors and sophomores were similar in their responses to each other and students at other UUs. PSU students indicated that PSU emphasized spending significant amounts of time studying and producing academic work (M = 3.02). They also reported that PSU placed less emphasis on helping students cope with non-academic responsibilities such as work and family life (M = 1.68). PSU seniors did not differ in their ratings from LPRU seniors. PSU sophomores (M = 1.68) reported receiving less support coping with non-academic responsibilities when compared to sophomores at LPRUs (M = 1.92). PSU sophomores were also less likely than LPRU sophomores to report that their institution provided support to help students succeed in academic work and meet personal goals (M = 2.52 & 2.79 respectively). These differences might be related to PSU and other urban university students’ higher levels of need for this support rather than an indication of differences between institutional types. Quality of Relationships Respondents rated the quality of their relationships with people at their school using 7-point scales (where 1= least favorable and 7 = most favorable rating). On average, PSU students were favorable in their ratings of other students and faculty. PSU students indicated that their relationships with other students were somewhat friendly and supportive, and that they experienced a sense of belonging (M = 4.93). They described faculty members as somewhat available, helpful and sympathetic (M = 4.79). PSU student ratings of administrative personnel and offices were more neutral (M = 4.09); some students found personnel to be helpful, considerate, and flexible, whereas other students found personnel to be unhelpful, inconsiderate, and rigid. The ratings of PSU sophomores and seniors did not differ from each other or from ratings of students at other UUs. In addition, PSU seniors did not differ from LPRU seniors in their ratings of relationships. However, PSU sophomores (M = 4.81) were less likely the LPRU sophomores (M = 5.43) to describe their relationships with other students as friendly and supportive. Conclusions The results of the NSSE indicate the extent to which students are engaged in good educational practices and what they gain from their college experience. Items on the NSSE ask about student behaviors that correlate with positive learning and personal development outcomes of attending university. PSU students were generally satisfied with their education. Overall, their experiences and activities were on par with those of other urban university students. More PSU students than LPRU students participated in community-based projects as part of their coursework. PSU students also felt more strongly than LPRU students felt that their college experience had contributed to clear and effective writing skills. These results indicate that PSU has helped students achieve desirable learning outcomes. PSU students spent more time than LPRU students did working for pay off-campus and caring for dependents. This finding suggests that PSU students may have a greater need for institutional support in helping to balance competing responsibilities. Portland State University is participating in the NSSE again during winter 2001. The sample for this administration will consist of freshmen and seniors. For more information about these results and future administrations of NSSE, please contact Juliette Stoering, Office of Institutional Research and Planning, 503-725-3427, stoeringj@pdx.edu. |