Body
Table of Contents
All for-credit courses with at least one student enrollment will be evaluated, except those tutorials for which the catalog number is appended by a T (e.g. 3450T). In order to protect student anonymity, instructors do not receive results reports for classes with fewer than five students.
Before the evaluation period
Thirty (30) days before the evaluation period begins, Blue sends evaluation administrators a form preview email for each course with an upcoming evaluation. Form preview tasks must be completed by evaluation administrators before the evaluation surveys are launched, two (2) weeks before the last day of the course for classes that run for seven (7) weeks or longer, and five (5) days before the end of the course for classes that run for six (6) weeks or shorter. If you are new to previewing forms, we recommend following the following process:
-
Sign into Blue and view the My Tasks widget (or open the first email notification).
-
Select “Start Now” to the right of the first task to open the form preview (or select the task link in the email).
-
On the Form Preview page, you can select “Preview” to open a new tab that shows exactly what a student would see, or you can just review a list of the questions by selecting “Expand All.”
-
If you see an issue, submit a ticket with the details about what you see and what you want to see (include the course info, such as the course name and section, as well as the instructor’s name).
-
When you are satisfied by the appearance of the form, select the “Submit” button on the form preview and this should dismiss the task so that it drops off of your “My Tasks” widget/list.
During the evaluation period
For courses that run seven (7) weeks or longer, instructors and students are notified of the evaluation launch by an email sent from CourseEvaluations@ohio.edu two (2) weeks before the published course end date. The evaluation start for courses that run six (6) weeks or less will be five (5) days before the course end date. The student version of the email contains a link to the survey. Instructors and students may also access evaluations via Canvas (the learning management system) or by signing into Blue directly. In addition, instructors may share the evaluation link or QR code with students in class, as well as send email reminders from the subject management area in Blue. Throughout the evaluation period, instructors can monitor response rates in Blue, but cannot see the identities of those who have participated (or not).
Blue automatically sends reminder emails to instructors and to students who have not yet responded to the survey two (2) days and four (4) days after the evaluation begins. In addition to these two reminders, instructors may also generate student reminder emails at will. Students will stop receiving reminder emails after they've submitted the evaluations. Upon submission, students receive a 'your feedback for [class] has been submitted' message on screen only.
Evaluation surveys for courses that run seven (7) weeks or longer are open for eight (8) days, concluding at 11:59 PM one (1) week before the course end date (before final exams begin). The evaluation surveys for courses that run six (6) weeks or less will close at 11:59 PM on the last day of class. In all cases, no responses are accepted after data collection closes. If you are unsure of a course end date, you can find it in the Faculty & Advising Center (if you have the appropriate access) and in the Course Offerings Search.
After the evaluation period concludes
After final grades are due for the term, instructors and college evaluation administrators receive an email from Blue for each course that meets the enrollment and response thresholds. These emails contain links to the evaluation results report in Blue and to the Student Evaluations of Teaching Dashboard in PowerBI. Instructors and administrators may also find past results reports at any time by signing into Blue directly (see "View all reports" link in My Reports widget) or via the Student Evaluations of Teaching Dashboard.
-
Reports are sent out by email after grades are due for the full term.
-
Academic unit staff will receive a copy of the college and department reports for which they are responsible, as well as a copy of each individual course report that falls under that/those department(s).
-
Course reports are only generated for courses with at least five (5) students enrolled and for which at least one (1) evaluation response was submitted, but the response data for courses that do not meet the threshold will be included in the aggregated department and college reports.
Student Evaluations of Teaching Dashboard
The Office of Information Technology (OIT) has developed a PowerBI report dashboard to provide instructors and academic leadership with access to more robust reporting of evaluation data. Instructors and evaluation administrators will continue to receive the automated reports emails from Blue for individual course results and department/college reports.
Accessing the dashboard
- The first time you access the dashboard, you will need to use the direct link that is provided in the automated report notification emails received from Blue (CourseEvaluations@ohio.edu) after the evaluation period ends and term grades are submitted. This link will 'install' the Student Evaluations of Teaching Dashboard app in your PowerBI reports (does not install anything on your device).
- After your first time accessing the dashboard, you may continue to use the direct link, or you can open the dashboard from the PowerBI site:
- Once you've signed into PowerBI with your Ohio account, select Apps from the menu along the left, and then select the Student Evaluations of Teaching Dashboard app in your PowerBI Apps list.
Navigating the dashboard
- Use the menu along the left to navigate between the Welcome page and the Admin Pages section, which includes the Summary View and Question Details pages. The Admin Pages section currently displays a version of the question details page which allows you to select multiple course sections and produce combined data. If you are an instructor, as well as an administrator, you may also see an Instructor Pages section, which includes the same screens, but with more limited data.
- Welcome is a landing page with some basic information about the dashboard and navigation instructions.
- Question Details displays response option rate, number of responses, and mean score for each question on the evaluation form.
- Summary View displays response rates and overall averages for courses and terms, including how averages trend over time.
- On the Summary View and Question Details pages, you'll find various slicers (drop-down menus) that you can use to filter the displayed data. The available slicers include the following variables:
- Term (only terms evaluated in Blue)
- Campus
- College
- Department
- Career (graduate or undergraduate course)
- Component (course type)
- Delivery Type (in-person or online)
- Instructor Name (can only by filtered by academic leadership or college admins)
- Class Section
- Question Section
- Question
- Note that, depending on your level of access, you may not have options for all visible slicers.
- By default, only data for the most recent term is displayed; data for additional terms can be selected with the Term slicer.
- If you do not see a course as an option in the Class Section slicer, either the evaluation did not receive any responses or an evaluation did not occur.
- The slicers are 'sticky,' so when you return to the dashboard, the options selected during your previous session are still in place.
- If you are seeing unexpected values in the data or in the slicer options, select the Clear all slicers button at the top right of the dashboard to reset all of the slicers and start again.
- Response rates can be found on the Summary View page.
Exporting
- To export data from the dashboard, do not use the Export option at the very top of the page. Instead, hover over the desired data and select the More Options ellipsis (...) in the upper right of the frame (outlined with red in the image below), then choose Export Data.
Considerations
- Responses to open-ended questions are not displayed on the dashboard at this time. Student comments continue to be available in the individual course reports that Blue automatically distributes by email to instructors and evaluation administrators.
- To protect student anonymity, data for individual or multiple class sections with fewer than five enrollments (combined) will not display in the dashboard. If slicers are selected for individual or combined sections with fewer than five total students enrolled, the dashboard will be blank.
- Combining course sections
- Administrators have the ability to select multiple course sections to provide combined data in more granular detail than found in Blue's distributed department reports by using the Admin Pages section of the dashboard.
- To protect student anonymity, faculty will be directed to contact evaluation administrators for support with combining course sections in the reporting dashboard.
- This functionality also allows small sections to be combined to share data when the total enrollment for the sections meets or exceeds five students.
- Only combine small enrollment sections for classes that are taught together.