Topics Map > Cobra Learning
Cobra Learning - Viewing quizzes
Viewing quizzes
Submitting a user's quiz
If a user starts a quiz but does not submit the attempt, the quiz displays as "in progress" on the Grade Quiz page, and the Enter Quiz as User (people) icon appears beside the attempt. If you want to submit the quiz for the user:
- Go to the quiz and select Grade from the context menu.
- Click Show Search Options.
- Change the option filter to Users with attempts in progress and click the magnifying glass/search icon above the filter. This will display students who have a quiz that is pending.
- Click the Enter Quiz as User (people) icon beside the quiz attempt in progress.
- Click Go to Submit Quiz and follow the prompts.
- Click Submit Quiz. You will return to the Grade Quiz page and stop impersonating the user.
Note You will need to reset your filter to Users who have submitted an attempt. (There is a special KB article for this process).
Viewing quiz statistics
You can view and export quiz statistics to a CSV file for data analysis. The CSV file contains all applicable information on the quiz so that you can query, sort, and evaluate the data without being connected to the learning management system. In this view, you can see a list of quizzes for the course. The average grade for each quiz displays beside the quiz name.
- All statistics are calculated based on a user's first attempt of the quiz. If a question is changed after attempts have occurred, then only the attempts on the newest version of the question are included in the statistical calculations.
- Average grade is calculated only for first attempts of the quiz.
- Quiz statistics are not available on pool or randomized quizzes.
Table of contents
- View quiz statistics
- Understanding User Stats
- Understanding Question Stats
- Understanding Question Details
- Understanding statistic types
View quiz statistics
- On the Manage Quizzes page, click Statistics from the context menu of the quiz you want to view.
- On the View Statistics page, click the User Stats, Question Stats, and Question Details tabs to view statistics broken down by user and by question.
- Click Export to CSV file if you want to save the quiz's statistics to your computer.
Note The system will export the statistics only from the tab you are currently viewing.
Understanding User Stats
User Stats CSV files contain performance data by user, including the user’s Org Defined ID, username, first name, last name, quiz score, the value the quiz was graded out of, the user’s score as a percentage, the class average, and the standard deviation for the class.
Tip Create a column in the CSV file to calculate the median score on the quiz to consider the class’s performance from a different perspective. Use the formula <=median(x1:x5)> to calculate the median.
Understanding Question Stats
Question Stats CSV files contain data about the average score on questions by points and percentage, as well as the standard deviation, discrimination index, and point biserial for each question.
The question title, text, bonus status, and difficulty level are included in the CSV file so that data can be analyzed without referring back to the learning management system.
Tip You can sort, query, hide, and delete data in the CSV file to help your analysis and create charts or graphs to visually represent trends.
Understanding Question Details
Question Details CSV files contain detailed information about each question in the quiz, including a list of all of the answers provided for each quiz attempt, how many users chose each possible answer, the total number of responses, and the average score, standard deviation, point biserial, and discrimination index for each question. Question Details reports can help you evaluate trends in answers and look for questions that were unclear or difficult for a number of users.
The question title, text, bonus status, and difficulty level are included in the CSV file so that data can be analyzed without referring back to the learning management system.
Tip Create a column that calculates the average score for all question attempts as a percentage by dividing the Average Score column by the Out Of column and multiplying by 100. Next, create a custom filter for the new Attempt Average column that displays only rows where the attempt average is less than 51%. This way you can quickly review questions that users struggle with and adjust grades or your lesson plans accordingly.
Data exported for question details
Question type | What is exported |
---|---|
Multiple Choice | All of the possible answers and the number of responses for each answer. |
True or False | All of the possible answers and the number of responses for each answer. |
Long Answer | All of the responses provided listed on separate rows. |
Short Answer | The correct answer for each blank and an additional row for all other answers, and the number of responses for the correct answer versus other answers. |
Multi-Short Answer | The correct answers for each blank and an additional row for all other answers, and the number of responses for the correct answer versus other answers. |
Fill in the Blanks | The correct answers and an additional row for other answers, and the number of responses for the correct answer versus other answers. |
Multi-Select | All of the possible answers and the number of responses for each answer. |
Matching | All of the possible matches and the number of responses for each match. |
Ordering | All of the answers in the order match and the number of responses for each match. |
Arithmetic | Questions broken down by results and units. Also lists which users had both results and units correct, only results correct, only units correct, and neither correct. |
Significant Figures | Questions broken down by results and units. Also lists which users had both results and units correct, both results and units correct as well as significant figures, only results correct, only results and significant figures correct, only units correct, and neither results or units correct. |
Understanding statistic types
Note: The discrimination index and point biserial are rendered more inaccurate the more edits you make to a quiz.
Statistic type | What is measured |
---|---|
Standard deviation | The standard deviation indicates how much scores vary from the average, ranging from 0% to 100%. A high standard deviation indicates that scores are spread out from the average, whereas a low standard deviation indicates that scores are close to the average. |
Discrimination index | The discrimination index indicates how well a question differentiates between high and low performers. It can range from -100% to 100%, with high values indicating a "good" question, and low values indicating a "bad" question. |
Point biserial | The point biserial correlation coefficient is an analysis applied to multiple choice and true/false question types that have only one answer with a weight of 100%, and all other answers with a weight of 0%. The point biserial correlation coefficient relates individuals' quiz scores to whether or not they answered a question correctly. It ranges from -1.00 to 1.00, with high values indicating a "good" question, and low values indicating a "bad" question. Note Only first attempts with scores between 0% and 100% on a question are included in that question's statistics. |
Viewing quiz reports
You can view and export quiz reports to a CSV file for data analysis. The CSV file contains all applicable information from the quiz so that you can query, sort, and evaluate the data without being connected to the learning management system. You must set up quiz reports from the Reports Setup tab for the appropriate quiz before you can view or export reports. See [Link for document 485551 is unavailable at this time] for more information about creating reports.
Notes
- All statistics are calculated based on a user's first attempt of the quiz. If a question is changed after attempts have occurred, then only the attempts on the newest version of the question are included in the statistical calculations.
- Average grade is calculated only for first attempts of the quiz.
View a quiz report
- On the Manage Quizzes page, click Reports from the context menu of the quiz you want to view.
- Click on the report you want to view.
- Select the From and To check boxes and set the calendar dates to restrict your report to a specific time frame.
- Click Generate CSV Report to save the report as a CSV file on your computer, or click Generate HTML Report to view the report in your browser.
Data exported with quiz reports
Report Type | What it includes |
---|---|
Question Statistics | The average score on questions by points and percentage. Unlike a report created using the Questions Stats tab on the Quiz Stats page, you can choose to exclude the class average, score distribution, bonus questions, the Out Of value, standard deviation, point biserial, and discrimination index. You can also set a release date for this report and select roles to release the report to. |
Question Details | All of the answers provided for each quiz attempt, how many users chose each possible answer, the total number of responses, and the average score on each question. Unlike a report created using the Question Details tab on the Quiz Stats page, you can choose to exclude the level of difficulty, text responses, bonus questions, private comments added to the report, standard deviation, point biserial, and discrimination index. You can also set a release date for this report and select roles to release the report to. |
Users Statistics | The class average and standard deviation, score distribution, and the grade of each user. Unlike a report created using the User Stats tab on the Quiz Stats page, you can choose to exclude the class average, score distribution, and Org Defined ID. You can also set a release date for this report and select roles to release the report to. |
Attempt Details | The Org Defined ID, username, first name, and last name of each user. Detailed information about each question. The users’ responses for each question organized by attempt, including how long each attempt took. The ability to set a start or end date for which attempts to include. You can also set a release date for this report and select roles to release the report to. |
User Attempts | The Org Defined ID, username, first name, and last name of each user. The users’ score for each question in points and percentage organized by attempt, including how long each attempt took. The ability to set a start or end date for which attempts to include. You can also set a release date for this report and select roles to release the report to. |