1 (800) 474-9640
[email protected]
  • Client Support
EnovationEnovationEnovationEnovation
1 (800) 474-9640
  • WHAT WE DO
    • OUR SERVICES
      • Consultancy
      • Training
      • Hosting
      • Content Creation
      • Build & Design
      • Support & Maintenance
    • OUR SOLUTIONS
      • Totara’s Talent Experience Platform
        • Totara Learn
        • Totara Engage
        • Totara Perform
      • Aura Talent
      • Moodle
      • Moodle Workplace
      • Go1 Premium Content
  • WHO WE ARE
    • About Enovation
  • CASE STUDIES
    • UDG Healthcare
    • Mercury Engineering
    • Tata Chemicals Europe
    • Aer Lingus
    • Sagemcom
    • HVACRedu
  • OUR PARTNERS
    • Microsoft Teams
    • IntelliBoard
    • BigBlueButton
  • #KeepLearningStrong
  • INSIGHTS
  • CONTACT US

Statistical Analysis of Moodle Quizzes

    Home Blog Statistical Analysis of Moodle Quizzes

    Statistical Analysis of Moodle Quizzes

    Mark Melia | Blog, News | 5 April, 2012

    I am a massive fan of Moodle Quiz. It really is one of the most powerful and comprehensive pedagogical tools in Moodle. From its multiple question types (http://docs.moodle.org/20/en/Question_types) to its many configuration and grading options, its various methods of giving students targeted feedback and its comprehensive reporting, it leaves most other quiz engines in the shade.

    Reporting is one of Moodle Quizzes biggest strengths and an aspect of the quiz that I think people overlook. Today I want to take some timeout just to do some justice to Moodle quiz and share with the world just how fantastic it is.

    Very generally there are two types of reports that can be generated for Moodle quizzes, student report and statistics report. Lets look at each of these reports in a little detail.

    Student Report

    The student report (grades) allows the teacher to see how students are performing in the quiz. The student report allows the teacher to see at a glance averages for questions and students but also allows the teacher to drill down to individual students to individual question and view a log for a student’s behavior in a given question.

    The screen shot below demonstrates a simple example of how summative information for a quiz is displayed.

    Grade report for Moodle Quiz

    Grade report for Moodle Quiz

    For a teacher to review an individual learners attempt he or she just needs to click on one of the marks. This will bring up the question and outline the students response to the question including a log of what the student did while answering the question.

    Question level logs

    Question level logs

    Teachers need to not only know how their students are performing but they also need to know how well their quizzes are performing. Moodle provides a “statistics” report providing basic psychometric analysis of quizzes to do this.

    Statistics Report

    The statistics report is broken into two parts; quiz information, which provides summative stats on the quiz, and quiz structure analysis, which provides detailed information about the quiz’s questions.

    Quiz information contains the following information about a given quiz:

    • Quiz name
    • Course name
    • Open and close dates for the quiz
    • Total number of first/graded attempts
    • Average grade for first/all attempts
    • Median grade
    • Standard deviation of grades
    • Score distribution skewness (for first attempts) – indicating whether there is a long tail on the distribution curve to the left (negative skew) or right (positive skew)
    • Coefficient of internal consistency (sometimes called Cronbach Alpha) – This is a measure of whether all the items in the quiz are testing basically the same thing. Thus it measures the consistency of the text, which is a lower bound for the validity. Higher numbers here are better [1].
    • Error ratio – the variation in the grades comes from two sources. First some students are better than others at what is being tested, and second there is some random variation. We hope that the quiz grades will largely be determined by the student’s ability, and that random variation will be minimised. The error ratio estimates how much of the variation is random, and so lower is better [1].
    • Standard error – this is derived from the error ratio, and is a measure of how much random variation there is in each test grade. So, if the Standard error is 10%, and a student scored 60%, then their real ability probably lies somewhere between 50% and 70% [1].
    The screen shot below outlines how this information is displayed to the teacher.
    Quiz statistics display
    Statistics are also generated for each question. The following looks at the types of statistics that you can expect for each question in your quiz (source: [1]):
    • Q# – shows the question number (position), question type icon, and preview and edit icons
    • Question name – the name is also a link to the detailed analysis of this question (See Quiz Question Statistics below).
    • Attempts – how many students attempted this question.
    • Facility Index – the percentage of students that answered the question correctly.
    • Standard Deviation – how much variation there was in the scores for this question.
    • Random guess score – the score the student would get by guessing randomly
    • Intended/Effective weight – Intended weight is simply what you set up when editing the quiz. If question 1 is worth 3 marks out of a total of 10 for the quiz, the the intended weight is 30%. The effective weight is an attempt to estimate, from the results, how much of the actual variation was due to this question. So, ideally the effective weights should be close to the intended weights.
    • Discrimination index – this is the correlation between the score for this question and the score for the whole quiz. That is, for a good question, you hope that the students who score highly on this question are the same students who score highly on the whole quiz. Higher numbers are better.
    • Discriminative efficiency – another measure that is similar to Discrimination index.
      • Where random questions are used, there is one row in the table for the random question, followed by further rows, one for each real question that was selected in place of this random question.
      • When quiz questions are randomized for each quiz, the quiz module determines a default position.
      • Quiz statistics calculations gives further details on all these quantities.
    Conclusion
    So there you have it, Moodle quiz allows you to see how well your students are performing and how well your quiz itself is performing. This is very powerful stuff giving you the information to create better questions and better quizzes that truly evaluate a students knowledge. 

    References:

    1. http://docs.moodle.org/22/en/Quiz_statistics_report
    Next Previous
    No tags.

    Related Post

    • SCORM and Moodle

      Mark Melia | Blog, News | 3 December, 2010

      In this post I am going to have a look at what the SCORM specification from ADL (Advanced Distributed Learning) is all about and how it relates to Moodle. The post will firstly look atRead more

    • Whats new in Moodle 2.0

      Mark Melia | Blog, News | 5 December, 2010

      Moodle 2.0, the long awaited next generation of Moodle was released on the 24th of November to much aclaim. In this blog post I am going to have a quick look at some of theRead more

    • Creating simple filter in Moodle 2

      Tomek Muras | Blog, News | 8 December, 2010

      Filters in Moodle are pluggable elements that can convert an output text to some other text. This is currently used for the functionality like: replacing text based emoticons with images (emoticon filter) generating images forRead more

    • Welcome to the new Enovation blog

      Mark Melia | Blog, News | 17 December, 2010

      Hello and welcome to the new Enovation Solutions Technical blog. This is the place to go to find all the latest and greatest developments, news and musings from the technical team at Enovation Solutions. Enovation’sRead more

    • Moodle 2.0 File Storage

      Stephen McGuinness | Blog, News | 3 January, 2011

      One of the major re-engineering efforts undertaken for Moodle 2.0 was a complete redesign of the Moodle file storage system. This article compares the Moodle 1.9 and Moodle 2.0 file storage methods.

    • Generate random test data in Moodle 2

      Tomek Muras | Blog, News | 17 February, 2011

      Would you like to test Moodle 2 performance? Or maybe you are interested in checking Moodle’s scalability? Sure, it works fast with the few courses you have created – but how will it look whenRead more

    • Creating SCORM Content for Moodle

      Mark Melia | Blog, News | 15 March, 2011

      Okay, so I have discussed what SCORM is and how to add it to Moodle. Click here for a reminder. In this blog post I am going to look at some of the excellent proprietaryRead more

    • Game In Moodle

      Moronke Fajobi | Blog, News | 8 April, 2011

      The first time I came across the game module in Moodle I couldn’t but wonder what this could be about. It aroused my curiosity and interest that I spent the entire day digging into itsRead more

    NextPrevious

    Latest Insights

    • Totara Talent Experience Platform webinar
      1 December, 2020
      Comments Off on [Webinar] Totara Talent eXperience Platform – a fresh look at developing talent.

      [Webinar] Totara Talent eXperience Platform – a fresh look at developing talent.

    • 18 November, 2020
      Comments Off on Elevate your Team with World-Class Training Modules from Enovation and Go1:

      Elevate your Team with World-Class Training Modules from Enovation and Go1:

    • 21 October, 2020
      Comments Off on Totara Perform: Boost Workplace Productivity, Anytime, Anywhere.

      Totara Perform: Boost Workplace Productivity, Anytime, Anywhere.

    • 19 October, 2020
      Comments Off on Totara Engage: Engage, Unite and Upskill your Workforce to Deliver Peak Performance

      Totara Engage: Engage, Unite and Upskill your Workforce to Deliver Peak Performance

    Archives

    • December 2020
    • November 2020
    • October 2020
    • September 2020
    • July 2020
    • June 2020
    • May 2020
    • April 2020
    • March 2020
    • February 2020
    • January 2020
    • November 2019
    • October 2019
    • September 2019
    • August 2019
    • July 2019
    • June 2019
    • May 2019
    • March 2019
    • January 2019
    • December 2018
    • October 2018
    • September 2018
    • July 2018
    • June 2018
    • May 2018
    • April 2018
    • March 2018
    • February 2018
    • January 2018
    • November 2017
    • October 2017
    • September 2017
    • August 2017
    • July 2017
    • June 2017
    • May 2017
    • April 2017
    • March 2017
    • January 2017
    • November 2016
    • October 2016
    • June 2016
    • March 2016
    • February 2016
    • January 2016
    • December 2015
    • November 2015
    • October 2015
    • September 2015
    • July 2015
    • June 2015
    • May 2015
    • March 2015
    • February 2015
    • January 2015
    • December 2014
    • November 2014
    • September 2014
    • June 2014
    • May 2014
    • January 2014
    • August 2013
    • April 2013
    • March 2013
    • February 2013
    • September 2012
    • July 2012
    • May 2012
    • April 2012
    • February 2012
    • December 2011
    • November 2011
    • June 2011
    • May 2011
    • April 2011
    • March 2011
    • February 2011
    • January 2011
    • December 2010

    Sign up for our newsletter today to receive free hints and tips straight to your inbox.

      Enovation Square

      Enovation Solutions Ltd.,
      T: +1 800-474-9640

      Partners & Certifications

      Totara Partner Logo

      Latest Insights

      • Totara Talent Experience Platform webinar

        [Webinar] Totara Talent eXperience Platform – a fresh look at developing talent.

        Come join us on Dec 9th for this guided tour of the Totara’s Talent Experience Platform.

        1 December, 2020
      • Elevate your Team with World-Class Training Modules from Enovation and Go1:

        Enovation and Go1 have developed premium content bundles to allow your organization

        18 November, 2020
      • Totara Perform: Boost Workplace Productivity, Anytime, Anywhere.

        Unlock new levels of performance with Totara Perform! Harness the power of

        21 October, 2020

      Latest Tweets

      Tweets by @EnovationUSA
      • Legal Information
      © 2021 Enovation Your eLearning Partner
      • WHAT WE DO
        • OUR SERVICES
          • Consultancy
          • Training
          • Hosting
          • Content Creation
          • Build & Design
          • Support & Maintenance
        • OUR SOLUTIONS
          • Totara’s Talent Experience Platform
            • Totara Learn
            • Totara Engage
            • Totara Perform
          • Aura Talent
          • Moodle
          • Moodle Workplace
          • Go1 Premium Content
      • WHO WE ARE
        • About Enovation
      • CASE STUDIES
        • UDG Healthcare
        • Mercury Engineering
        • Tata Chemicals Europe
        • Aer Lingus
        • Sagemcom
        • HVACRedu
      • OUR PARTNERS
        • Microsoft Teams
        • IntelliBoard
        • BigBlueButton
      • #KeepLearningStrong
      • INSIGHTS
      • CONTACT US
      Enovation
      1 (800) 474-9640