How to create questions using Generative AI

How to create questions using Generative AI

Access Gen AI Language Learning Model (LLM) to create questions 

In recent years, Generative AI (GenAI) technology has emerged as a transformative force to generate content. With the advent of widely available Language Learning models (LLM), the implementation of Generative AI has been a constantly developing use case. In Assessment and Learning sector, one of the major use cases of GenAI is the capability of question creation based on reference text making it easier for institutes and organization to better engage with their study materials.

What is Generative AI? 

Generative AI refers to algorithms that can create new content based on supplied prompts. While traditional AI models focus on prediction and analytics, Gen AI models focus on creating text, image, music etc. These models leverage deep learning techniques such as neural networks, to understand patterns and generate output that mimics human like creativity.

How Mercer Mettl leverages Generative AI?

Mercer Mettl allows its user to add question to the content library. We have integrated our in-house LLM built on Open AI to generate questions like Multiple Choice, Multiple Correct, and Long Answer questions. User can provide background about the topic on which they want to create questions and within few seconds they can review the generated questions. 

Steps to access the module and generate questions:

FORM ELEMENTS

  1. Navigate to My Questions. Generative AI is a paid feature and needs to be enabled by Admin on Organization ID. Once enabled, the module will be enabled in all sub accounts also.  
  2. All those users who have access to My Questions page will then get access to Generative AI model. 
  3. On clicking Create in the button bar under the top navigation bar, a form page will open where background about topic needs to be provided. 
  4. Topic is an input to the Gen AI model on which the questions will be created. User can also provide further information such as:
    1. Sub-Topic
    2. Question Type: Multiple Choice Questions / Multiple Correct Questions / Long Answer Questions 
    3. Level:  Easy / Medium / Difficult
    4. No of Questions: min 1 and max 10 
    5. Reference Content:
      1. File Upload of max size 1MB, pdf, doc
      2. Text of max 5000 characters 



















TOKEN BALANCE

  1. A maximum of 1M tokens will be added to the organization account by default when the setting is enabled.  
  2. Tokens will be consumed depending on the content that the model generates.  
  3. If the token balance is completely exhausted, then no further questions can be generated.

GENERATED QUESTIONS


Video Illustration on how the model can be accessed
  1. Once the questions are generated, the user can review the questions. In this step, the user can select which questions need to be added to the content library. 
  2. After selecting questions, the user will be navigated to the Add Questions page with the Question, answers, correct answer, and topic name as skill name. 
  3. User can edit the questions / answers / skills if required.  
  4. Users may also send the questions for a review process by a group of reviewers. For this Content Review Process must be enabled in their account. 
  5. The module also provides the capability of generating more questions on the same parameters. This will add the new questions to the list of previously generated questions. 
  6. If any of the generation parameters such as Type of Question, Level of Questions, or number of questions is changed, the model re-generates the question instead of adding to the list. 
  7. If there is any issue in generating questions, the user will be notified by an alert message.