The main goal of the Metalogue project is to design a dialogue system with metacognitive capabilities that is based on natural spoken language and multimodal interaction and evaluate the developed technologies in multiperspective educational dialogue setting. The project goal can be broken down to six main objectives outlined below:

Objective 1

Define several learning and interaction scenarios of different levels of complexity and collect multimodal conversational speech and interaction data for the following purposes:

  • for specification of system and user requirements;
  • for training (meta-)cognitive models of regular cognitive skills;
  • for establishing a clear definition of strategy and tactics of tutoring conversations;
  • for designing building and testing interactive dialogue models and metacognitive agents;
  • for designing and testing a multimodal multi-party dialogue system.

Objective 2

Provide cognitive models for the metacognitive capabilities that are used for 3 purposes:

  1. to understand the nature of metacognitive processes (Theoretical Model)
  2. to integrate into the dialogue system and to provide models that become system components (Agent Model)
  3. to assess/predict the system’s and user’s success in mastering metacognitive skills (Learner Model)

Objective 3

Specify educational dialogue strategies based on scenarios and cognitive models and evaluation results in order to:

  • development of different intervention and feedback strategies in human-computer dialogue, based on anticipated dialogue and educational intervention strategies;
  • develop instructional practices for amplification of monitoring and reflection, and feedback based on sensory and multimodal input and output;
  • use multimodal sensory input as the basis for a continuous training model with feedback on several levels ranging from micro-feedback loops to strategic monitoring and practicing sessions, as also analytics for reflection about action;
  • develop multi-perspective educational dialogue models for training.

Objective 4

Design multimodal multi-party and multiperspective models that capture interactive learning behaviour accurately and adequately. Develop a method and a framework that can be incorporated into and run as part of the main Metalogue system; while the modular aspect of the system means that it can be used as a stand-alone application, its design will be such that it can optimally integrate and share data with other components in the system.

Objective 5

To develop a multimodal dialogue system with metacognitive capabilities/awareness. To provide not only the integration of the different tools involved in the solution but appropriate and effective IT infrastructure that will support the interaction by incorporating human factors and user’s innate cognitive abilities.

Objective 6

To assess and evaluate the system’s performance both in terms of technical performance and user acceptance, including:

  1. effectiveness of the metacognitive aware system (contrast newly developed algorithm with A*);
  2. influence of the chosen interactive approach on the user and the user’s motivation;
  3. usability testing and user satisfaction