CS5484 Multimodal Interface Design

Part I

Course Duration: One semester
Credit Units: 3
Level: P5
Medium of Instruction: English
Prerequisites: Nil
Precursors: CS2332 Object-Oriented Programming, or equivalent
Equivalent Courses: Nil
Exclusive Courses
: Nil 

Part II

Course Aims
This course aims to develop an understanding and practical skills of how to design usable interfaces to computer-based environments that interact with, and support, human multi-modal information processing.

Course Intended Learning Outcomes (CILOs)
Upon successful completion of this course, students should be able to:

No.

CILOs

Weighting
(if applicable)

1.

identify human characteristics important in carrying out tasks using computer-based environments, and to apply these characteristics to the design of a user-oriented multi-modal interface;

 

2.

perform a detailed analysis of the target user community of an interface;

 

3.

apply design principles to the creation of user-oriented interfaces;

 

4.

adopt alternative modalities, in addition to keyboard and mouse input, in user-oriented interface design;

 

5.

evaluate the design of a multimodal interface.

 

Teaching and Learning Activities (TLAs)
(Indicative of likely activities and tasks designed to facilitate students’ achievement of the CILOs. Final details will be provided to students in their first week of attendance in this course)

  
Teaching pattern:
  
Suggested lecture/tutorial/laboratory mix: 1 hr. lecture; 2 hrs. tutorial.

CILO No.

TLAs

Hours/week
(if applicable)

CILO 1,2,4,5

Lecture: The lecture will focus on the introduction of the theories, principles and guidelines of multimodal interface design.

 

CILO 5

Tutorial: Students are required to work on a different case study each week during the tutorial sessions. In particular, they will perform group discussions, and each group is required to submit a brief report of their conclusions in each tutorial session.  One of the groups will be invited to give a class presentation, and the other groups are encouraged to comment on their findings.

 

CILO 1

Assignment: Students will verify a number of human performance models by performing experiments themselves and interpreting the observations.  In particular, the students will determine how well the models can predict their own actual performance.  These results and interpretations are to be summarized in the form of a report.

 

CILO 2,3,4

Project: Students will work as a group on an interface design project.  The interface should allow interaction through a combination of modalities.  The students will apply the theories, principles and guidelines they have learnt from the course for their design.  The evaluation of the project will be based on the following criteria:

 

-Analysis of the target user group.
-  Overall design (interface structure, selection of control, layout of text and graphics, etc).
-  Implementation of the multiple modalities of interaction.
-  Suitable adoption of the theories, principles and guidelines of interface design.

Assessment Tasks/Activities
(Indicative of likely activities and tasks designed to assess how well the students achieve the CILOs. Final details will be provided to students in their first week of attendance in this course)

   Examination duration:  2 hours
  
Percentage of coursework, examination, etc.: 60% CW; 40% Exam

CILO No.

Type of Assessment Tasks/Activities

Weighting
(if applicable)

Remarks

CILO 1

Coursework: Students are required to work on an assignment to verify specific human performance models by performing experiments themselves and interpreting the observations.  Their ability to provide a critical comparison between their own performance and that predicted by the model will be used to measure this ILO.
Examination: Final examination will include questions to assess the capability of students to apply suitable human performance models in interface design.

 

 

CILO 2

Coursework: Students are required to work on a multimodal interface design project. In this design project, students are required to provide a detailed user analysis.  Their ability to identify the main characteristics of the target user community will be used to assess this ILO.

 

 

CILO 3

Coursework: The ability of students to apply the suitable design principles to their multimodal interface design projects will be used to assess this ILO.
Examination: Final examination will include questions to assess the capability of students to design an original interface based on a requirement specification.

 

 

CILO 4

Coursework: In the design project, students are required to incorporate multiple modalities in their interface.  The degree of interaction enhancement due to these additional modalities in their project will be used to assess this ILO.
Examination: Final examination will include questions to assess the capability of students to select suitable modalities in multimodal interface design.

 

 

CILO 5

Coursework: Students are required to work on a different case study each week during the tutorial sessions.  Some of the case studies will require students to evaluate the usability of an interface.  The ability of students to identify the merits and problems of the interfaces in the case studies will be used to assess this ILO.
Examination: Final examination will include questions to assess the capability of students to provide a critical evaluation of different aspects of an interface design.

 

 

Grading of Student Achievement: Refer to Grading of Courses in the Academic Regulations
Grading pattern: Standard (A+, A, A-…F)
For a student to pass the course, at least 30% of the maximum mark for the examination must be obtained.
    .

Part III

Keyword Syllabus:

Human psychological and physical ergonomics; tools; human sensory: visual, aural and kinesthetic limitations; human psychological expectations and limitations; forms of interaction; information interaction design; human performance engineering. Usability testing; ethics of testing; measures; statistical and psychological tool kits. The design process; design metaphors; sketching; object/action paradigm; conceptual modeling; use scenarios; dialogue formalisms. Guidelines; industry standards; nonverbal communication; use of colour, sound and gestures. Documentation; help systems; tutorials. Integration with program design; windowing systems; multimedia environments; elements of graphics.

Syllabus

1.

Background to human use of computer systems
How people use computers. Concept of the computer as a tool.  Concept of the end-user need.  Ergonomics and human performance engineering.  Information processing modalities: visual, aural and kinesthetic factors.  Conceptual (mis)match.  Forms of interaction.  Role of metaphors in designs.  Information seeking in electronic environments.
 

2.

Evaluation of human-computer interaction
What makes products easy for people to use; frameworks for testing human-computer interaction; ways of testing: when to test and how to test; ethics of testing that involves human subjects; measurement in testing: time, response, accuracy, learning, recall, errors; what makes an interface human-centred.
 

3.

Design
Design process.  Development of visual prototypes through sketching, drawing and interactive prototyping.  Conceptual models.  Object-action paradigm for design.  Methodologies of design.  Design metaphors.  Information structuring design.  Guidelines with an emphasis on IBM's Common User Access.  Physical design: colour, visual displays, keyboards, pointing devices.  Sound and voice.  Screen layout.  Paper forms design.  Use scenarios, interaction scripts, dialogue and its specifications
 

4.

Environment and development platforms
Hardware input/output objects.  Integration of manuals, quick reference guides, courses, on-line help, tutorials and information guides as part of the user interface.  User interface management systems (UIM).  Managing the design process.  Multiple communication media and existing software components for developing user-interface designs: fundamentals of windowing systems, web-based systems, cyberworlds, elements of graphics, virtual environments

Related Links
Department of Computer Science