Speech interactive communication systems

Study programs

Teaching information

Teachers

doc. Ing. Stanislav Ondáš, PhD. doc. Ing. Daniel Hládek, PhD.

Schedule

Learning outcomes

The course is aimed at gaining theoretical knowledge and practical skills in the design of interactive communication through mobile telecommunications terminals, such as smartphones, tablets, etc. Students will get acquainted with speech and multimodal interaction systems, with their structure and with technologies that enable speech communication and also with the help of other modalities (gestures, touch, ...). Completion of the course will provide the graduate with basic knowledge about technologies of speech recognition and synthesis, interaction management, multimodal fusion and fission, and technologies for voice interaction via the web, mediated through mobile telecommunications terminals. Students will gain practical experience in designing interactive services with voice modality for speech interactive systems and also for applications for mobile terminals using technologies for speech recognition and synthesis.

Course outline

1. Basics of multimodal human-machine interaction; 2. Speech and multimodal interactive systems - definition, classification, principles and structure; 3. Mobile and web interactive systems and technologies (server-client solutions, available technologies, standards, tools for creating mobile web applications with VUI); 4. Communication modalities (text, touch, speech, gestures, face sensing, brain waves); 5. Multimodal technologies for mobile terminals; 6. Automatic speech and speaker recognition; 7. Automatic recognition of faces, gestures and other modalities; 8. Merger and fusion modalities; 9. Interaction management; 10. Speech synthesis; 11. Domain data in interactive systems and their services; 12. Methods of evaluation of interactive telecommunication applications.

Completion conditions

Assessment and completion of the course: Credit test and examination Continuous assessment: Student passes the continuous assessment and receives credits when he or she meets the requirement to obtain at least 21% out of 40%. Credit test Final assessment: Student passes the final assessment and passes the examination when he or she meets the requirement to obtain at least 31% out of 60%. Examination Overall assessment: Overall assessment is the sum of the assessments obtained by students in the assessment period. The overall result is determined in accordance with the internal regulations of the Technical University in Košice. (Study Regulations, the internal regulation principles of doctoral studies)

Recommended literature

[1] Juhár, J. a kol.: Rečové technológie v telekomunikačných a informačných systémoch, Košice 2011, ISBN 978-80-89284-75-7 [2] J.-P. Thiran, F. Marqués, H. Bourlard, Eds., Multimodal Signal Processing Theory and Applications for ,Human–Computer Interaction, Elsevier Academic Press, 2010. [3] David Benyon, Designing Interactive Systems, 2ed., Pearson Academic Wesley, 2010. [4] Alan Dix et.al., Human-computer interaction, 3ed., Pearson Prentice Hall, 2004.

Notes

To successfully complete the course, it is necessary to obtain a credit and successfully pass the exam. This includes the student's participation in educational activities of direct teaching, lectures, exercises, as well as independent study and independent creative activity of the student in processing the semester assignment / assignments, project on a specified topic, to a specified extent, in a specified design of a total of 180 hours intensity of the student's work per semester.

Grade distribution

Total graded students: 81