In this demo we show the current state of NAVEL’s nonverbal and verbal dialog capabilities. There were a total of two recording sequences from which the demo is cut together.
As a technical basis for the dialog system, we use RASA, which uses various AI modules for both the NLU process such as intent detection and the selection of response strategies. For example, the system recognizes answers from the user that do not exactly match the predefined ones and the dialog system can also handle topic changes that were not previously defined in story lines. For speech recognition, we are currently using Google ASR. By using various tricks, we were able to reduce the latency enough to create a pleasant dialog flow.
NAVEL’s special nonverbal capabilities are partially controlled directly by the dialog system to have them synchronized and consistent with the dialog. Basic emotions and specific gestures are set by the dialog editor. In addition, we have automated as much of the non-verbal behavior as possible, so that authentic live behavior is created without much manual work. Functions such as eye contact including saccades and gaze aversion are fully automated. Even the movement patterns appropriate to different dialog situations are not scripted by hand but automated.
For the dialog itself, we use a wide variety of communication strategies to guide and activate the user: Open and closed questions, positive feedback, recognition, self-revelation, activating questions, etc. In terms of content, we are currently mapping exemplary functions that are suitable for care, including: Games, entertainment, information, small talk and exercises to improve well-being. For this we use exercises from the field of mindfulness and positive psychology.
We are also very excited to see how it will be when we go back to nursing homes with the new skills and NAVEL interacts with “normal“ people!
See more on
1 view
54
119
3 weeks ago 00:33:36 1
к.ф.-м.н. Стригин М.Б. Четыре этапа эволюции мышления: экспликация мирового разума
2 months ago 00:48:08 1
Полный гайд подземелье В гостях на “Веспере“: Механики, стратегии, снаряжение, секреты, диалоги
2 months ago 01:01:49 1
⚖️ ТОРГИ ЗАКРЫВАЮТСЯ: план раздела Украины. Шевченко: жизнь Трампа висит на волоске! Капкан молдаван
2 months ago 00:39:54 1
Стратегия Победы. В Кузбассе продолжается диалог о путях победы.
2 months ago 00:56:02 1
„Tödliche Chargen“: IDA-SPRECHSTUNDE mit Dr. Gunter Frank und Dr. Kay Klapproth
2 months ago 00:00:13 1
Katt Williams ROAST BIDEN and Geuss Whos Mad
2 months ago 00:10:40 1
Pläne liegen vor: Steht Polen kurz vor Kriegseintritt im Russland/Ukraine Krieg?
2 months ago 00:13:14 1
🔺Как Нарциссы и психопаты вводят в состояние НЕОПРЕДЕЛЁННОСТИ🔻
3 months ago 00:17:47 3
Речевые стратегии, практика защиты от манипуляций по игре А.Сафина “Защитись, договорись, насладись“
3 months ago 01:01:55 11
Арестович: К декабрю 2024 г. война остановится или нет? @holovanov
3 months ago 00:42:56 1
ЯДЕРНАЯ ДОКТРИНА РФ –ПОСЛЕДНЕЕ ПРЕДУПРЕЖДЕНИЕ ЗАПАДУ:МОСКВА МЕНЯЕТ СТРАТЕГИЮ ГЛОБАЛЬНОЙ БЕЗОПАСНОСТИ