Verbalna komunikacija afektivnog virtualnog agenta temeljena na chatbot usluzi

master's thesis

• Title (english): Verbal communication of an affective virtual agent based on a chatbot service
• Author: Domagoj Majetić
• Mentor: Tomislav Stipančić (mentor)
• Granter: University of Zagreb; Faculty of Mechanical Engineering and Naval Architecture; Zagreb
• Defense date and country: 2024-05, Croatia
• Scientific / art field, discipline and subdiscipline: TECHNICAL SCIENCES; Computing; Artificial Intelligence

Abstract

Tema ovog rada je integracija ChatGPT usluge sa virtualnim agentom radi ostvarivanja verbalne komunikacije u području virtualne stvarnosti i afektivne robotike. U teorijskom dijelu opisuju se metode obrade prirodnog jezika te njihova primjena i analiziraju se načini povezivanja ChatGPT usluge s Unreal Engine 5 razvojnim okruženjem u kojem je modeliran PLEA virtualni agent. Praktični dio rada obuhvaća integraciju ChatGPT usluge sa virtualnim agentom, što uključuje implementaciju programske podrške za pretvorbu govora u tekst i teksta u govor te animiranje izražaja lica, virtualnog modela čovjeka, sukladno govoru.

Abstract (english)

The topic of this paper is the integration of the ChatGPT service with a virtual agent to achieve verbal communication in the field of virtual reality and affective robotics. The theoretical part describes Natural Language Processing methods, their application, and analyzes ways to connect the ChatGPT service with the Unreal Engine 5 development environment. The practical part of the paper involves integrating the ChatGPT service with the virtual agent, including implementing speech-to text and text-to-speech conversion, as well as animating facial expressions of a virtual human model in accordance with speech.

• Keywords: ChatGPT; virtualni agent; verbalna komunikacija; virtualna stvarnost; afektivna robotika; obrada prirodnog jezika; Unreal Engine; animiranje lica
• Keywords (english): ChatGPT; virtual agent; verbal communication; virtual reality; affective robotics; Natural Language Processing; Unreal Engine; facial animation
• Language: croatian
• URN:NBN: urn:nbn:hr:235:964815
• Project: Number: UIP-2020-02-7184; Title: Afektivna multimodalna interakcija temeljena na konstruiranoj robotskoj spoznaji; Title: Affective Multimodal Interaction based on Constructed Robot Cognition; Acronym: AMICORC; Leader: Tomislav Stipančić; Jurisdiction: Croatia; Funder: Hrvatska zaklada za znanost; Funding stream: Installation Research Projects
• Study programme: Title: Mechanical Engineering; Study programme type: university; Study level: graduate; Academic / professional title: magistar/magistra inženjer/inženjerka strojarstva (magistar/magistra inženjer/inženjerka strojarstva)
• Type of resource: Text
• File origin: Born digital
• Access conditions: Open access
• Created on: 2024-05-10 21:16:57