{"id":1743,"date":"2019-11-30T10:28:47","date_gmt":"2019-11-30T10:28:47","guid":{"rendered":"https:\/\/mielesproject.org\/?p=1743"},"modified":"2019-11-30T10:28:47","modified_gmt":"2019-11-30T10:28:47","slug":"mieles-modules-multimodal-interaction","status":"publish","type":"post","link":"https:\/\/www.ub.edu\/mielesproject\/2019\/11\/30\/mieles-modules-multimodal-interaction\/","title":{"rendered":"MIELES Modules &#8211; Multimodal interaction"},"content":{"rendered":"<h1 style=\"text-align: center;\"><strong>Multimodal Interaction<\/strong><\/h1>\n<p style=\"text-align: center;\"><strong style=\"color: #99ccff;\"><em>By Dr. Ing. Sebastian M\u00f6ller, Dr. Benjamin Weiss, Dr. Rahul Swaminathan and Dr. Ing. Jens Ahrens<\/em><\/strong><\/p>\n<p style=\"text-align: center;\"><strong><em>Technische Universit\u00e4t Berlin<\/em><\/strong><\/p>\n<p style=\"text-align: center;\"><strong style=\"color: #99ccff;\"><em>&nbsp;<\/em><\/strong><\/p>\n<h2>Week 1<\/h2>\n<ul>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=2sK3WcS2soM&amp;list=PL4np5mvljbFtL8tj9L6pjR6rmPOz-kCnn\"><br \/>\nIntroduction<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=JwDKrBGG6i4&amp;list=PL4np5mvljbFtL8tj9L6pjR6rmPOz-kCnn&amp;index=2\"><br \/>\nMedium vs. Modality<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=NVup826BQ60&amp;list=PL4np5mvljbFtL8tj9L6pjR6rmPOz-kCnn&amp;index=3\"><br \/>\nMultimedia and Multimodality<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=H_g6SzevYEE&amp;list=PL4np5mvljbFtL8tj9L6pjR6rmPOz-kCnn&amp;index=4\"><br \/>\nModality Relations<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=eaN-uzwD49o&amp;list=PL4np5mvljbFtL8tj9L6pjR6rmPOz-kCnn&amp;index=5\"><br \/>\nCharacteristics of Multimodal Systems<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=Jf_LbYDcZZg&amp;list=PL4np5mvljbFtL8tj9L6pjR6rmPOz-kCnn&amp;index=6\"><br \/>\nIntroduction.<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=S4Pxf7dJmZA&amp;list=PL4np5mvljbFtL8tj9L6pjR6rmPOz-kCnn&amp;index=7\"><br \/>\nSpeech Production<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=bspJe__6SR8&amp;list=PL4np5mvljbFtL8tj9L6pjR6rmPOz-kCnn&amp;index=8\"><br \/>\nHearing &#8211; Ear<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=jT69U26S41M&amp;list=PL4np5mvljbFtL8tj9L6pjR6rmPOz-kCnn&amp;index=9\"><br \/>\nHearing &#8211; Perception<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=hUTAdIF6UcU&amp;list=PL4np5mvljbFtL8tj9L6pjR6rmPOz-kCnn&amp;index=10\"><br \/>\nIntroduction..<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=P4jXRo2cyGE&amp;list=PL4np5mvljbFtL8tj9L6pjR6rmPOz-kCnn&amp;index=11\"><br \/>\nThe Human Eye<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=8Rt7MbDCOco&amp;list=PL4np5mvljbFtL8tj9L6pjR6rmPOz-kCnn&amp;index=12\"><br \/>\nGestlat Perception<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=3DsweFgx_MY&amp;list=PL4np5mvljbFtL8tj9L6pjR6rmPOz-kCnn&amp;index=13\"><br \/>\nResolution and Sensitivity<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=YkeEOMaDy0w&amp;list=PL4np5mvljbFtL8tj9L6pjR6rmPOz-kCnn&amp;index=14\"><br \/>\nDepth Perception<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=dphxTqAt6h0&amp;list=PL4np5mvljbFtL8tj9L6pjR6rmPOz-kCnn&amp;index=15\"><br \/>\nReading<br \/>\n<\/a><\/li>\n<\/ul>\n<h2>Week 2<\/h2>\n<ul>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=Uwe-x8GdrsQ&amp;list=PL4np5mvljbFtmDVVqqvDI_lMiXasI6Kgc\"><br \/>\nIntroduction<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=TNz1xV-cl6M&amp;list=PL4np5mvljbFtmDVVqqvDI_lMiXasI6Kgc&amp;index=2\"><br \/>\nHaptics<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=kYzf-VAtivo&amp;list=PL4np5mvljbFtmDVVqqvDI_lMiXasI6Kgc&amp;index=3\"><br \/>\nSmell<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=ib42rBjlbcc&amp;list=PL4np5mvljbFtmDVVqqvDI_lMiXasI6Kgc&amp;index=4\"><br \/>\nTaste<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=jLrGKuBxh5g&amp;list=PL4np5mvljbFtmDVVqqvDI_lMiXasI6Kgc&amp;index=5\"><br \/>\nMemory<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=4dpXQWohvQ8&amp;list=PL4np5mvljbFtmDVVqqvDI_lMiXasI6Kgc&amp;index=6\"><br \/>\nMotorsystem<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=cvSr8rFR37c&amp;list=PL4np5mvljbFtmDVVqqvDI_lMiXasI6Kgc&amp;index=7\"><br \/>\nIntroduction<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=TJWXaXn7_Lw&amp;list=PL4np5mvljbFtmDVVqqvDI_lMiXasI6Kgc&amp;index=8\"><br \/>\nProcessing Multiple Signals<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=j8M0_cRJNRk&amp;list=PL4np5mvljbFtmDVVqqvDI_lMiXasI6Kgc&amp;index=9\"><br \/>\nMultimodal Dual-Tasks<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=JoP1YLIBRsA&amp;list=PL4np5mvljbFtmDVVqqvDI_lMiXasI6Kgc&amp;index=10\"><br \/>\nEffects of Discongurent Signals<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=tDjCuJW5DOQ&amp;list=PL4np5mvljbFtmDVVqqvDI_lMiXasI6Kgc&amp;index=11\"><br \/>\nRelevance<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=AuFu449RRVY&amp;list=PL4np5mvljbFtmDVVqqvDI_lMiXasI6Kgc&amp;index=12\"><br \/>\nIntroduction 1<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=XieDRIZAiMc&amp;list=PL4np5mvljbFtmDVVqqvDI_lMiXasI6Kgc&amp;index=13\"><br \/>\nIntroduction 2<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=v0R0F6U5OZQ&amp;list=PL4np5mvljbFtmDVVqqvDI_lMiXasI6Kgc&amp;index=14\"><br \/>\nGesture to Space<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=citEmayA8tE&amp;list=PL4np5mvljbFtmDVVqqvDI_lMiXasI6Kgc&amp;index=15\"><br \/>\nTurn Taking<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=47wG1fjondM&amp;list=PL4np5mvljbFtmDVVqqvDI_lMiXasI6Kgc&amp;index=16\"><br \/>\nConclusion<br \/>\n<\/a><\/li>\n<\/ul>\n<h2>Week 3<\/h2>\n<ul>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=WxKe8aeYArk&amp;list=PL4np5mvljbFshoYCLFvNR5gR54LsVzlFY\"><br \/>\nIntroduction<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=BD_zKK9bn_I&amp;list=PL4np5mvljbFshoYCLFvNR5gR54LsVzlFY&amp;index=2\"><br \/>\nOverview<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=yX0XqlS-5Ak&amp;list=PL4np5mvljbFshoYCLFvNR5gR54LsVzlFY&amp;index=3\"><br \/>\nAutomatic Speech Recognition<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=XRv8KQ9MYXY&amp;list=PL4np5mvljbFshoYCLFvNR5gR54LsVzlFY&amp;index=4\"><br \/>\nEmotion Recognition<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=6p4VwBuGvAU&amp;list=PL4np5mvljbFshoYCLFvNR5gR54LsVzlFY&amp;index=5\"><br \/>\nText Recognition<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=wvTnROU8qJ8&amp;list=PL4np5mvljbFshoYCLFvNR5gR54LsVzlFY&amp;index=6\"><br \/>\nIntroduction1<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=6daZvmB1J5Y&amp;list=PL4np5mvljbFshoYCLFvNR5gR54LsVzlFY&amp;index=7\"><br \/>\nIcons<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=MUS1vgPNT0I&amp;list=PL4np5mvljbFshoYCLFvNR5gR54LsVzlFY&amp;index=8\"><br \/>\nText Generation<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=Cd0Yk7b1Kkg&amp;list=PL4np5mvljbFshoYCLFvNR5gR54LsVzlFY&amp;index=9\"><br \/>\nText to Speech<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=dM5vUR8qFCY&amp;list=PL4np5mvljbFshoYCLFvNR5gR54LsVzlFY&amp;index=10\"><br \/>\nSpeech Generation<br \/>\n<\/a><\/li>\n<\/ul>\n<h2>Week 4<\/h2>\n<ul>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=gMv-qk7jqkA&amp;list=PL4np5mvljbFsalWPtPnB1q8gvWOHqHLap&amp;index=1\"><br \/>\nIntroduction<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=qyiJLolpy_Q&amp;list=PL4np5mvljbFsalWPtPnB1q8gvWOHqHLap&amp;index=2\"><br \/>\nMultimodal Interactive Systems Development<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=iiyde5A0l1I&amp;list=PL4np5mvljbFsalWPtPnB1q8gvWOHqHLap&amp;index=3\"><br \/>\nIntroduction . .<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=FZuLMyano30&amp;list=PL4np5mvljbFsalWPtPnB1q8gvWOHqHLap&amp;index=4\"><br \/>\nVirtual Reality<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=zx5RX6CbHPo&amp;list=PL4np5mvljbFsalWPtPnB1q8gvWOHqHLap&amp;index=5\"><br \/>\nIntroduction to Audio for Virtual Reality<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=8CmLTXM8z-c&amp;list=PL4np5mvljbFsalWPtPnB1q8gvWOHqHLap&amp;index=6\"><br \/>\nSpatial Hearing<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=gEZIAA-iD9g&amp;list=PL4np5mvljbFsalWPtPnB1q8gvWOHqHLap&amp;index=7\"><br \/>\nDummy Heads<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=wfoMRhBY3go&amp;list=PL4np5mvljbFsalWPtPnB1q8gvWOHqHLap&amp;index=8\"><br \/>\nIndividuality of HRTFs<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=KFWR1JMpgrY&amp;list=PL4np5mvljbFsalWPtPnB1q8gvWOHqHLap&amp;index=9\"><br \/>\nSterophony<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=agl-jRY1n84&amp;list=PL4np5mvljbFsalWPtPnB1q8gvWOHqHLap&amp;index=10\"><br \/>\nCrosstalk Cancelation<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=oF25nlIer5M&amp;list=PL4np5mvljbFsalWPtPnB1q8gvWOHqHLap&amp;index=11\"><br \/>\nAmbisonics<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=WEyD4HiXQI0&amp;list=PL4np5mvljbFsalWPtPnB1q8gvWOHqHLap&amp;index=12\"><br \/>\nSound Field Synthesis<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=Oox69WS7HqY&amp;list=PL4np5mvljbFsalWPtPnB1q8gvWOHqHLap&amp;index=13\"><br \/>\nChallenges with Projection-based Systems<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=KrP-4NXFBwc&amp;list=PL4np5mvljbFsalWPtPnB1q8gvWOHqHLap&amp;index=14\"><br \/>\nCapturing of Sound Scenes<br \/>\n<\/a><\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=U23hJ7gz3Dg&amp;list=PL4np5mvljbFsalWPtPnB1q8gvWOHqHLap&amp;index=15\"><br \/>\nClosing Remarks<br \/>\n<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Multimodal Interaction By Dr. Ing. Sebastian M\u00f6ller, Dr. Benjamin Weiss, Dr. Rahul Swaminathan and Dr. Ing. Jens Ahrens Technische Universit\u00e4t Berlin &nbsp; Week 1 Introduction Medium vs. Modality Multimedia and Multimodality Modality Relations Characteristics of Multimodal Systems Introduction. Speech Production Hearing &#8211; Ear Hearing &#8211; Perception Introduction.. The Human Eye Gestlat Perception Resolution and Sensitivity [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":1768,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_themeisle_gutenberg_block_has_review":false,"footnotes":""},"categories":[1],"tags":[],"class_list":["post-1743","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/www.ub.edu\/mielesproject\/wp-json\/wp\/v2\/posts\/1743","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.ub.edu\/mielesproject\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.ub.edu\/mielesproject\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.ub.edu\/mielesproject\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.ub.edu\/mielesproject\/wp-json\/wp\/v2\/comments?post=1743"}],"version-history":[{"count":0,"href":"https:\/\/www.ub.edu\/mielesproject\/wp-json\/wp\/v2\/posts\/1743\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.ub.edu\/mielesproject\/wp-json\/wp\/v2\/media?parent=1743"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.ub.edu\/mielesproject\/wp-json\/wp\/v2\/categories?post=1743"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.ub.edu\/mielesproject\/wp-json\/wp\/v2\/tags?post=1743"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}