Show simple item record

dc.contributor.advisorAnshus, Otto
dc.contributor.authorSu, Fei
dc.date.accessioned2019-11-06T13:03:19Z
dc.date.available2019-11-06T13:03:19Z
dc.date.embargoEndDate2024-11-01
dc.date.issued2019-11-01
dc.description.abstractThis dissertation presents MultiStage, a human-to-human interaction system meant to be use by actors on a stage to interact and perform with actors on other stages as if they were on the same stage. MultiStage includes several local side stages and a global side. It uses a publish-subscribe model to handle the handover of data streams. Local side produces data streams about actors to global side. Local sides also subscribe to data streams from global side to create remote presence about actors. Global side receives data streams and sends data streams back to the local side according to subscriptions. When actors interact with remote actors, the system amplifies actors’ actions by adding text and animations to the remote presences. When the remote presences lag behind too much because of network and processing delays, the system applies various techniques to mask the effects of delays, including switching rapidly to a prerecorded video or animations of individual actors. Another use of the MultiStage video distribution model is called pVD. The Personal Video Distribution (pVD) system supports sending and viewing live and stored videos between any of a single user’s computers, and allows for a smooth handover of play back between computers. The system avoids any third parties, and relies only on the user’s personal computers. The architecture is comprised of functionality for sending videos, subscribing to videos, and maintaining the video playback state. The design has a local side sending and viewing videos, and a global side coordinating the switching and distribution of videos, and maintaining subscriptions and video state. A set of experiments was conducted to document the performance of the prototype. The results show that pVD global side has low CPU usage, and supports a handful of simultaneous exchanges of videos on a wireless network.en_US
dc.description.doctoraltypeph.d.en_US
dc.description.popularabstractWe present MultiStage system for human-to-human live interaction across distance. The system masking the effects of delays and amplifying the remote presence of actors. It is designed to scale to at least three stages connected with both LAN and WAN (Internet). Each stage can have multiple actors. We use four 3D cameras per stage glued together to give approximately 360-degree coverage. Each stage also has at least one display. The system extracts a 3D recording of each actor. The system also sends data streams into the system for distribution between the stages. The data streams are analyzed on-the-fly for information such as gestures. Each stage receives several data streams and creates remote presences of the remote actors. The system applies several techniques to mask the effects of delays, including on-the-fly blending in of prerecorded data streams or on-demand animations into the visualization of remote presences if delays prevent the data streams from arriving in time.en_US
dc.description.sponsorshipThe project is funded by the Norwegian Research Council.en_US
dc.identifier.isbn978-82-8236-365-5
dc.identifier.urihttps://hdl.handle.net/10037/16614
dc.language.isoengen_US
dc.publisherUiT Norges arktiske universiteten_US
dc.publisherUiT The Arctic University of Norwayen_US
dc.relation.haspart<p>Paper I: Su, F., Tartari, G., Bjørndalen, J.M., Ha, P.H. & Anshus, O.J. (2013). MultiStage: Acting across Distance. In P. Nesi & R. Santucci (Eds.), <i>Second International Conference on Information Technologies for Performing Arts, Media Access and Entertainment, ECLAP 2013, Porto, Portugal, April 8-10, 2013. LNCS 7990</i> (pp. 227–239). Berlin Heidelberg: Springer-Verlag. ISBN 978-3-642-40050-6. Published version not available in Munin due to publisher’s restrictions. Published version available at <a href=https://doi.org/10.1007/978-3-642-40050-6_20> https://doi.org/10.1007/978-3-642-40050-6_20</a>. Accepted manuscript version available in Munin at <a href=https://hdl.handle.net/10037/16625>https://hdl.handle.net/10037/16625</a>. <p>Paper II: Su, F., Bjørndalen, J.M., Ha, P.H. & Anshus O.J. (2013). pVD - Personal Video Distribution. <i>IEEE Ninth International Conference on Wireless and Mobile Computing, Networking and Communications, WiMob 2013, Lyon, France, October 7-9, 2013</i>. Published version not available in Munin due to publisher’s restrictions. Published version available at <a href=http://dx.doi.org/10.1109/WiMOB.2013.6673431>http://dx.doi.org/10.1109/WiMOB.2013.6673431</a>. Accepted manuscript version available in Munin at <a href=https://hdl.handle.net/10037/16626>https://hdl.handle.net/10037/16626</a>. <p>Paper III: Su, F., Bjørndalen, J.M., Ha, P.H. & Anshus, O.J. (2014). Masking the Effects of Delays in Human-to-Human Remote Interaction. In M. Ganzha, L. Maciaszek & M. Paprzycki (Eds), <i>Proceedings of the 2014 Federated Conference on Computer Science and Information Systems. Annals of Computer Science and Information Systems, Volume 2. Warsaw, Poland, September 7-10, 2014</i> (pp. 719-728). Polish Information Processing Society & IEEE. Published version not available in Munin due to publisher’s restrictions. Published version available at <a href= http://dx.doi.org/10.15439/2014F137>http://dx.doi.org/10.15439/2014F137</a>. Accepted manuscript version available in Munin at <a href= https://hdl.handle.net/10037/16624> https://hdl.handle.net/10037/16624</a>.en_US
dc.relation.projectIDinfo:eu-repo/grantAgreement/RCN/VERDIKT/187828/Norway/Virtually Enhanced Real-life synchronizeD Interaction - ON the Edge/VERDIONE/
dc.rights.accessRightsembargoedAccessen_US
dc.subject.courseIDDOKTOR-004
dc.subjectDistributed systemen_US
dc.subjectHuman-to-human interactionen_US
dc.subjectMasking the effects of delaysen_US
dc.subjectRemote presenceen_US
dc.titleA distributed remote presence system masking the effects of delays in human-to-human remote interactionen_US
dc.typeDoctoral thesisen_US
dc.typeDoktorgradsavhandlingen_US


File(s) in this item

Thumbnail
Thumbnail
Thumbnail

This item appears in the following collection(s)

Show simple item record