{"id":21132,"date":"2025-02-04T20:31:00","date_gmt":"2025-02-04T19:31:00","guid":{"rendered":"https:\/\/sano.science\/?post_type=research&p=21132"},"modified":"2025-07-08T16:30:33","modified_gmt":"2025-07-08T14:30:33","slug":"hilotel-virtual-reality-robot-interface-based-human-in-the-loop-task-execution-and-learning-in-the-physical-world-through-its-digital-twin","status":"publish","type":"research","link":"https:\/\/sano.science\/research\/hilotel-virtual-reality-robot-interface-based-human-in-the-loop-task-execution-and-learning-in-the-physical-world-through-its-digital-twin\/","title":{"rendered":"HiLoTEL: Virtual Reality Robot Interface-Based Human-in-the-Loop Task Execution and Learning in the Physical World Through Its Digital Twin"},"content":{"rendered":"\n

Amanuel Ergogo, Diego Dall’Alba, Przemyslaw Korzeniowski<\/h2>\n\n\n\n
<\/div>\n\n\n\n

HiLoTEL is a flexible virtual-reality framework for executing and learning tasks in virtual and physical environments. It enables hu-man experts to collaborate with learning agents and intervene when necessary through human-in-the-loop imitation learning. HiLoTEL reduces the need to carry out repetitive tasks, providing the user with an intuitive supervision interface. The system is tested on Pick-and-Place task, considering both teleoperated and passthrough interaction modalities. The results show that HiLoTEL improves success rates while maintaining human-level completion time and providing users with 71% hands free supervision time, thus enabling effective human-robot collaboration<\/p>\n\n\n\n

<\/div>\n\n\n\n

Authors<\/strong>:\u00a0Amanuel Ergogo<\/a>,\u00a0Diego Dall’Alba<\/a>,\u00a0\u00a0Przemyslaw Korzeniowski<\/a><\/p>\n\n\n\n

DOI<\/strong>: 10.1109\/VRW62533.2024.00137<\/a><\/p>\n\n\n\n

<\/div>\n\n\n","protected":false},"excerpt":{"rendered":"

Conference manuscript in IEEE VR, 2024<\/p>\n","protected":false},"featured_media":0,"template":"","research_type":[8],"research_team":[17],"class_list":["post-21132","research","type-research","status-publish","hentry","research_type-publications","research_team-health-informatics-group-higs"],"yoast_head":"\nHiLoTEL: Virtual Reality Robot Interface-Based Human-in-the-Loop Task Execution and Learning in the Physical World Through Its Digital Twin - Centre for Computational Personalized Medicine<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/sano.science\/research\/hilotel-virtual-reality-robot-interface-based-human-in-the-loop-task-execution-and-learning-in-the-physical-world-through-its-digital-twin\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"HiLoTEL: Virtual Reality Robot Interface-Based Human-in-the-Loop Task Execution and Learning in the Physical World Through Its Digital Twin\" \/>\n<meta property=\"og:description\" content=\"Conference manuscript in IEEE VR, 2024\" \/>\n<meta property=\"og:url\" content=\"https:\/\/sano.science\/research\/hilotel-virtual-reality-robot-interface-based-human-in-the-loop-task-execution-and-learning-in-the-physical-world-through-its-digital-twin\/\" \/>\n<meta property=\"og:site_name\" content=\"Centre for Computational Personalized Medicine\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/sano.science\/\" \/>\n<meta property=\"article:modified_time\" content=\"2025-07-08T14:30:33+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:site\" content=\"@sanoscience\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/sano.science\\\/research\\\/hilotel-virtual-reality-robot-interface-based-human-in-the-loop-task-execution-and-learning-in-the-physical-world-through-its-digital-twin\\\/\",\"url\":\"https:\\\/\\\/sano.science\\\/research\\\/hilotel-virtual-reality-robot-interface-based-human-in-the-loop-task-execution-and-learning-in-the-physical-world-through-its-digital-twin\\\/\",\"name\":\"HiLoTEL: Virtual Reality Robot Interface-Based Human-in-the-Loop Task Execution and Learning in the Physical World Through Its Digital Twin - Centre for Computational Personalized Medicine\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/sano.science\\\/#website\"},\"datePublished\":\"2025-02-04T19:31:00+00:00\",\"dateModified\":\"2025-07-08T14:30:33+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/sano.science\\\/research\\\/hilotel-virtual-reality-robot-interface-based-human-in-the-loop-task-execution-and-learning-in-the-physical-world-through-its-digital-twin\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/sano.science\\\/research\\\/hilotel-virtual-reality-robot-interface-based-human-in-the-loop-task-execution-and-learning-in-the-physical-world-through-its-digital-twin\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/sano.science\\\/research\\\/hilotel-virtual-reality-robot-interface-based-human-in-the-loop-task-execution-and-learning-in-the-physical-world-through-its-digital-twin\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/sano.science\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Research\",\"item\":\"https:\\\/\\\/sano.science\\\/research\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Publications\",\"item\":\"https:\\\/\\\/sano.science\\\/research-type\\\/publications\\\/\"},{\"@type\":\"ListItem\",\"position\":4,\"name\":\"HiLoTEL: Virtual Reality Robot Interface-Based Human-in-the-Loop Task Execution and Learning in the Physical World Through Its Digital Twin\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/sano.science\\\/#website\",\"url\":\"https:\\\/\\\/sano.science\\\/\",\"name\":\"Centre for Computational Personalized Medicine\",\"description\":\"Sano \u2013 Centre for Computational Medicine\",\"publisher\":{\"@id\":\"https:\\\/\\\/sano.science\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/sano.science\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/sano.science\\\/#organization\",\"name\":\"Sano \u2013 Centre for Computational Medicine\",\"alternateName\":\"Sano\",\"url\":\"https:\\\/\\\/sano.science\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/sano.science\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/sano.science\\\/wp-content\\\/uploads\\\/2024\\\/05\\\/logo_sano_podstawowe.png\",\"contentUrl\":\"https:\\\/\\\/sano.science\\\/wp-content\\\/uploads\\\/2024\\\/05\\\/logo_sano_podstawowe.png\",\"width\":700,\"height\":265,\"caption\":\"Sano \u2013 Centre for Computational Medicine\"},\"image\":{\"@id\":\"https:\\\/\\\/sano.science\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/sano.science\\\/\",\"https:\\\/\\\/x.com\\\/sanoscience\",\"https:\\\/\\\/www.linkedin.com\\\/company\\\/sanoscience\\\/\",\"https:\\\/\\\/www.youtube.com\\\/channel\\\/UCDZ_8TcjMWUG2ZcgKKgfpwQ\",\"https:\\\/\\\/bsky.app\\\/profile\\\/sanoscience.bsky.social\"]}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"HiLoTEL: Virtual Reality Robot Interface-Based Human-in-the-Loop Task Execution and Learning in the Physical World Through Its Digital Twin - Centre for Computational Personalized Medicine","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/sano.science\/research\/hilotel-virtual-reality-robot-interface-based-human-in-the-loop-task-execution-and-learning-in-the-physical-world-through-its-digital-twin\/","og_locale":"en_US","og_type":"article","og_title":"HiLoTEL: Virtual Reality Robot Interface-Based Human-in-the-Loop Task Execution and Learning in the Physical World Through Its Digital Twin","og_description":"Conference manuscript in IEEE VR, 2024","og_url":"https:\/\/sano.science\/research\/hilotel-virtual-reality-robot-interface-based-human-in-the-loop-task-execution-and-learning-in-the-physical-world-through-its-digital-twin\/","og_site_name":"Centre for Computational Personalized Medicine","article_publisher":"https:\/\/www.facebook.com\/sano.science\/","article_modified_time":"2025-07-08T14:30:33+00:00","twitter_card":"summary_large_image","twitter_site":"@sanoscience","twitter_misc":{"Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/sano.science\/research\/hilotel-virtual-reality-robot-interface-based-human-in-the-loop-task-execution-and-learning-in-the-physical-world-through-its-digital-twin\/","url":"https:\/\/sano.science\/research\/hilotel-virtual-reality-robot-interface-based-human-in-the-loop-task-execution-and-learning-in-the-physical-world-through-its-digital-twin\/","name":"HiLoTEL: Virtual Reality Robot Interface-Based Human-in-the-Loop Task Execution and Learning in the Physical World Through Its Digital Twin - Centre for Computational Personalized Medicine","isPartOf":{"@id":"https:\/\/sano.science\/#website"},"datePublished":"2025-02-04T19:31:00+00:00","dateModified":"2025-07-08T14:30:33+00:00","breadcrumb":{"@id":"https:\/\/sano.science\/research\/hilotel-virtual-reality-robot-interface-based-human-in-the-loop-task-execution-and-learning-in-the-physical-world-through-its-digital-twin\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/sano.science\/research\/hilotel-virtual-reality-robot-interface-based-human-in-the-loop-task-execution-and-learning-in-the-physical-world-through-its-digital-twin\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/sano.science\/research\/hilotel-virtual-reality-robot-interface-based-human-in-the-loop-task-execution-and-learning-in-the-physical-world-through-its-digital-twin\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/sano.science\/"},{"@type":"ListItem","position":2,"name":"Research","item":"https:\/\/sano.science\/research\/"},{"@type":"ListItem","position":3,"name":"Publications","item":"https:\/\/sano.science\/research-type\/publications\/"},{"@type":"ListItem","position":4,"name":"HiLoTEL: Virtual Reality Robot Interface-Based Human-in-the-Loop Task Execution and Learning in the Physical World Through Its Digital Twin"}]},{"@type":"WebSite","@id":"https:\/\/sano.science\/#website","url":"https:\/\/sano.science\/","name":"Centre for Computational Personalized Medicine","description":"Sano \u2013 Centre for Computational Medicine","publisher":{"@id":"https:\/\/sano.science\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/sano.science\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/sano.science\/#organization","name":"Sano \u2013 Centre for Computational Medicine","alternateName":"Sano","url":"https:\/\/sano.science\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/sano.science\/#\/schema\/logo\/image\/","url":"https:\/\/sano.science\/wp-content\/uploads\/2024\/05\/logo_sano_podstawowe.png","contentUrl":"https:\/\/sano.science\/wp-content\/uploads\/2024\/05\/logo_sano_podstawowe.png","width":700,"height":265,"caption":"Sano \u2013 Centre for Computational Medicine"},"image":{"@id":"https:\/\/sano.science\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/sano.science\/","https:\/\/x.com\/sanoscience","https:\/\/www.linkedin.com\/company\/sanoscience\/","https:\/\/www.youtube.com\/channel\/UCDZ_8TcjMWUG2ZcgKKgfpwQ","https:\/\/bsky.app\/profile\/sanoscience.bsky.social"]}]}},"acf":[],"gutenberg_blocks":[{"blockName":"custom-styles","attrs":{"styles":""}},{"blockName":"core\/heading","attrs":{"epAnimationGeneratedClass":"edplus_anim-Or1mHV","epGeneratedClass":"eplus-wrapper"},"innerBlocks":[],"innerHTML":"\n<h2 class=\"wp-block-heading eplus-wrapper\" id=\"h-amanuel-ergogo-nbsp-diego-dall-alba-nbsp-przemyslaw-korzeniowski\">Amanuel Ergogo, Diego Dall'Alba, Przemyslaw Korzeniowski<\/h2>\n","innerContent":["\n<h2 class=\"wp-block-heading eplus-wrapper\" id=\"h-amanuel-ergogo-nbsp-diego-dall-alba-nbsp-przemyslaw-korzeniowski\">Amanuel Ergogo, Diego Dall'Alba, Przemyslaw Korzeniowski<\/h2>\n"]},{"blockName":"core\/spacer","attrs":{"height":"40px","epAnimationGeneratedClass":"edplus_anim-juDPze","epGeneratedClass":"eplus-wrapper"},"innerBlocks":[],"innerHTML":"\n<div style=\"height:40px\" aria-hidden=\"true\" class=\"wp-block-spacer eplus-wrapper\"><\/div>\n","innerContent":["\n<div style=\"height:40px\" aria-hidden=\"true\" class=\"wp-block-spacer eplus-wrapper\"><\/div>\n"]},{"blockName":"core\/paragraph","attrs":{"epAnimationGeneratedClass":"edplus_anim-2mxAaw","epGeneratedClass":"eplus-wrapper"},"innerBlocks":[],"innerHTML":"\n<p class=\" eplus-wrapper\">HiLoTEL is a flexible virtual-reality framework for executing and learning tasks in virtual and physical environments. It enables hu-man experts to collaborate with learning agents and intervene when necessary through human-in-the-loop imitation learning. HiLoTEL reduces the need to carry out repetitive tasks, providing the user with an intuitive supervision interface. The system is tested on Pick-and-Place task, considering both teleoperated and passthrough interaction modalities. The results show that HiLoTEL improves success rates while maintaining human-level completion time and providing users with 71% hands free supervision time, thus enabling effective human-robot collaboration<\/p>\n","innerContent":["\n<p class=\" eplus-wrapper\">HiLoTEL is a flexible virtual-reality framework for executing and learning tasks in virtual and physical environments. It enables hu-man experts to collaborate with learning agents and intervene when necessary through human-in-the-loop imitation learning. HiLoTEL reduces the need to carry out repetitive tasks, providing the user with an intuitive supervision interface. The system is tested on Pick-and-Place task, considering both teleoperated and passthrough interaction modalities. The results show that HiLoTEL improves success rates while maintaining human-level completion time and providing users with 71% hands free supervision time, thus enabling effective human-robot collaboration<\/p>\n"]},{"blockName":"core\/spacer","attrs":{"height":"40px","epAnimationGeneratedClass":"edplus_anim-juDPze","epGeneratedClass":"eplus-wrapper"},"innerBlocks":[],"innerHTML":"\n<div style=\"height:40px\" aria-hidden=\"true\" class=\"wp-block-spacer eplus-wrapper\"><\/div>\n","innerContent":["\n<div style=\"height:40px\" aria-hidden=\"true\" class=\"wp-block-spacer eplus-wrapper\"><\/div>\n"]},{"blockName":"core\/paragraph","attrs":{"epAnimationGeneratedClass":"edplus_anim-Qwi9b1","epGeneratedClass":"eplus-wrapper"},"innerBlocks":[],"innerHTML":"\n<p class=\" eplus-wrapper\"><strong>Authors<\/strong>:\u00a0<a href=\"https:\/\/www.computer.org\/csdl\/search\/default?type=author&givenName=Amanuel&surname=Ergogo\" target=\"_blank\" rel=\"noreferrer noopener\">Amanuel Ergogo<\/a>,\u00a0<a href=\"https:\/\/www.computer.org\/csdl\/search\/default?type=author&givenName=Diego&surname=Dall%27Alba\" target=\"_blank\" rel=\"noreferrer noopener\">Diego Dall'Alba<\/a>,\u00a0\u00a0<a href=\"https:\/\/www.computer.org\/csdl\/search\/default?type=author&givenName=Przemyslaw&surname=Korzeniowski\" target=\"_blank\" rel=\"noreferrer noopener\">Przemyslaw Korzeniowski<\/a><\/p>\n","innerContent":["\n<p class=\" eplus-wrapper\"><strong>Authors<\/strong>:\u00a0<a href=\"https:\/\/www.computer.org\/csdl\/search\/default?type=author&givenName=Amanuel&surname=Ergogo\" target=\"_blank\" rel=\"noreferrer noopener\">Amanuel Ergogo<\/a>,\u00a0<a href=\"https:\/\/www.computer.org\/csdl\/search\/default?type=author&givenName=Diego&surname=Dall%27Alba\" target=\"_blank\" rel=\"noreferrer noopener\">Diego Dall'Alba<\/a>,\u00a0\u00a0<a href=\"https:\/\/www.computer.org\/csdl\/search\/default?type=author&givenName=Przemyslaw&surname=Korzeniowski\" target=\"_blank\" rel=\"noreferrer noopener\">Przemyslaw Korzeniowski<\/a><\/p>\n"]},{"blockName":"core\/paragraph","attrs":{"epAnimationGeneratedClass":"edplus_anim-2RsxZw","epGeneratedClass":"eplus-wrapper"},"innerBlocks":[],"innerHTML":"\n<p class=\" eplus-wrapper\"><strong>DOI<\/strong>: <a href=\"https:\/\/doi.org\/10.1109\/VRW62533.2024.00137\" target=\"_blank\" rel=\"noreferrer noopener\">10.1109\/VRW62533.2024.00137<\/a><\/p>\n","innerContent":["\n<p class=\" eplus-wrapper\"><strong>DOI<\/strong>: <a href=\"https:\/\/doi.org\/10.1109\/VRW62533.2024.00137\" target=\"_blank\" rel=\"noreferrer noopener\">10.1109\/VRW62533.2024.00137<\/a><\/p>\n"]},{"blockName":"core\/spacer","attrs":{"height":"40px","epAnimationGeneratedClass":"edplus_anim-juDPze","epGeneratedClass":"eplus-wrapper"},"innerBlocks":[],"innerHTML":"\n<div style=\"height:40px\" aria-hidden=\"true\" class=\"wp-block-spacer eplus-wrapper\"><\/div>\n","innerContent":["\n<div style=\"height:40px\" aria-hidden=\"true\" class=\"wp-block-spacer eplus-wrapper\"><\/div>\n"]},{"blockName":"acf\/button","attrs":{"title":"","button_type":"link","url":"https:\/\/www.computer.org\/csdl\/proceedings-article\/vrw\/2024\/744900a681\/1XlcE8sI6LC","button_style":"primary","target":"_self","button_extra_classes":""},"innerBlocks":[],"innerHTML":"","innerContent":[]}],"meta_data":{"is_automatically_other_posts":true,"number_of_posts":"3","is_automatically_check_also_posts":true},"_links":{"self":[{"href":"https:\/\/sano.science\/index.php\/wp-json\/wp\/v2\/research\/21132","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sano.science\/index.php\/wp-json\/wp\/v2\/research"}],"about":[{"href":"https:\/\/sano.science\/index.php\/wp-json\/wp\/v2\/types\/research"}],"version-history":[{"count":10,"href":"https:\/\/sano.science\/index.php\/wp-json\/wp\/v2\/research\/21132\/revisions"}],"predecessor-version":[{"id":24901,"href":"https:\/\/sano.science\/index.php\/wp-json\/wp\/v2\/research\/21132\/revisions\/24901"}],"wp:attachment":[{"href":"https:\/\/sano.science\/index.php\/wp-json\/wp\/v2\/media?parent=21132"}],"wp:term":[{"taxonomy":"research_type","embeddable":true,"href":"https:\/\/sano.science\/index.php\/wp-json\/wp\/v2\/research_type?post=21132"},{"taxonomy":"research_team","embeddable":true,"href":"https:\/\/sano.science\/index.php\/wp-json\/wp\/v2\/research_team?post=21132"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}