{"id":15626,"date":"2024-03-04T20:44:09","date_gmt":"2024-03-04T19:44:09","guid":{"rendered":"https:\/\/sano.science\/?post_type=seminars&#038;p=15626"},"modified":"2024-10-09T19:13:22","modified_gmt":"2024-10-09T17:13:22","slug":"advancements-in-synthetic-data-generation-and-novel-view-synthesis-for-enhanced-medical-image-analysis-and-computer-assisted-surgical-systems","status":"publish","type":"seminars","link":"https:\/\/sano.science\/seminars\/advancements-in-synthetic-data-generation-and-novel-view-synthesis-for-enhanced-medical-image-analysis-and-computer-assisted-surgical-systems\/","title":{"rendered":"141. Advancements in Synthetic Data Generation and Novel View Synthesis for Enhanced Medical Image Analysis and Computer-Assisted Surgical Systems"},"content":{"rendered":"\n<h2 class=\"wp-block-heading eplus-wrapper\">Abstract:<\/h2>\n\n\n\n<div style=\"height:30px\" aria-hidden=\"true\" class=\"wp-block-spacer eplus-wrapper\"><\/div>\n\n\n\n<p class=\" eplus-wrapper\">The medical community faces significant challenges due to limited data availability, data scarcity, and the burdensome task of data labeling, which are crucial for training deep learning models and autonomous surgical robots. Recently, synthetic data generation has emerged, allowing for the creation of highly realistic data indistinguishable from real data. This advancement benefits systems reliant on deep learning models trained on complex and difficult-to-annotate data. Additionally, novel view synthesis has seen remarkable growth, thanks to neural rendering and Gaussian splatting, enabling new reconstruction capabilities and accurate novel view synthesis.\u00a0<\/p>\n\n\n\n<div style=\"height:30px\" aria-hidden=\"true\" class=\"wp-block-spacer eplus-wrapper\"><\/div>\n\n\n\n<p class=\" eplus-wrapper\">In this seminar, we will explore innovative approaches to bridge the gap between synthetic and real data, enhancing the effectiveness of both medical image analysis and computer-assisted surgical (CAS) systems.We will begin with a method that combines Stable Diffusion and ControlNet to generate realistic endoscopic images from synthetic data. This approach significantly reduces the domain gap and requires less input data compared to traditional methods. The method is effective in simplified scenarios and extends to a fully-fledged surgical simulator, generating comprehensive annotations and simulating complex surgical interactions. By integrating an image-to-image translation model, it maintains the integrity of the generated annotations and enhances the realism of synthetic datasets.<\/p>\n\n\n\n<div style=\"height:30px\" aria-hidden=\"true\" class=\"wp-block-spacer eplus-wrapper\"><\/div>\n\n\n\n<p class=\" eplus-wrapper\">Next, we will discuss how generative models provide exceptional representations useful for other tasks. We utilize a diffusion model to create a shared representation with a classification model, demonstrating its applicability to semi-supervised classification with very limited labeled data and its capability for self-explainability. This approach combines generative tasks with standard classification, learning from both labeled and unlabeled data while offering explainable results through counterfactual examples. It addresses the critical need for high performance and confidence in medical applications, achieving results comparable to recent semi-supervised methods.<\/p>\n\n\n\n<div style=\"height:30px\" aria-hidden=\"true\" class=\"wp-block-spacer eplus-wrapper\"><\/div>\n\n\n\n<p class=\" eplus-wrapper\">Finally, we will briefly discuss novel view synthesis approaches related to computer graphics, aiming to increase the quality and utility of medical data.<\/p>\n\n\n\n<div style=\"height:30px\" aria-hidden=\"true\" class=\"wp-block-spacer eplus-wrapper\"><\/div>\n\n\n\n<h2 class=\"wp-block-heading eplus-wrapper\">About the author:<\/h2>\n\n\n\n<div style=\"height:30px\" aria-hidden=\"true\" class=\"wp-block-spacer eplus-wrapper\"><\/div>\n\n\n\n<p class=\" eplus-wrapper\">Joanna Kaleta is a\u00a0PhD student at Sano and has also joined the doctoral school at Warsaw University of Technology, Faculty of Computer Science. She holds a Master&#8217;s in Computer Science from the same institution. Her research has primarily focused on generative modeling and bridging the gap between simulation and real medical data. Recently, she has expanded her interests to include computer graphics and novel view synthesis.<\/p>\n\n\n\n<div style=\"height:30px\" aria-hidden=\"true\" class=\"wp-block-spacer eplus-wrapper\"><\/div>\n\n\n\n<figure class=\"wp-block-image size-large eplus-wrapper\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"536\" src=\"https:\/\/sano.science\/wp-content\/uploads\/2024\/07\/Seminarium_Kaleta-1024x536.png\" alt=\"\" class=\"wp-image-18247\" srcset=\"https:\/\/sano.science\/wp-content\/uploads\/2024\/07\/Seminarium_Kaleta-1024x536.png 1024w, https:\/\/sano.science\/wp-content\/uploads\/2024\/07\/Seminarium_Kaleta-300x157.png 300w, https:\/\/sano.science\/wp-content\/uploads\/2024\/07\/Seminarium_Kaleta-768x402.png 768w, https:\/\/sano.science\/wp-content\/uploads\/2024\/07\/Seminarium_Kaleta.png 1200w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n","protected":false},"excerpt":{"rendered":"<p>Joanna Kaleta \u2013 PhD Student, Health Informatics, Sano Centre for Computational Medicine, Krakow, Poland<\/p>\n","protected":false},"featured_media":0,"template":"","class_list":["post-15626","seminars","type-seminars","status-publish","hentry"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v27.4 (Yoast SEO v27.4) - https:\/\/yoast.com\/product\/yoast-seo-premium-wordpress\/ -->\n<title>141. Advancements in Synthetic Data Generation and Novel View Synthesis for Enhanced Medical Image Analysis and Computer-Assisted Surgical Systems - Centre for Computational Personalized Medicine<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/sano.science\/seminars\/advancements-in-synthetic-data-generation-and-novel-view-synthesis-for-enhanced-medical-image-analysis-and-computer-assisted-surgical-systems\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"141. Advancements in Synthetic Data Generation and Novel View Synthesis for Enhanced Medical Image Analysis and Computer-Assisted Surgical Systems\" \/>\n<meta property=\"og:description\" content=\"Joanna Kaleta \u2013 PhD Student, Health Informatics, Sano Centre for Computational Medicine, Krakow, Poland\" \/>\n<meta property=\"og:url\" content=\"https:\/\/sano.science\/seminars\/advancements-in-synthetic-data-generation-and-novel-view-synthesis-for-enhanced-medical-image-analysis-and-computer-assisted-surgical-systems\/\" \/>\n<meta property=\"og:site_name\" content=\"Centre for Computational Personalized Medicine\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/sano.science\/\" \/>\n<meta property=\"article:modified_time\" content=\"2024-10-09T17:13:22+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/sano.science\/wp-content\/uploads\/2024\/07\/Seminarium_Kaleta.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"628\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:site\" content=\"@sanoscience\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/sano.science\\\/seminars\\\/advancements-in-synthetic-data-generation-and-novel-view-synthesis-for-enhanced-medical-image-analysis-and-computer-assisted-surgical-systems\\\/\",\"url\":\"https:\\\/\\\/sano.science\\\/seminars\\\/advancements-in-synthetic-data-generation-and-novel-view-synthesis-for-enhanced-medical-image-analysis-and-computer-assisted-surgical-systems\\\/\",\"name\":\"141. Advancements in Synthetic Data Generation and Novel View Synthesis for Enhanced Medical Image Analysis and Computer-Assisted Surgical Systems - Centre for Computational Personalized Medicine\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/sano.science\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/sano.science\\\/seminars\\\/advancements-in-synthetic-data-generation-and-novel-view-synthesis-for-enhanced-medical-image-analysis-and-computer-assisted-surgical-systems\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/sano.science\\\/seminars\\\/advancements-in-synthetic-data-generation-and-novel-view-synthesis-for-enhanced-medical-image-analysis-and-computer-assisted-surgical-systems\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/sano.science\\\/wp-content\\\/uploads\\\/2024\\\/07\\\/Seminarium_Kaleta-1024x536.png\",\"datePublished\":\"2024-03-04T19:44:09+00:00\",\"dateModified\":\"2024-10-09T17:13:22+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/sano.science\\\/seminars\\\/advancements-in-synthetic-data-generation-and-novel-view-synthesis-for-enhanced-medical-image-analysis-and-computer-assisted-surgical-systems\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/sano.science\\\/seminars\\\/advancements-in-synthetic-data-generation-and-novel-view-synthesis-for-enhanced-medical-image-analysis-and-computer-assisted-surgical-systems\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/sano.science\\\/seminars\\\/advancements-in-synthetic-data-generation-and-novel-view-synthesis-for-enhanced-medical-image-analysis-and-computer-assisted-surgical-systems\\\/#primaryimage\",\"url\":\"https:\\\/\\\/sano.science\\\/wp-content\\\/uploads\\\/2024\\\/07\\\/Seminarium_Kaleta.png\",\"contentUrl\":\"https:\\\/\\\/sano.science\\\/wp-content\\\/uploads\\\/2024\\\/07\\\/Seminarium_Kaleta.png\",\"width\":1200,\"height\":628},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/sano.science\\\/seminars\\\/advancements-in-synthetic-data-generation-and-novel-view-synthesis-for-enhanced-medical-image-analysis-and-computer-assisted-surgical-systems\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/sano.science\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Seminars\",\"item\":\"https:\\\/\\\/sano.science\\\/seminars\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"141. Advancements in Synthetic Data Generation and Novel View Synthesis for Enhanced Medical Image Analysis and Computer-Assisted Surgical Systems\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/sano.science\\\/#website\",\"url\":\"https:\\\/\\\/sano.science\\\/\",\"name\":\"Centre for Computational Personalized Medicine\",\"description\":\"Sano \u2013 Centre for Computational Medicine\",\"publisher\":{\"@id\":\"https:\\\/\\\/sano.science\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/sano.science\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/sano.science\\\/#organization\",\"name\":\"Sano \u2013 Centre for Computational Medicine\",\"alternateName\":\"Sano\",\"url\":\"https:\\\/\\\/sano.science\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/sano.science\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/sano.science\\\/wp-content\\\/uploads\\\/2024\\\/05\\\/logo_sano_podstawowe.png\",\"contentUrl\":\"https:\\\/\\\/sano.science\\\/wp-content\\\/uploads\\\/2024\\\/05\\\/logo_sano_podstawowe.png\",\"width\":700,\"height\":265,\"caption\":\"Sano \u2013 Centre for Computational Medicine\"},\"image\":{\"@id\":\"https:\\\/\\\/sano.science\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/sano.science\\\/\",\"https:\\\/\\\/x.com\\\/sanoscience\",\"https:\\\/\\\/www.linkedin.com\\\/company\\\/sanoscience\\\/\",\"https:\\\/\\\/www.youtube.com\\\/channel\\\/UCDZ_8TcjMWUG2ZcgKKgfpwQ\",\"https:\\\/\\\/bsky.app\\\/profile\\\/sanoscience.bsky.social\"]}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"141. Advancements in Synthetic Data Generation and Novel View Synthesis for Enhanced Medical Image Analysis and Computer-Assisted Surgical Systems - Centre for Computational Personalized Medicine","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/sano.science\/seminars\/advancements-in-synthetic-data-generation-and-novel-view-synthesis-for-enhanced-medical-image-analysis-and-computer-assisted-surgical-systems\/","og_locale":"en_US","og_type":"article","og_title":"141. Advancements in Synthetic Data Generation and Novel View Synthesis for Enhanced Medical Image Analysis and Computer-Assisted Surgical Systems","og_description":"Joanna Kaleta \u2013 PhD Student, Health Informatics, Sano Centre for Computational Medicine, Krakow, Poland","og_url":"https:\/\/sano.science\/seminars\/advancements-in-synthetic-data-generation-and-novel-view-synthesis-for-enhanced-medical-image-analysis-and-computer-assisted-surgical-systems\/","og_site_name":"Centre for Computational Personalized Medicine","article_publisher":"https:\/\/www.facebook.com\/sano.science\/","article_modified_time":"2024-10-09T17:13:22+00:00","og_image":[{"width":1200,"height":628,"url":"https:\/\/sano.science\/wp-content\/uploads\/2024\/07\/Seminarium_Kaleta.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_site":"@sanoscience","twitter_misc":{"Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/sano.science\/seminars\/advancements-in-synthetic-data-generation-and-novel-view-synthesis-for-enhanced-medical-image-analysis-and-computer-assisted-surgical-systems\/","url":"https:\/\/sano.science\/seminars\/advancements-in-synthetic-data-generation-and-novel-view-synthesis-for-enhanced-medical-image-analysis-and-computer-assisted-surgical-systems\/","name":"141. Advancements in Synthetic Data Generation and Novel View Synthesis for Enhanced Medical Image Analysis and Computer-Assisted Surgical Systems - Centre for Computational Personalized Medicine","isPartOf":{"@id":"https:\/\/sano.science\/#website"},"primaryImageOfPage":{"@id":"https:\/\/sano.science\/seminars\/advancements-in-synthetic-data-generation-and-novel-view-synthesis-for-enhanced-medical-image-analysis-and-computer-assisted-surgical-systems\/#primaryimage"},"image":{"@id":"https:\/\/sano.science\/seminars\/advancements-in-synthetic-data-generation-and-novel-view-synthesis-for-enhanced-medical-image-analysis-and-computer-assisted-surgical-systems\/#primaryimage"},"thumbnailUrl":"https:\/\/sano.science\/wp-content\/uploads\/2024\/07\/Seminarium_Kaleta-1024x536.png","datePublished":"2024-03-04T19:44:09+00:00","dateModified":"2024-10-09T17:13:22+00:00","breadcrumb":{"@id":"https:\/\/sano.science\/seminars\/advancements-in-synthetic-data-generation-and-novel-view-synthesis-for-enhanced-medical-image-analysis-and-computer-assisted-surgical-systems\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/sano.science\/seminars\/advancements-in-synthetic-data-generation-and-novel-view-synthesis-for-enhanced-medical-image-analysis-and-computer-assisted-surgical-systems\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/sano.science\/seminars\/advancements-in-synthetic-data-generation-and-novel-view-synthesis-for-enhanced-medical-image-analysis-and-computer-assisted-surgical-systems\/#primaryimage","url":"https:\/\/sano.science\/wp-content\/uploads\/2024\/07\/Seminarium_Kaleta.png","contentUrl":"https:\/\/sano.science\/wp-content\/uploads\/2024\/07\/Seminarium_Kaleta.png","width":1200,"height":628},{"@type":"BreadcrumbList","@id":"https:\/\/sano.science\/seminars\/advancements-in-synthetic-data-generation-and-novel-view-synthesis-for-enhanced-medical-image-analysis-and-computer-assisted-surgical-systems\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/sano.science\/"},{"@type":"ListItem","position":2,"name":"Seminars","item":"https:\/\/sano.science\/seminars\/"},{"@type":"ListItem","position":3,"name":"141. Advancements in Synthetic Data Generation and Novel View Synthesis for Enhanced Medical Image Analysis and Computer-Assisted Surgical Systems"}]},{"@type":"WebSite","@id":"https:\/\/sano.science\/#website","url":"https:\/\/sano.science\/","name":"Centre for Computational Personalized Medicine","description":"Sano \u2013 Centre for Computational Medicine","publisher":{"@id":"https:\/\/sano.science\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/sano.science\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/sano.science\/#organization","name":"Sano \u2013 Centre for Computational Medicine","alternateName":"Sano","url":"https:\/\/sano.science\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/sano.science\/#\/schema\/logo\/image\/","url":"https:\/\/sano.science\/wp-content\/uploads\/2024\/05\/logo_sano_podstawowe.png","contentUrl":"https:\/\/sano.science\/wp-content\/uploads\/2024\/05\/logo_sano_podstawowe.png","width":700,"height":265,"caption":"Sano \u2013 Centre for Computational Medicine"},"image":{"@id":"https:\/\/sano.science\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/sano.science\/","https:\/\/x.com\/sanoscience","https:\/\/www.linkedin.com\/company\/sanoscience\/","https:\/\/www.youtube.com\/channel\/UCDZ_8TcjMWUG2ZcgKKgfpwQ","https:\/\/bsky.app\/profile\/sanoscience.bsky.social"]}]}},"acf":[],"gutenberg_blocks":[{"blockName":"custom-styles","attrs":{"styles":""}},{"blockName":"core\/heading","attrs":{"epAnimationGeneratedClass":"edplus_anim-TTyl0s","epGeneratedClass":"eplus-wrapper"},"innerBlocks":[],"innerHTML":"\n<h2 class=\"wp-block-heading eplus-wrapper\">Abstract:<\/h2>\n","innerContent":["\n<h2 class=\"wp-block-heading eplus-wrapper\">Abstract:<\/h2>\n"]},{"blockName":"core\/spacer","attrs":{"height":"30px","epAnimationGeneratedClass":"edplus_anim-1pQWL6","epGeneratedClass":"eplus-wrapper"},"innerBlocks":[],"innerHTML":"\n<div style=\"height:30px\" aria-hidden=\"true\" class=\"wp-block-spacer eplus-wrapper\"><\/div>\n","innerContent":["\n<div style=\"height:30px\" aria-hidden=\"true\" class=\"wp-block-spacer eplus-wrapper\"><\/div>\n"]},{"blockName":"core\/paragraph","attrs":{"epAnimationGeneratedClass":"edplus_anim-JMlzCt","epGeneratedClass":"eplus-wrapper"},"innerBlocks":[],"innerHTML":"\n<p class=\" eplus-wrapper\">The medical community faces significant challenges due to limited data availability, data scarcity, and the burdensome task of data labeling, which are crucial for training deep learning models and autonomous surgical robots. Recently, synthetic data generation has emerged, allowing for the creation of highly realistic data indistinguishable from real data. This advancement benefits systems reliant on deep learning models trained on complex and difficult-to-annotate data. Additionally, novel view synthesis has seen remarkable growth, thanks to neural rendering and Gaussian splatting, enabling new reconstruction capabilities and accurate novel view synthesis.\u00a0<\/p>\n","innerContent":["\n<p class=\" eplus-wrapper\">The medical community faces significant challenges due to limited data availability, data scarcity, and the burdensome task of data labeling, which are crucial for training deep learning models and autonomous surgical robots. Recently, synthetic data generation has emerged, allowing for the creation of highly realistic data indistinguishable from real data. This advancement benefits systems reliant on deep learning models trained on complex and difficult-to-annotate data. Additionally, novel view synthesis has seen remarkable growth, thanks to neural rendering and Gaussian splatting, enabling new reconstruction capabilities and accurate novel view synthesis.\u00a0<\/p>\n"]},{"blockName":"core\/spacer","attrs":{"height":"30px","epAnimationGeneratedClass":"edplus_anim-1pQWL6","epGeneratedClass":"eplus-wrapper"},"innerBlocks":[],"innerHTML":"\n<div style=\"height:30px\" aria-hidden=\"true\" class=\"wp-block-spacer eplus-wrapper\"><\/div>\n","innerContent":["\n<div style=\"height:30px\" aria-hidden=\"true\" class=\"wp-block-spacer eplus-wrapper\"><\/div>\n"]},{"blockName":"core\/paragraph","attrs":{"epAnimationGeneratedClass":"edplus_anim-EEKTAe","epGeneratedClass":"eplus-wrapper"},"innerBlocks":[],"innerHTML":"\n<p class=\" eplus-wrapper\">In this seminar, we will explore innovative approaches to bridge the gap between synthetic and real data, enhancing the effectiveness of both medical image analysis and computer-assisted surgical (CAS) systems.We will begin with a method that combines Stable Diffusion and ControlNet to generate realistic endoscopic images from synthetic data. This approach significantly reduces the domain gap and requires less input data compared to traditional methods. The method is effective in simplified scenarios and extends to a fully-fledged surgical simulator, generating comprehensive annotations and simulating complex surgical interactions. By integrating an image-to-image translation model, it maintains the integrity of the generated annotations and enhances the realism of synthetic datasets.<\/p>\n","innerContent":["\n<p class=\" eplus-wrapper\">In this seminar, we will explore innovative approaches to bridge the gap between synthetic and real data, enhancing the effectiveness of both medical image analysis and computer-assisted surgical (CAS) systems.We will begin with a method that combines Stable Diffusion and ControlNet to generate realistic endoscopic images from synthetic data. This approach significantly reduces the domain gap and requires less input data compared to traditional methods. The method is effective in simplified scenarios and extends to a fully-fledged surgical simulator, generating comprehensive annotations and simulating complex surgical interactions. By integrating an image-to-image translation model, it maintains the integrity of the generated annotations and enhances the realism of synthetic datasets.<\/p>\n"]},{"blockName":"core\/spacer","attrs":{"height":"30px","epAnimationGeneratedClass":"edplus_anim-1pQWL6","epGeneratedClass":"eplus-wrapper"},"innerBlocks":[],"innerHTML":"\n<div style=\"height:30px\" aria-hidden=\"true\" class=\"wp-block-spacer eplus-wrapper\"><\/div>\n","innerContent":["\n<div style=\"height:30px\" aria-hidden=\"true\" class=\"wp-block-spacer eplus-wrapper\"><\/div>\n"]},{"blockName":"core\/paragraph","attrs":{"epAnimationGeneratedClass":"edplus_anim-nOtEwH","epGeneratedClass":"eplus-wrapper"},"innerBlocks":[],"innerHTML":"\n<p class=\" eplus-wrapper\">Next, we will discuss how generative models provide exceptional representations useful for other tasks. We utilize a diffusion model to create a shared representation with a classification model, demonstrating its applicability to semi-supervised classification with very limited labeled data and its capability for self-explainability. This approach combines generative tasks with standard classification, learning from both labeled and unlabeled data while offering explainable results through counterfactual examples. It addresses the critical need for high performance and confidence in medical applications, achieving results comparable to recent semi-supervised methods.<\/p>\n","innerContent":["\n<p class=\" eplus-wrapper\">Next, we will discuss how generative models provide exceptional representations useful for other tasks. We utilize a diffusion model to create a shared representation with a classification model, demonstrating its applicability to semi-supervised classification with very limited labeled data and its capability for self-explainability. This approach combines generative tasks with standard classification, learning from both labeled and unlabeled data while offering explainable results through counterfactual examples. It addresses the critical need for high performance and confidence in medical applications, achieving results comparable to recent semi-supervised methods.<\/p>\n"]},{"blockName":"core\/spacer","attrs":{"height":"30px","epAnimationGeneratedClass":"edplus_anim-1pQWL6","epGeneratedClass":"eplus-wrapper"},"innerBlocks":[],"innerHTML":"\n<div style=\"height:30px\" aria-hidden=\"true\" class=\"wp-block-spacer eplus-wrapper\"><\/div>\n","innerContent":["\n<div style=\"height:30px\" aria-hidden=\"true\" class=\"wp-block-spacer eplus-wrapper\"><\/div>\n"]},{"blockName":"core\/paragraph","attrs":{"epAnimationGeneratedClass":"edplus_anim-ofhsGh","epGeneratedClass":"eplus-wrapper"},"innerBlocks":[],"innerHTML":"\n<p class=\" eplus-wrapper\">Finally, we will briefly discuss novel view synthesis approaches related to computer graphics, aiming to increase the quality and utility of medical data.<\/p>\n","innerContent":["\n<p class=\" eplus-wrapper\">Finally, we will briefly discuss novel view synthesis approaches related to computer graphics, aiming to increase the quality and utility of medical data.<\/p>\n"]},{"blockName":"core\/spacer","attrs":{"height":"30px","epAnimationGeneratedClass":"edplus_anim-1pQWL6","epGeneratedClass":"eplus-wrapper"},"innerBlocks":[],"innerHTML":"\n<div style=\"height:30px\" aria-hidden=\"true\" class=\"wp-block-spacer eplus-wrapper\"><\/div>\n","innerContent":["\n<div style=\"height:30px\" aria-hidden=\"true\" class=\"wp-block-spacer eplus-wrapper\"><\/div>\n"]},{"blockName":"core\/heading","attrs":{"epAnimationGeneratedClass":"edplus_anim-WFl4Ty","epGeneratedClass":"eplus-wrapper"},"innerBlocks":[],"innerHTML":"\n<h2 class=\"wp-block-heading eplus-wrapper\">About the author:<\/h2>\n","innerContent":["\n<h2 class=\"wp-block-heading eplus-wrapper\">About the author:<\/h2>\n"]},{"blockName":"core\/spacer","attrs":{"height":"30px","epAnimationGeneratedClass":"edplus_anim-1pQWL6","epGeneratedClass":"eplus-wrapper"},"innerBlocks":[],"innerHTML":"\n<div style=\"height:30px\" aria-hidden=\"true\" class=\"wp-block-spacer eplus-wrapper\"><\/div>\n","innerContent":["\n<div style=\"height:30px\" aria-hidden=\"true\" class=\"wp-block-spacer eplus-wrapper\"><\/div>\n"]},{"blockName":"core\/paragraph","attrs":{"epAnimationGeneratedClass":"edplus_anim-o58eRT","epGeneratedClass":"eplus-wrapper"},"innerBlocks":[],"innerHTML":"\n<p class=\" eplus-wrapper\">Joanna Kaleta is a\u00a0PhD student at Sano and has also joined the doctoral school at Warsaw University of Technology, Faculty of Computer Science. She holds a Master's in Computer Science from the same institution. Her research has primarily focused on generative modeling and bridging the gap between simulation and real medical data. Recently, she has expanded her interests to include computer graphics and novel view synthesis.<\/p>\n","innerContent":["\n<p class=\" eplus-wrapper\">Joanna Kaleta is a\u00a0PhD student at Sano and has also joined the doctoral school at Warsaw University of Technology, Faculty of Computer Science. She holds a Master's in Computer Science from the same institution. Her research has primarily focused on generative modeling and bridging the gap between simulation and real medical data. Recently, she has expanded her interests to include computer graphics and novel view synthesis.<\/p>\n"]},{"blockName":"core\/spacer","attrs":{"height":"30px","epAnimationGeneratedClass":"edplus_anim-1pQWL6","epGeneratedClass":"eplus-wrapper"},"innerBlocks":[],"innerHTML":"\n<div style=\"height:30px\" aria-hidden=\"true\" class=\"wp-block-spacer eplus-wrapper\"><\/div>\n","innerContent":["\n<div style=\"height:30px\" aria-hidden=\"true\" class=\"wp-block-spacer eplus-wrapper\"><\/div>\n"]},{"blockName":"core\/image","attrs":{"id":18247,"sizeSlug":"large","linkDestination":"none","epAnimationGeneratedClass":"edplus_anim-Pz67hR","epGeneratedClass":"eplus-wrapper"},"innerBlocks":[],"innerHTML":"\n<figure class=\"wp-block-image size-large eplus-wrapper\"><img src=\"https:\/\/sano.science\/wp-content\/uploads\/2024\/07\/Seminarium_Kaleta-1024x536.png\" alt=\"\" class=\"wp-image-18247\"\/><\/figure>\n","innerContent":["\n<figure class=\"wp-block-image size-large eplus-wrapper\"><img src=\"https:\/\/sano.science\/wp-content\/uploads\/2024\/07\/Seminarium_Kaleta-1024x536.png\" alt=\"\" class=\"wp-image-18247\"\/><\/figure>\n"]}],"meta_data":{"event_day":"2024-07-22","event_time":"2:00-3:30 PM (CEST)","event_guest":"Joanna Kaleta \u2013 PhD Student, Health Informatics, Sano Centre for Computational Medicine, Krakow, PL","has_medias":true,"medias":[{"icon":{"ID":1144,"id":1144,"title":"clock","filename":"clock.svg","filesize":1479,"url":"https:\/\/sano.science\/wp-content\/uploads\/2023\/06\/clock.svg","link":"https:\/\/sano.science\/seminars\/79-digital-behaviour-change-interventions-dbci-from-design-to-implementation\/clock\/","alt":"clock Sano Seminar","author":"7","description":"","caption":"Sano Seminar clock","name":"clock","status":"inherit","uploaded_to":13471,"date":"2023-06-01 13:24:42","modified":"2024-10-09 16:41:04","menu_order":0,"mime_type":"image\/svg+xml","type":"image","subtype":"svg+xml","icon":"https:\/\/sano.science\/wp-includes\/images\/media\/default.png","width":56,"height":57,"sizes":{"thumbnail":"https:\/\/sano.science\/wp-content\/uploads\/2023\/06\/clock.svg","thumbnail-width":147,"thumbnail-height":150,"medium":"https:\/\/sano.science\/wp-content\/uploads\/2023\/06\/clock.svg","medium-width":294,"medium-height":300,"medium_large":"https:\/\/sano.science\/wp-content\/uploads\/2023\/06\/clock.svg","medium_large-width":768,"medium_large-height":783,"large":"https:\/\/sano.science\/wp-content\/uploads\/2023\/06\/clock.svg","large-width":1004,"large-height":1024,"1536x1536":"https:\/\/sano.science\/wp-content\/uploads\/2023\/06\/clock.svg","1536x1536-width":56,"1536x1536-height":57,"2048x2048":"https:\/\/sano.science\/wp-content\/uploads\/2023\/06\/clock.svg","2048x2048-width":56,"2048x2048-height":57}},"title":"22nd July 2024, 2:00-3:30 PM (CEST)","link":""},{"icon":{"ID":1146,"id":1146,"title":"camera","filename":"camera.svg","filesize":1129,"url":"https:\/\/sano.science\/wp-content\/uploads\/2023\/06\/camera.svg","link":"https:\/\/sano.science\/seminars\/79-digital-behaviour-change-interventions-dbci-from-design-to-implementation\/camera\/","alt":"camera Sano Seminar","author":"7","description":"","caption":"Sano Seminar camera","name":"camera","status":"inherit","uploaded_to":13471,"date":"2023-06-01 13:25:24","modified":"2024-10-09 16:42:29","menu_order":0,"mime_type":"image\/svg+xml","type":"image","subtype":"svg+xml","icon":"https:\/\/sano.science\/wp-includes\/images\/media\/default.png","width":60,"height":38,"sizes":{"thumbnail":"https:\/\/sano.science\/wp-content\/uploads\/2023\/06\/camera.svg","thumbnail-width":150,"thumbnail-height":95,"medium":"https:\/\/sano.science\/wp-content\/uploads\/2023\/06\/camera.svg","medium-width":300,"medium-height":190,"medium_large":"https:\/\/sano.science\/wp-content\/uploads\/2023\/06\/camera.svg","medium_large-width":768,"medium_large-height":486,"large":"https:\/\/sano.science\/wp-content\/uploads\/2023\/06\/camera.svg","large-width":1024,"large-height":648,"1536x1536":"https:\/\/sano.science\/wp-content\/uploads\/2023\/06\/camera.svg","1536x1536-width":60,"1536x1536-height":38,"2048x2048":"https:\/\/sano.science\/wp-content\/uploads\/2023\/06\/camera.svg","2048x2048-width":60,"2048x2048-height":38}},"title":"Join via ZOOM on","link":{"title":"seminar.sano.science","url":"https:\/\/us06web.zoom.us\/j\/81263292238#success","target":"_blank"}}]},"_links":{"self":[{"href":"https:\/\/sano.science\/index.php\/wp-json\/wp\/v2\/seminars\/15626","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sano.science\/index.php\/wp-json\/wp\/v2\/seminars"}],"about":[{"href":"https:\/\/sano.science\/index.php\/wp-json\/wp\/v2\/types\/seminars"}],"version-history":[{"count":16,"href":"https:\/\/sano.science\/index.php\/wp-json\/wp\/v2\/seminars\/15626\/revisions"}],"predecessor-version":[{"id":19234,"href":"https:\/\/sano.science\/index.php\/wp-json\/wp\/v2\/seminars\/15626\/revisions\/19234"}],"wp:attachment":[{"href":"https:\/\/sano.science\/index.php\/wp-json\/wp\/v2\/media?parent=15626"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}