{"id":12585,"date":"2023-07-12T15:44:17","date_gmt":"2023-07-12T13:44:17","guid":{"rendered":"https:\/\/new.sano.science\/?post_type=research&p=12585"},"modified":"2024-01-05T13:57:38","modified_gmt":"2024-01-05T12:57:38","slug":"algorithms-for-cost-and-deadline-constrained-provisioning-for-scientific-workflow-ensembles-in-iaas-clouds","status":"publish","type":"research","link":"https:\/\/sano.science\/research\/algorithms-for-cost-and-deadline-constrained-provisioning-for-scientific-workflow-ensembles-in-iaas-clouds\/","title":{"rendered":"Algorithms for cost-and deadline-constrained provisioning for scientific workflow ensembles in IaaS clouds\u00a0"},"content":{"rendered":"\n

Malawski, Maciej; Juve, Gideon; Deelman, Ewa; Nabrzyski, Jarek<\/h2>\n\n\n\n
<\/div>\n\n\n\n

Large-scale applications expressed as scientific workflows are often grouped into ensembles of inter-related workflows. In this paper, we address a new and important problem concerning the efficient management of such ensembles under budget and deadline constraints on Infrastructure as a Service (IaaS) clouds. IaaS clouds are characterized by on-demand resource provisioning capabilities and a pay-per-use model. We discuss, develop, and assess novel algorithms based on static and dynamic strategies for both task scheduling and resource provisioning. We perform the evaluation via simulation using a set of scientific workflow ensembles with a broad range of budget and deadline parameters, taking into account task granularity, uncertainties in task runtime estimations, provisioning delays, and failures. We find that the key factor determining the performance of an algorithm is its ability to decide which workflows in an ensemble to admit or reject for execution. Our results show that an admission procedure based on workflow structure and estimates of task runtimes can significantly improve the quality of solutions.<\/p>\n\n\n\n

<\/div>\n\n\n\n\t\n \n \n\t\t\t\n\n\t\t\t\t\n\t\t\t\t\tREAD HERE\n\t\t\t\t<\/span>\n\n\t\t\t<\/a>\n\n \n \n","protected":false},"excerpt":{"rendered":"

In: Future Generation Computer Systems, vol. 48, pp. 1\u201318, 2015, ISSN: 0167739X.<\/p>\n","protected":false},"featured_media":0,"template":"","research_type":[8],"research_team":[16],"class_list":["post-12585","research","type-research","status-publish","hentry","research_type-publications","research_team-extreme-scale-data-and-computing"],"yoast_head":"\nAlgorithms for cost-and deadline-constrained provisioning for scientific workflow ensembles in IaaS clouds\u00a0 - Centre for Computational Personalized Medicine<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/sano.science\/research\/algorithms-for-cost-and-deadline-constrained-provisioning-for-scientific-workflow-ensembles-in-iaas-clouds\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Algorithms for cost-and deadline-constrained provisioning for scientific workflow ensembles in IaaS clouds\u00a0\" \/>\n<meta property=\"og:description\" content=\"In: Future Generation Computer Systems, vol. 48, pp. 1\u201318, 2015, ISSN: 0167739X.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/sano.science\/research\/algorithms-for-cost-and-deadline-constrained-provisioning-for-scientific-workflow-ensembles-in-iaas-clouds\/\" \/>\n<meta property=\"og:site_name\" content=\"Centre for Computational Personalized Medicine\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/sano.science\/\" \/>\n<meta property=\"article:modified_time\" content=\"2024-01-05T12:57:38+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:site\" content=\"@sanoscience\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/sano.science\\\/research\\\/algorithms-for-cost-and-deadline-constrained-provisioning-for-scientific-workflow-ensembles-in-iaas-clouds\\\/\",\"url\":\"https:\\\/\\\/sano.science\\\/research\\\/algorithms-for-cost-and-deadline-constrained-provisioning-for-scientific-workflow-ensembles-in-iaas-clouds\\\/\",\"name\":\"Algorithms for cost-and deadline-constrained provisioning for scientific workflow ensembles in IaaS clouds\u00a0 - Centre for Computational Personalized Medicine\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/sano.science\\\/#website\"},\"datePublished\":\"2023-07-12T13:44:17+00:00\",\"dateModified\":\"2024-01-05T12:57:38+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/sano.science\\\/research\\\/algorithms-for-cost-and-deadline-constrained-provisioning-for-scientific-workflow-ensembles-in-iaas-clouds\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/sano.science\\\/research\\\/algorithms-for-cost-and-deadline-constrained-provisioning-for-scientific-workflow-ensembles-in-iaas-clouds\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/sano.science\\\/research\\\/algorithms-for-cost-and-deadline-constrained-provisioning-for-scientific-workflow-ensembles-in-iaas-clouds\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/sano.science\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Research\",\"item\":\"https:\\\/\\\/sano.science\\\/research\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Publications\",\"item\":\"https:\\\/\\\/sano.science\\\/research-type\\\/publications\\\/\"},{\"@type\":\"ListItem\",\"position\":4,\"name\":\"Algorithms for cost-and deadline-constrained provisioning for scientific workflow ensembles in IaaS clouds\u00a0\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/sano.science\\\/#website\",\"url\":\"https:\\\/\\\/sano.science\\\/\",\"name\":\"Centre for Computational Personalized Medicine\",\"description\":\"Sano \u2013 Centre for Computational Medicine\",\"publisher\":{\"@id\":\"https:\\\/\\\/sano.science\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/sano.science\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/sano.science\\\/#organization\",\"name\":\"Sano \u2013 Centre for Computational Medicine\",\"alternateName\":\"Sano\",\"url\":\"https:\\\/\\\/sano.science\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/sano.science\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/sano.science\\\/wp-content\\\/uploads\\\/2024\\\/05\\\/logo_sano_podstawowe.png\",\"contentUrl\":\"https:\\\/\\\/sano.science\\\/wp-content\\\/uploads\\\/2024\\\/05\\\/logo_sano_podstawowe.png\",\"width\":700,\"height\":265,\"caption\":\"Sano \u2013 Centre for Computational Medicine\"},\"image\":{\"@id\":\"https:\\\/\\\/sano.science\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/sano.science\\\/\",\"https:\\\/\\\/x.com\\\/sanoscience\",\"https:\\\/\\\/www.linkedin.com\\\/company\\\/sanoscience\\\/\",\"https:\\\/\\\/www.youtube.com\\\/channel\\\/UCDZ_8TcjMWUG2ZcgKKgfpwQ\",\"https:\\\/\\\/bsky.app\\\/profile\\\/sanoscience.bsky.social\"]}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Algorithms for cost-and deadline-constrained provisioning for scientific workflow ensembles in IaaS clouds\u00a0 - Centre for Computational Personalized Medicine","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/sano.science\/research\/algorithms-for-cost-and-deadline-constrained-provisioning-for-scientific-workflow-ensembles-in-iaas-clouds\/","og_locale":"en_US","og_type":"article","og_title":"Algorithms for cost-and deadline-constrained provisioning for scientific workflow ensembles in IaaS clouds\u00a0","og_description":"In: Future Generation Computer Systems, vol. 48, pp. 1\u201318, 2015, ISSN: 0167739X.","og_url":"https:\/\/sano.science\/research\/algorithms-for-cost-and-deadline-constrained-provisioning-for-scientific-workflow-ensembles-in-iaas-clouds\/","og_site_name":"Centre for Computational Personalized Medicine","article_publisher":"https:\/\/www.facebook.com\/sano.science\/","article_modified_time":"2024-01-05T12:57:38+00:00","twitter_card":"summary_large_image","twitter_site":"@sanoscience","twitter_misc":{"Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/sano.science\/research\/algorithms-for-cost-and-deadline-constrained-provisioning-for-scientific-workflow-ensembles-in-iaas-clouds\/","url":"https:\/\/sano.science\/research\/algorithms-for-cost-and-deadline-constrained-provisioning-for-scientific-workflow-ensembles-in-iaas-clouds\/","name":"Algorithms for cost-and deadline-constrained provisioning for scientific workflow ensembles in IaaS clouds\u00a0 - Centre for Computational Personalized Medicine","isPartOf":{"@id":"https:\/\/sano.science\/#website"},"datePublished":"2023-07-12T13:44:17+00:00","dateModified":"2024-01-05T12:57:38+00:00","breadcrumb":{"@id":"https:\/\/sano.science\/research\/algorithms-for-cost-and-deadline-constrained-provisioning-for-scientific-workflow-ensembles-in-iaas-clouds\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/sano.science\/research\/algorithms-for-cost-and-deadline-constrained-provisioning-for-scientific-workflow-ensembles-in-iaas-clouds\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/sano.science\/research\/algorithms-for-cost-and-deadline-constrained-provisioning-for-scientific-workflow-ensembles-in-iaas-clouds\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/sano.science\/"},{"@type":"ListItem","position":2,"name":"Research","item":"https:\/\/sano.science\/research\/"},{"@type":"ListItem","position":3,"name":"Publications","item":"https:\/\/sano.science\/research-type\/publications\/"},{"@type":"ListItem","position":4,"name":"Algorithms for cost-and deadline-constrained provisioning for scientific workflow ensembles in IaaS clouds\u00a0"}]},{"@type":"WebSite","@id":"https:\/\/sano.science\/#website","url":"https:\/\/sano.science\/","name":"Centre for Computational Personalized Medicine","description":"Sano \u2013 Centre for Computational Medicine","publisher":{"@id":"https:\/\/sano.science\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/sano.science\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/sano.science\/#organization","name":"Sano \u2013 Centre for Computational Medicine","alternateName":"Sano","url":"https:\/\/sano.science\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/sano.science\/#\/schema\/logo\/image\/","url":"https:\/\/sano.science\/wp-content\/uploads\/2024\/05\/logo_sano_podstawowe.png","contentUrl":"https:\/\/sano.science\/wp-content\/uploads\/2024\/05\/logo_sano_podstawowe.png","width":700,"height":265,"caption":"Sano \u2013 Centre for Computational Medicine"},"image":{"@id":"https:\/\/sano.science\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/sano.science\/","https:\/\/x.com\/sanoscience","https:\/\/www.linkedin.com\/company\/sanoscience\/","https:\/\/www.youtube.com\/channel\/UCDZ_8TcjMWUG2ZcgKKgfpwQ","https:\/\/bsky.app\/profile\/sanoscience.bsky.social"]}]}},"acf":[],"gutenberg_blocks":[{"blockName":"custom-styles","attrs":{"styles":""}},{"blockName":"core\/heading","attrs":{"epAnimationGeneratedClass":"edplus_anim-OmJe40","epGeneratedClass":"eplus-wrapper"},"innerBlocks":[],"innerHTML":"\n<h2 class=\"wp-block-heading eplus-wrapper\">Malawski, Maciej; Juve, Gideon; Deelman, Ewa; Nabrzyski, Jarek<\/h2>\n","innerContent":["\n<h2 class=\"wp-block-heading eplus-wrapper\">Malawski, Maciej; Juve, Gideon; Deelman, Ewa; Nabrzyski, Jarek<\/h2>\n"]},{"blockName":"core\/spacer","attrs":{"height":"50px","epAnimationGeneratedClass":"edplus_anim-ca6pce","epGeneratedClass":"eplus-wrapper"},"innerBlocks":[],"innerHTML":"\n<div style=\"height:50px\" aria-hidden=\"true\" class=\"wp-block-spacer eplus-wrapper\"><\/div>\n","innerContent":["\n<div style=\"height:50px\" aria-hidden=\"true\" class=\"wp-block-spacer eplus-wrapper\"><\/div>\n"]},{"blockName":"core\/paragraph","attrs":{"epAnimationGeneratedClass":"edplus_anim-TPKkWw","epGeneratedClass":"eplus-wrapper"},"innerBlocks":[],"innerHTML":"\n<p class=\" eplus-wrapper\">Large-scale applications expressed as scientific workflows are often grouped into ensembles of inter-related workflows. In this paper, we address a new and important problem concerning the efficient management of such ensembles under budget and deadline constraints on Infrastructure as a Service (IaaS) clouds. IaaS clouds are characterized by on-demand resource provisioning capabilities and a pay-per-use model. We discuss, develop, and assess novel algorithms based on static and dynamic strategies for both task scheduling and resource provisioning. We perform the evaluation via simulation using a set of scientific workflow ensembles with a broad range of budget and deadline parameters, taking into account task granularity, uncertainties in task runtime estimations, provisioning delays, and failures. We find that the key factor determining the performance of an algorithm is its ability to decide which workflows in an ensemble to admit or reject for execution. Our results show that an admission procedure based on workflow structure and estimates of task runtimes can significantly improve the quality of solutions.<\/p>\n","innerContent":["\n<p class=\" eplus-wrapper\">Large-scale applications expressed as scientific workflows are often grouped into ensembles of inter-related workflows. In this paper, we address a new and important problem concerning the efficient management of such ensembles under budget and deadline constraints on Infrastructure as a Service (IaaS) clouds. IaaS clouds are characterized by on-demand resource provisioning capabilities and a pay-per-use model. We discuss, develop, and assess novel algorithms based on static and dynamic strategies for both task scheduling and resource provisioning. We perform the evaluation via simulation using a set of scientific workflow ensembles with a broad range of budget and deadline parameters, taking into account task granularity, uncertainties in task runtime estimations, provisioning delays, and failures. We find that the key factor determining the performance of an algorithm is its ability to decide which workflows in an ensemble to admit or reject for execution. Our results show that an admission procedure based on workflow structure and estimates of task runtimes can significantly improve the quality of solutions.<\/p>\n"]},{"blockName":"core\/spacer","attrs":{"height":"50px","epAnimationGeneratedClass":"edplus_anim-syXWPn","epGeneratedClass":"eplus-wrapper"},"innerBlocks":[],"innerHTML":"\n<div style=\"height:50px\" aria-hidden=\"true\" class=\"wp-block-spacer eplus-wrapper\"><\/div>\n","innerContent":["\n<div style=\"height:50px\" aria-hidden=\"true\" class=\"wp-block-spacer eplus-wrapper\"><\/div>\n"]},{"blockName":"acf\/button","attrs":{"title":"READ HERE","button_type":"link","url":"https:\/\/www.sciencedirect.com\/science\/article\/abs\/pii\/S0167739X15000059?via%3Dihub","button_style":"primary","target":"_blank","button_extra_classes":""},"innerBlocks":[],"innerHTML":"","innerContent":[]}],"meta_data":{"is_automatically_other_posts":true,"number_of_posts":"3","is_automatically_check_also_posts":true},"_links":{"self":[{"href":"https:\/\/sano.science\/index.php\/wp-json\/wp\/v2\/research\/12585","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sano.science\/index.php\/wp-json\/wp\/v2\/research"}],"about":[{"href":"https:\/\/sano.science\/index.php\/wp-json\/wp\/v2\/types\/research"}],"version-history":[{"count":4,"href":"https:\/\/sano.science\/index.php\/wp-json\/wp\/v2\/research\/12585\/revisions"}],"predecessor-version":[{"id":14730,"href":"https:\/\/sano.science\/index.php\/wp-json\/wp\/v2\/research\/12585\/revisions\/14730"}],"wp:attachment":[{"href":"https:\/\/sano.science\/index.php\/wp-json\/wp\/v2\/media?parent=12585"}],"wp:term":[{"taxonomy":"research_type","embeddable":true,"href":"https:\/\/sano.science\/index.php\/wp-json\/wp\/v2\/research_type?post=12585"},{"taxonomy":"research_team","embeddable":true,"href":"https:\/\/sano.science\/index.php\/wp-json\/wp\/v2\/research_team?post=12585"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}