{"id":18113,"date":"2019-10-10T15:23:24","date_gmt":"2019-10-10T22:23:24","guid":{"rendered":"https:\/\/faculty.engineering.asu.edu\/bertsekas\/?page_id=18113"},"modified":"2020-04-16T11:38:11","modified_gmt":"2020-04-16T18:38:11","slug":"semicontractive-dynamic-programming","status":"publish","type":"page","link":"https:\/\/faculty.engineering.asu.edu\/bertsekas\/semicontractive-dynamic-programming\/","title":{"rendered":"Semicontractive dynamic programming"},"content":{"rendered":"<p>[et_pb_section fb_built=&#8221;1&#8243; _builder_version=&#8221;3.22&#8243;][et_pb_row _builder_version=&#8221;3.25&#8243; background_size=&#8221;initial&#8221; background_position=&#8221;top_left&#8221; background_repeat=&#8221;repeat&#8221;][et_pb_column type=&#8221;4_4&#8243; _builder_version=&#8221;3.25&#8243; custom_padding=&#8221;|||&#8221; custom_padding__hover=&#8221;|||&#8221;][et_pb_text _builder_version=&#8221;4.4.1&#8243; z_index_tablet=&#8221;500&#8243; text_text_shadow_horizontal_length_tablet=&#8221;0px&#8221; text_text_shadow_vertical_length_tablet=&#8221;0px&#8221; text_text_shadow_blur_strength_tablet=&#8221;1px&#8221; link_text_shadow_horizontal_length_tablet=&#8221;0px&#8221; link_text_shadow_vertical_length_tablet=&#8221;0px&#8221; link_text_shadow_blur_strength_tablet=&#8221;1px&#8221; ul_text_shadow_horizontal_length_tablet=&#8221;0px&#8221; ul_text_shadow_vertical_length_tablet=&#8221;0px&#8221; ul_text_shadow_blur_strength_tablet=&#8221;1px&#8221; ol_text_shadow_horizontal_length_tablet=&#8221;0px&#8221; ol_text_shadow_vertical_length_tablet=&#8221;0px&#8221; ol_text_shadow_blur_strength_tablet=&#8221;1px&#8221; quote_text_shadow_horizontal_length_tablet=&#8221;0px&#8221; quote_text_shadow_vertical_length_tablet=&#8221;0px&#8221; quote_text_shadow_blur_strength_tablet=&#8221;1px&#8221; header_text_shadow_horizontal_length_tablet=&#8221;0px&#8221; header_text_shadow_vertical_length_tablet=&#8221;0px&#8221; header_text_shadow_blur_strength_tablet=&#8221;1px&#8221; header_2_text_shadow_horizontal_length_tablet=&#8221;0px&#8221; header_2_text_shadow_vertical_length_tablet=&#8221;0px&#8221; header_2_text_shadow_blur_strength_tablet=&#8221;1px&#8221; header_3_text_shadow_horizontal_length_tablet=&#8221;0px&#8221; header_3_text_shadow_vertical_length_tablet=&#8221;0px&#8221; header_3_text_shadow_blur_strength_tablet=&#8221;1px&#8221; header_4_text_shadow_horizontal_length_tablet=&#8221;0px&#8221; header_4_text_shadow_vertical_length_tablet=&#8221;0px&#8221; header_4_text_shadow_blur_strength_tablet=&#8221;1px&#8221; header_5_text_shadow_horizontal_length_tablet=&#8221;0px&#8221; header_5_text_shadow_vertical_length_tablet=&#8221;0px&#8221; header_5_text_shadow_blur_strength_tablet=&#8221;1px&#8221; header_6_text_shadow_horizontal_length_tablet=&#8221;0px&#8221; header_6_text_shadow_vertical_length_tablet=&#8221;0px&#8221; header_6_text_shadow_blur_strength_tablet=&#8221;1px&#8221; box_shadow_horizontal_tablet=&#8221;0px&#8221; box_shadow_vertical_tablet=&#8221;0px&#8221; box_shadow_blur_tablet=&#8221;40px&#8221; box_shadow_spread_tablet=&#8221;0px&#8221;]<\/p>\n<h1>Semicontractive dynamic programming videos and slides<\/h1>\n<p>Video from a Oct. 2017 Lecture at UConn on\u00a0<a href=\"https:\/\/www.youtube.com\/watch?v=bnSimLYmWfc\">Optimal control, abstract, and semicontractive dynamic programming<\/a>.\u00a0<a href=\"http:\/\/web.mit.edu\/dimitrib\/www\/Stable_Opt_Control.pdf\">Related paper<\/a>, and set of\u00a0<a href=\"http:\/\/web.mit.edu\/dimitrib\/www\/AbstractDP_UConn.pdf\">Lecture Slides<\/a>.<\/p>\n<p>Video from a May 2017 Lecture at MIT on the solutions of Bellman&#8217;s equation,\u00a0<a href=\"https:\/\/www.youtube.com\/watch?v=G-jJGDTZe6g\">Stable optimal control, and semicontractive dynamic programming<\/a>.\u00a0<a href=\"http:\/\/web.mit.edu\/dimitrib\/www\/Stable_Opt_Control.pdf\">Related paper<\/a>, and set of\u00a0<a href=\"http:\/\/www.mit.edu\/~dimitrib\/Stable_Opt_Control_Slides.pdf\">Lecture Slides.<\/a><\/p>\n<p>Videos from a 5-lecture series on Semicontractive Dynamic Programming, a type of methodology, introduced in the research monograph\u00a0<a href=\"http:\/\/web.mit.edu\/dimitrib\/www\/abstractdp_MIT.html\">Abstract Dynamic Programming.<\/a><\/p>\n<p>The monograph aims at a unified and economical development of the core theory and algorithms of total cost sequential decision problems. Semicontractive DP refers qualitatively to a collection of models where some policies have a regularity\/contraction-like property but others do not. They are exemplified by models involving a termination state, such as shortest path-type problems, both deterministic and stochastic.<\/p>\n<p>The lectures focus on research, which is described in\u00a0<a href=\"http:\/\/web.mit.edu\/dimitrib\/www\/abstractdp_MIT.html\">recent papers and an on-line 2nd edition<\/a>\u00a0of the monograph. The lectures are as follows:<\/p>\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li>Video lecture 1:\u00a0<a href=\"https:\/\/www.youtube.com\/watch?v=E7nOlmUmwNI\">Introduction and Semicontractive Examples<\/a>. Set of\u00a0<a href=\"http:\/\/www.mit.edu\/~dimitrib\/Semicontractive_Lecture1.pdf\">Lecture Slides.<\/a><\/li>\n<li>Video lecture 2:\u00a0<a href=\"https:\/\/youtu.be\/jce5Y64-vrY\">Semicontractive Analysis for Stochastic Optimal Control<\/a>. Set of\u00a0<a href=\"http:\/\/www.mit.edu\/~dimitrib\/Semicontractive_Lecture2.pdf\">Lecture Slides.<\/a><\/li>\n<li>Video lecture 3:\u00a0<a href=\"https:\/\/www.youtube.com\/watch?v=U4oYOf02lFM\">Extensions to Abstract DP Models<\/a>. Set of\u00a0<a href=\"http:\/\/www.mit.edu\/~dimitrib\/Semicontractive_Lecture3.pdf\">Lecture Slides.<\/a><\/li>\n<li>Video lecture 4:\u00a0<a href=\"https:\/\/www.youtube.com\/watch?v=P6dEE93R2os\">Applications to Stochastic Shortest Path and Other Problems<\/a>. Set of\u00a0<a href=\"http:\/\/www.mit.edu\/~dimitrib\/Semicontractive_Lecture4.pdf\">Lecture Slides.<\/a><\/li>\n<li>Video lecture 5:\u00a0<a href=\"https:\/\/www.youtube.com\/watch?v=S9aLu1NY9Ho\">Algorithms<\/a>. Set of\u00a0<a href=\"http:\/\/www.mit.edu\/~dimitrib\/Semicontractive_Lecture5.pdf\">Lecture Slides.<\/a><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p>[\/et_pb_text][\/et_pb_column][\/et_pb_row][\/et_pb_section]<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Semicontractive dynamic programming videos and slides Video from a Oct. 2017 Lecture at UConn on\u00a0Optimal control, abstract, and semicontractive dynamic programming.\u00a0Related paper, and set of\u00a0Lecture Slides. Video from a May 2017 Lecture at MIT on the solutions of Bellman&#8217;s equation,\u00a0Stable optimal control, and semicontractive dynamic programming.\u00a0Related paper, and set of\u00a0Lecture Slides. Videos from a 5-lecture<\/p>\n","protected":false},"author":2,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_et_pb_use_builder":"on","_et_pb_old_content":"","_et_gb_content_width":"","footnotes":""},"class_list":["post-18113","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/faculty.engineering.asu.edu\/bertsekas\/wp-json\/wp\/v2\/pages\/18113","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/faculty.engineering.asu.edu\/bertsekas\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/faculty.engineering.asu.edu\/bertsekas\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/faculty.engineering.asu.edu\/bertsekas\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/faculty.engineering.asu.edu\/bertsekas\/wp-json\/wp\/v2\/comments?post=18113"}],"version-history":[{"count":0,"href":"https:\/\/faculty.engineering.asu.edu\/bertsekas\/wp-json\/wp\/v2\/pages\/18113\/revisions"}],"wp:attachment":[{"href":"https:\/\/faculty.engineering.asu.edu\/bertsekas\/wp-json\/wp\/v2\/media?parent=18113"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}