{"id":380,"date":"2020-04-11T15:45:09","date_gmt":"2020-04-11T13:45:09","guid":{"rendered":"https:\/\/www.wolter.tech\/?p=380"},"modified":"2020-04-15T00:58:22","modified_gmt":"2020-04-14T22:58:22","slug":"video-prediction-a-la-fourier","status":"publish","type":"post","link":"https:\/\/www.wolter.tech\/?p=380","title":{"rendered":"Video Prediction \u00e0 la Fourier"},"content":{"rendered":"\n<p>Video frame prediction is a very challenging problem. Many recent neural network based solution-attempts trained using a mean squared error lead to blurry predictions. My most recent paper currently under review proposes to use Phase correlation and the Fourier-Shift theorem estimate changes and transform current images into predictions. A demo is shown below. The video shows ground truth (left), shift prediction (middle) and an off the shelf GRU prediction (right). <\/p>\n\n\n\n<figure class=\"wp-block-video\"><video height=\"480\" style=\"aspect-ratio: 640 \/ 480;\" width=\"640\" controls src=\"https:\/\/www.wolter.tech\/wordpress\/wp-content\/uploads\/2019\/12\/result3.mp4\"><\/video><\/figure>\n\n\n\n<p>Source code is available on<a rel=\"noreferrer noopener\" href=\"https:\/\/github.com\/v0lta\/Fourier-Motion-Estimation-and-Segment-Transformation\" target=\"_blank\"> github<\/a> .<\/p>\n\n\n\n<p>A more detailed description is available in the <a href=\"https:\/\/www.researchgate.net\/publication\/340580619_Object-centered_Fourier_Motion_Estimation_and_Segment-Transformation_Prediction\" target=\"_blank\" rel=\"noreferrer noopener\"> paper<\/a> .<\/p>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Video frame prediction is a very challenging problem. Many recent neural network based solution-attempts trained using a mean squared error lead to blurry predictions. My most recent paper currently under review proposes to use Phase correlation and the Fourier-Shift theorem estimate changes and transform current images into predictions. A demo is shown below. The video &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/www.wolter.tech\/?p=380\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Video Prediction \u00e0 la Fourier&#8221;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[24,5],"tags":[25,12,7,16,4],"class_list":["post-380","post","type-post","status-publish","format-standard","hentry","category-all","category-research-projects","tag-frequency-domain","tag-machine-learning","tag-numerical-time-series-forecasting","tag-recurrent-networks","tag-video-prediction","entry"],"_links":{"self":[{"href":"https:\/\/www.wolter.tech\/index.php?rest_route=\/wp\/v2\/posts\/380","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.wolter.tech\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.wolter.tech\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.wolter.tech\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.wolter.tech\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=380"}],"version-history":[{"count":4,"href":"https:\/\/www.wolter.tech\/index.php?rest_route=\/wp\/v2\/posts\/380\/revisions"}],"predecessor-version":[{"id":427,"href":"https:\/\/www.wolter.tech\/index.php?rest_route=\/wp\/v2\/posts\/380\/revisions\/427"}],"wp:attachment":[{"href":"https:\/\/www.wolter.tech\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=380"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.wolter.tech\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=380"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.wolter.tech\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=380"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}