{"id":825,"date":"2020-08-18T12:47:20","date_gmt":"2020-08-18T03:47:20","guid":{"rendered":"http:\/\/54.178.151.130\/?p=825"},"modified":"2020-10-18T18:49:11","modified_gmt":"2020-10-18T09:49:11","slug":"azure-kinect%e3%81%a7%e9%aa%a8%e6%a0%bc%e3%82%92%e6%a4%9c%e5%87%ba%e3%81%97%e3%81%a6%e4%bf%9d%e5%ad%98%e3%81%99%e3%82%8b%e3%80%90azure-kinect-%e5%ae%9f%e8%b7%b5%e8%ac%9b%e5%ba%a72%e3%80%91","status":"publish","type":"post","link":"https:\/\/sho-d-blog.com\/en\/tech\/825\/","title":{"rendered":"Detect and save skeleton with Azure Kinect\u3010Azure Kinect Practical course#2\u3011"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\">Introduction<\/h2>\n\n\n\n<p>This article describes how to detect the skeleton with Azure Kinect and how to save the skeleton position with csv format.<\/p>\n\n\n\n<p>Please check here to check the specifications required for the environment and PC to run Azure Kinect.<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-rich is-provider-wp-oembed-blog-card\"><div class=\"wp-block-embed__wrapper\">\nhttp:\/\/54.178.151.130\/en\/tech\/820\/\n<\/div><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">Body Tracking SDK<\/h2>\n\n\n\n<p>In order to detect the skeleton, the Body Tracking SDK must be installed on the PC.<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-rich is-provider-wp-oembed-blog-card\"><div class=\"wp-block-embed__wrapper\">\nhttps:\/\/docs.microsoft.com\/azure\/kinect-dk\/body-sdk-download\n<\/div><\/figure>\n\n\n\n<p>Download the latest version from the &#8220;<strong>msi<\/strong>&#8221; link and install it. If you can start the Body Tracking Viewer by typing &#8220;body&#8221; from the windows start button, the installation is complete.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large is-resized\"><img decoding=\"async\" loading=\"lazy\" src=\"http:\/\/54.178.151.130\/wp-content\/uploads\/2020\/08\/image.png\" alt=\"\" class=\"wp-image-690\" width=\"623\" height=\"513\" srcset=\"https:\/\/sho-d-blog.com\/wp-content\/uploads\/2020\/08\/image.png 831w, https:\/\/sho-d-blog.com\/wp-content\/uploads\/2020\/08\/image-300x247.png 300w, https:\/\/sho-d-blog.com\/wp-content\/uploads\/2020\/08\/image-768x632.png 768w\" sizes=\"(max-width: 623px) 100vw, 623px\" \/><\/figure>\n\n\n\n<p>When you actually start it and detect a person, the skeleton part is colored as follows.<\/p>\n\n\n\n<figure class=\"wp-block-embed-youtube wp-block-embed is-type-video is-provider-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<div class=\"c-responsive-container-16-9\"><iframe loading=\"lazy\" title=\"\u3010Body Tracking\u3011Ascending and descending the stairs captured by Azure Kinect\" width=\"1220\" height=\"686\" src=\"https:\/\/www.youtube.com\/embed\/uqeyXXASS9I?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe><\/div>\n<\/div><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">Has the skeleton detection accuracy improved?<\/h2>\n\n\n\n<p>Skeleton detection was also possible with the conventional Kinect v2. Azure Kinect has <strong>further improved<\/strong> skeleton detection accuracy. Specifically, v2 uses only the difference in depth information around pixels as a feature, but Azure Kinect detects it on a deep learning basis, making it strong against disturbances due to environmental factors such as when holding an object. Furthermore, <strong>the front and back of the body can be identified<\/strong>.<\/p>\n\n\n\n<p>From the comparison video below, you can see that the front and back of the body are properly recognized. Something like a low-pass filter is built in in the initial state, and noise at the estimated part of the skeleton is also suppressed.<\/p>\n\n\n\n<figure class=\"wp-block-embed-youtube wp-block-embed is-type-video is-provider-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<div class=\"c-responsive-container-16-9\"><iframe loading=\"lazy\" title=\"UpDownTest(Azure Kinect vs Kinect v2 )\" width=\"1220\" height=\"686\" src=\"https:\/\/www.youtube.com\/embed\/WF9kdnyBhkc?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe><\/div>\n<\/div><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">How to save skeletal position<\/h2>\n\n\n\n<p>You can preview the skeleton position but not save it just by installing the SDK. If you install the following tools, you can save the 3D skeleton position in csv format and use it when analyzing data.<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-rich is-provider-wp-oembed-blog-card\"><div class=\"wp-block-embed__wrapper\">\nhttps:\/\/github.com\/shoda888\/AKRecorder\n<\/div><\/figure>\n\n\n\n<figure class=\"wp-block-embed-youtube wp-block-embed is-type-video is-provider-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<div class=\"c-responsive-container-16-9\"><iframe loading=\"lazy\" title=\"Azure Kinect Recorder\" width=\"1220\" height=\"686\" src=\"https:\/\/www.youtube.com\/embed\/yrhxCEUvvkY?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe><\/div>\n<\/div><\/figure>\n\n\n\n<p>AKRecorder starts recording the <strong>skeleton coordinate value<\/strong> (csv) and <strong>the color image<\/strong> (png) from the Depth camera viewpoint when the person appears, and finishes the recording when the person leaves. The recorded file is saved for each directory with the date and the time stamp at the start of recording, and supports up to 6 people.<\/p>\n\n\n\n<p>AKRecorder can be executed by opening Csharp_3d_viewer.sln in Visual Studio and building it. In PosSaver.csv in advance, specify the path to save the data (line 33). If you get an error at build time, most of the dependent packages are missing, so install them as appropriate. If you want to visualize the skeleton position during recording, comment out the part related to GUI drawing in the same code.<\/p>\n\n\n\n<script src=\"https:\/\/gist.github.com\/shoda888\/04c1c2ee15c4c61f2e916688c99cbc51.js\"><\/script>\n\n\n\n<h2 class=\"wp-block-heading\">Conclusion<\/h2>\n\n\n\n<p>Described how to detect the skeleton and save the skeleton coordinate values \u200b\u200busing the Azure Kinect Body Tracking SDK and AK Recorder.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Introduction This article describes how to detect the skeleton with Azure Kinect and how to save the skeleton position with csv format. Please check here to check the specifications required for the environment and PC to run Azure Kinect. Body Tracking SDK In order to detect the skeleton, the Body Tracking SDK must be installed [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":684,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"_locale":"en_US","_original_post":"http:\/\/54.178.151.130\/?p=679"},"categories":[2],"tags":[],"aioseo_notices":[],"jetpack_featured_media_url":"https:\/\/sho-d-blog.com\/wp-content\/uploads\/2020\/08\/shot9.jpg","_links":{"self":[{"href":"https:\/\/sho-d-blog.com\/wp-json\/wp\/v2\/posts\/825"}],"collection":[{"href":"https:\/\/sho-d-blog.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sho-d-blog.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sho-d-blog.com\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/sho-d-blog.com\/wp-json\/wp\/v2\/comments?post=825"}],"version-history":[{"count":0,"href":"https:\/\/sho-d-blog.com\/wp-json\/wp\/v2\/posts\/825\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/sho-d-blog.com\/wp-json\/wp\/v2\/media\/684"}],"wp:attachment":[{"href":"https:\/\/sho-d-blog.com\/wp-json\/wp\/v2\/media?parent=825"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sho-d-blog.com\/wp-json\/wp\/v2\/categories?post=825"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sho-d-blog.com\/wp-json\/wp\/v2\/tags?post=825"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}