{"id":416241,"date":"2020-05-03T18:01:49","date_gmt":"2020-05-03T16:01:49","guid":{"rendered":"https:\/\/www.thomann.de\/blog\/?p=416241"},"modified":"2020-05-03T18:22:40","modified_gmt":"2020-05-03T16:22:40","slug":"ar-piano-a-new-learning-phenomenon","status":"publish","type":"post","link":"https:\/\/www.thomann.de\/blog\/en\/inspire\/ar-piano-a-new-learning-phenomenon\/","title":{"rendered":"AR Piano – A New Learning Phenomenon"},"content":{"rendered":"

Definitely worth seeing: A tweet from Fayez Salka – physician, software company and 3D artist – shows how he uses AR (augmented reality) technology to bring a virtual pianist to life on a real piano. Back to the future, it gets more and more wacky. But take a look for yourself:<\/strong><\/p>\n

\ufe0f?<\/p>\n

\n

Augment Reality for musicians – really impressive<\/h3>\n

In the video, the resourceful Salka<\/strong> strolls through a piano shop<\/strong>. He points his mobile phone camera<\/strong> at various pianos. Immediately an AR pianist appears<\/strong> on the screen and starts playing various songs<\/strong> by award-winning pianists. In real time<\/strong>, the notes<\/strong> scroll over the bottom of the screen.<\/p>\n

\n
\n
<\/div>\n
\n
\n

You are currently viewing a placeholder content from X<\/strong>. To access the actual content, click the button below. Please note that doing so will share data with third-party providers.<\/p>\n

More Information<\/a> <\/div>\n

Unblock content<\/a> Accept required service and unblock content<\/a> <\/div>\n<\/p><\/div>\n<\/p><\/div>\n<\/div>\n

 <\/p>\n

Precise key recognition even without 3D depth camera<\/h3>\n

The app<\/strong> recognises the piano<\/strong> including the notes of its keyboard. It determines the three-dimensional position<\/strong> and orientation<\/strong> of the piano in a 3D space<\/strong>. This is done with a precision of up to 1 centimetre<\/strong>. This is carried out merely by looking at each individual frame, 3D depth cameras are not needed.<\/p>\n

This precise positioning is important so that the virtual pianist can be aligned and visually superimposed<\/strong> at the exact place on the piano. The interesting thing about this is that, due to the self-learning algorithm<\/strong>, this works with any piano model<\/strong> of any brand<\/strong>. Even the lighting conditions are irrelevant. It is not necessary to set special image points or image markers. Also, the piano does not have to be scanned beforehand. Unbelievable!<\/p>\n

 <\/p>\n

Now published on App Store<\/h3>\n

The app<\/strong> is now available on the iOS app store<\/strong><\/a>. Fayez Salka and his business partner Anas Wattar<\/strong> of Montr\u00e9al-based Massive Technologies Inc.<\/strong><\/a> have eliminated the final bugs<\/strong> of the virtual wonder and made it available for others online. There is most probably some creative brainstorming to be done, for which purposes the app could be used. The future<\/strong> is exciting!<\/p>\n

\"\"<\/a>
from www.massivetechnologies.ca<\/figcaption><\/figure>\n
<\/div>\n

Re-experience piano music on smartphones & mobile devices<\/h3>\n

\"\"<\/p>\n

In its current state, the creative lateral thinker sees the app as an excellent tool for experiencing piano music on the smartphone<\/strong> in a completely new way<\/strong>. This is truly something special, a completely new approach with previously unimaginable scenarios for learning<\/strong> to play an instrument. In further development, the app could cover many more areas in music and a variety of instruments<\/strong>.<\/p>\n

\"\"<\/a>
A screenshot of “Drum Machina” from massivetechnologies.ca<\/figcaption><\/figure>\n

<\/h3>\n

A new development step in music’s AI sector<\/h3>\n

To put it bluntly: A\u00a0new step in AI (artificial intelligence)<\/strong>\u00a0development<\/strong> is being implemented here. Whereas music not made by hand<\/strong> was previously limited to the use of playback<\/strong>, sequences<\/strong> and the like, the former concept is now being completely turned upside down: You simply point your smartphone at a piano and the whole process takes place.<\/p>\n

Learning from “virtual people”<\/h3>\n

You will be played what you would like to learn in an absolutely direct and visually comprehensible way<\/strong>. However, it is not the “artificial” piano that plays, but a virtual person<\/strong>. So you can establish a personal relationship with your smartphone. Finally, an AR app that has massive potential for ambitious young musicians.<\/p>\n

What could this technology possibly lead to?<\/h3>\n

Let’s not fool ourselves, after all, despite all its comprehensive functionality, this app is also just the beginning. It is conceivable that this is not just a fascinating optical gimmick, but rather a didactic step<\/strong> into the future world of music for almost all instruments<\/strong>. It’s a funny thought that you could have your music teacher<\/strong> permanently in your pocket<\/strong> in the near future. A small request by simple keystroke or voice command; s\/he will play the next lesson for you. As many times as you want, and with consistent<\/strong> perfection<\/strong>, until you have understood everything.<\/p>\n

<\/h3>\n

Lots of ideas still in the oven<\/h3>\n

For Salka the project started as a hobby<\/strong>. Meanwhile the cooperation with Massive Technologies has become his main job<\/strong>. And it is already clear that there is still a lot to come. Fayez reports that some ideas are still cooking in the oven, we are curious and will follow the developments with great pleasure. To illustrate the potential: An older app from Massive Technologies is called Piano 3D<\/strong><\/a>. A product with over 7 million downloads, and counting…<\/p>\n

\n
\n
<\/div>\n
\n
<\/div>\n
\n

You are currently viewing a placeholder content from YouTube<\/strong>. To access the actual content, click the button below. Please note that doing so will share data with third-party providers.<\/p>\n

More Information<\/a> <\/div>\n

Unblock this content<\/a> Accept required service and unblock its content<\/a> <\/div>\n<\/p><\/div>\n<\/p><\/div>\n<\/div>\n
\n

Below are links to all of Massive Technologies<\/strong>‘ apps so far:<\/p>\n

\"\"<\/a><\/p>\n

\"\"<\/a> \"\"<\/a><\/p>\n

Advertisements<\/div>
\"\"<\/a><\/div><\/div>","protected":false},"excerpt":{"rendered":"

Augmented Reality for piano players and piano enthusiasts? It’s here! Read this article to learn more…<\/p>\n","protected":false},"author":30,"featured_media":431811,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"tblog_post_audio_url":"","footnotes":""},"categories":[10676],"tags":[4875,9151,11909,11911,11919,11921,4962,11917,3443,7056,11915,4859,11913],"class_list":["post-416241","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-inspire","tag-tech-en","tag-app","tag-ar","tag-augmented-reality","tag-device","tag-mobile-en","tag-perform","tag-phone","tag-piano-en","tag-playing","tag-smartphone","tag-technology","tag-virtual-reality"],"category_colors":{"color_key":"inspire","css_classes":{"text":"cat-inspire","text_light":"cat-inspire-light","bg":"cat-bg-inspire","bg_light":"cat-bg-inspire-light","border":"cat-border-inspire","text_on_bg":"cat-text-on-inspire"}},"reading_time":{"minutes":4,"formatted":"4 min"},"_links":{"self":[{"href":"https:\/\/www.thomann.de\/blog\/en\/wp-json\/wp\/v2\/posts\/416241","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.thomann.de\/blog\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.thomann.de\/blog\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.thomann.de\/blog\/en\/wp-json\/wp\/v2\/users\/30"}],"replies":[{"embeddable":true,"href":"https:\/\/www.thomann.de\/blog\/en\/wp-json\/wp\/v2\/comments?post=416241"}],"version-history":[{"count":0,"href":"https:\/\/www.thomann.de\/blog\/en\/wp-json\/wp\/v2\/posts\/416241\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.thomann.de\/blog\/en\/wp-json\/wp\/v2\/media\/431811"}],"wp:attachment":[{"href":"https:\/\/www.thomann.de\/blog\/en\/wp-json\/wp\/v2\/media?parent=416241"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.thomann.de\/blog\/en\/wp-json\/wp\/v2\/categories?post=416241"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.thomann.de\/blog\/en\/wp-json\/wp\/v2\/tags?post=416241"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}