Use AR Pianist To Watch A Virtual Performance On a Real Piano

A brand new app out there for iOS and Android locations a digital pianist at your actual life piano, permitting you to observe them play a full piece from begin to end as in the event that they’re within the room with you.

Again in February, I wrote about VRTuos, an Oculus Quest app that used hand monitoring to sync up a digital piano in VR along with your actual life piano. Whereas very fundamental and nonetheless considerably buggy, it basically allowed you to study a easy piano on an actual piano utilizing VR and hand monitoring. Whereas it wasn’t excellent, I managed to show myself the Tetris theme utilizing the app and got here away fairly impressed.

Now, many months later, an AR equal has arrived — AR Pianist is an astonishing app that makes use of augmented actuality to stage a digital AR live performance on an actual life piano, and it’s fairly convincing too.

The setup course of is straightforward — as you may see within the video under, you calibrate the digital camera for AR and the press the ‘Place’ button upon getting your piano in view and all of the keys seen. Like magic, a pianist avatar will probably be sitting at your piano, and with the press of a button they may run by means of a whole piece.

Nothing is definitely occurring in actual lie — the app doesn’t connect with digital pianos and no precise taking part in is going down. It’s totally digital — the AR pianist creates the (virtually) excellent phantasm somebody is sitting at your piano and taking part in a bit for you.


You may transfer round and examine the pianist from totally different angles as they play, and even get proper up near the keys, watching from the angle of the piano stool as in case you had been taking part in the piece your self. In fact, it’s not excellent — the extra keys are out of view, the much less aligned the AR keys turn into — but it surely’s shut sufficient to not matter.

The app is free to obtain — there are some free tracks included and others which are locked behind a subscription paywall. The monitor featured within the video above, ‘Fur Elise Jam’, is a brand new monitor out there on the app, and is a collaboration with the well-known musicians and YouTube channel, The Piano Guys. The usual avatar is changed by considered one of Jon Schmidt, which is convincingly lifelike when seen up shut.

For those who don’t personal a piano in actual life, there’s additionally an choice to position a full AR piano in your area as properly. The app additionally has non-AR performance, similar to displaying songs in a synthesia-type method and utilizing your microphone to hear for the notes as you play them.

AR Pianist is accessible for iOS and Android now.

Go to our Digital Actuality Store

Go to our sponsor Video 360 Digital camera

Credit score : Supply Hyperlink