Facebook is big on both AR and VR, both for entertainment and communication purposes

It’s no secret that Facebook is big on both AR and VR, to help both entertainment and communication purposes. And new research claim that it is working on AR applications which not only modifies or replaces your face, but your entire body too.

A blog post today has the AI Camera Team showing off a bit of work clearly focused at doing full-body replacement or tracking in a VR or AR context.

The researchers report, “We recently developed a new technology that can accurately detect body poses and segment a person from their background. Our model is still in research phase at the moment, but it is only a few megabytes, and can run on smart phones in real time.”

Obviously, this form of research is far from unprecedented. Skeletal tracking systems are commonplace in many industries. And indeed this blog post is more about how this particular system and its component neural networks operate than claiming any major advances.

Which means, Facebook is clearly looking specially into keeping things efficient and easy to deploy on mobile. That says working within many hard limitations as far as sensor data, image resolution and refresh rate, processing power available, and so on. Mask R-CNN, as the technique is called, is a nice step in this direction.

We can surely expect more like this from Facebook in the future — the company is even looking for a research intern dedicated to this line of research.

Featured Image: Facebook

 

more recommended stories

Get Amazing Stories

Get great contents delivered straight to your inbox everyday, just a click away, Sign Up Now
Email address
Secure and Spam free...

Get Amazing Stories

Get great contents delivered straight to your inbox everyday, just a click away, Sign Up Now
Email address