AI light-field camera reads 3D facial expressions

facial expression
Credit: CC0 Public Domain

A joint research team led by Professors Ki-Hun Jeong and Doheon Lee from the KAIST Department of Bio and Brain Engineering reported the development of a technique for facial expression detection by merging near-infrared light-field camera techniques with artificial intelligence (AI) technology.

Unlike a conventional camera, the light-field camera contains micro-lens arrays in front of the image sensor, which makes the camera small enough to fit into a smart phone, while allowing it to acquire the spatial and directional information of the light with a single shot. The technique has received attention as it can reconstruct images in a variety of ways including multi-views, refocusing, and 3D image acquisition, giving rise to many potential applications.

However, the optical crosstalk between shadows caused by external light sources in the environment and the micro-lens has limited existing light-field cameras from being able to provide accurate image contrast and 3D reconstruction.

The joint research team applied a vertical-cavity surface-emitting laser (VCSEL) in the near-IR range to stabilize the accuracy of 3D image reconstruction that previously depended on environmental light. When an external light source is shone on a face at 0-, 30-, and 60-degree angles, the light field camera reduces 54% of image reconstruction errors. Additionally, by inserting a light-absorbing layer for visible and near-IR wavelengths between the micro-lens arrays, the team could minimize optical crosstalk while increasing the image contrast by 2.1 times.

Through this technique, the team could overcome the limitations of existing light-field cameras and was able to develop their NIR-based light-field camera (NIR-LFC), optimized for the 3D image reconstruction of facial expressions. Using the NIR-LFC, the team acquired high-quality 3D reconstruction images of facial expressions expressing various emotions regardless of the lighting conditions of the surrounding environment.

The facial expressions in the acquired 3D images were distinguished through machine learning with an average of 85% accuracy—a statistically significant figure compared to when 2D images were used. Furthermore, by calculating the interdependency of distance information that varies with facial expression in 3D images, the team could identify the information a light-field camera utilizes to distinguish human expressions.

Professor Ki-Hun Jeong says that “the sub-miniature light-field camera developed by the research team has the potential to become the new platform to quantitatively analyze the facial expressions and emotions of humans.” To highlight the significance of this research, he added, “it could be applied in various fields including mobile healthcare, field diagnosis, social cognition, and human-machine interactions.”

This research was published in Advanced Intelligent Systems.

More information: Sang-In Bae et al, Machine‐Learned Light‐Field Camera that Reads Facial Expression from High‐Contrast and Illumination Invariant 3D Facial Images, Advanced Intelligent Systems (2021). DOI: 10.1002/aisy.202100182
Provided by KAIST
Citation: AI light-field camera reads 3D facial expressions (2022, January 21) retrieved 21 January 2022 from https://techxplore.com/news/2022-01-ai-light-field-camera-3d-facial.html
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

Source: TechExplore

90 Replies to “AI light-field camera reads 3D facial expressions”

  1. Very nice post. I just stumbled upon your blog and wanted to say that I’ve really enjoyed browsing your blog posts. In any case I’ll be subscribing to your feed and I hope you write again soon!

  2. Remarkable things here. I’m very satisfied to see your article. Thank you so much and I’m taking a look forward to touch you. Will you please drop me a mail?

  3. My programmer is trying to persuade me to move to .net from PHP. I have always disliked the idea because of the expenses. But he’s tryiong none the less. I’ve been using Movable-type on a number of websites for about a year and am worried about switching to another platform. I have heard great things about blogengine.net. Is there a way I can transfer all my wordpress content into it? Any kind of help would be really appreciated!

  4. Hi there would you mind letting me know which hosting company you’re working with? I’ve loaded your blog in 3 completely different internet browsers and I must say this blog loads a lot quicker then most. Can you suggest a good web hosting provider at a reasonable price? Thanks a lot, I appreciate it!

  5. Hi there, I found your blog via Google at the same time as searching for a comparable matter, your web site got here up, it seems good. I have bookmarked it in my google bookmarks.

  6. I have been surfing online more than three hours these days, yet I never found any fascinating article like yours. It’s pretty worth enough for me. In my opinion, if all site owners and bloggers made good content as you did, the net might be much more useful than ever before.

  7. Woah! I’m really enjoying the template/theme of this website. It’s simple, yet effective. A lot of times it’s tough to get that “perfect balance” between user friendliness and visual appeal. I must say you have done a excellent job with this. Additionally, the blog loads extremely fast for me on Internet explorer. Outstanding Blog!

  8. Excellent post. I used to be checking continuously this blog and I am inspired! Very useful information particularly the remaining part 🙂 I deal with such info a lot. I used to be seeking this particular info for a long timelong time. Thank you and good luck.

  9. I blog frequently and I truly appreciate your content. This article has really peaked my interest. I will book mark your site and keep checking for new information about once a week. I subscribed to your RSS feed as well.

  10. Greetings I am so thrilled I found your webpage, I really found you by mistake, while I was searching on Askjeeve for something else, Regardless I am here now and would just like to say thanks a lot for a incredible post and a all round exciting blog (I also love the theme/design), I don’t have time to read through it all at the minute but I have book-marked it and also included your RSS feeds, so when I have time I will be back to read a lot more, Please do keep up the awesome job.

  11. This is very fascinating, You are an excessively professional blogger. I have joined your feed and look forward to in quest of more of your magnificent post. Also, I have shared your site in my social networks

  12. Simply wish to say your article is as surprising. The clearness on your post is simply spectacular and i can assume you are knowledgeable in this subject. Well with your permission allow me to clutch your RSS feed to stay up to date with imminent post. Thank you one million and please continue the rewarding work.

  13. I will right away grab your rss as I can not find your email subscription link or newsletter service. Do you have any? Please permit me recognize so that I may subscribe. Thanks.

  14. It is appropriate time to make a few plans for the longer term and it is time to be happy. I have read this publish and if I may just I wish to suggest you few interesting things or suggestions. Perhaps you could write next articles relating to this article. I wish to read more things approximately it!

  15. Sweet blog! I found it while surfing around on Yahoo News. Do you have any tips on how to get listed in Yahoo News? I’ve been trying for a while but I never seem to get there! Many thanks

  16. I got this web site from my friend who told me regarding this site and now this time I am visiting this site and reading very informative articles here.

  17. Greetings from Florida! I’m bored to tears at work so I decided to check out your website on my iphone during lunch break. I enjoy the info you present here and can’t wait to take a look when I get home. I’m shocked at how quick your blog loaded on my mobile .. I’m not even using WIFI, just 3G .. Anyhow, amazing site!

  18. I have been surfing online more than 3 hours today, yet I never found any interesting article like yours. It’s pretty worth enough for me. Personally, if all website owners and bloggers made good content as you did, the internet will be much more useful than ever before.

  19. Pretty portion of content. I simply stumbled upon your web site and in accession capital to claim that I acquire in fact enjoyed account your blog posts. Any way I’ll be subscribing for your augment or even I achievement you get entry to persistently rapidly.

  20. Sweet blog! I found it while surfing around on Yahoo News. Do you have any tips on how to get listed in Yahoo News? I’ve been trying for a while but I never seem to get there! Cheers

  21. I was extremely pleased to find this web site. I want to to thank you for your time just for this wonderful read!! I definitely savored every bit of it and I have you book marked to check out new things on your web site.

  22. A fascinating discussion is worth comment. I think that you should write more on this topic, it might not be a taboo subject but usually people don’t speak about such subjects. To the next! Cheers!!

  23. Your article gave me a lot of inspiration, I hope you can explain your point of view in more detail, because I have some doubts, thank you.

  24. Excellent blog! Do you have any suggestions for aspiring writers? I’m planning to start my own website soon but I’m a little lost on everything. Would you propose starting with a free platform like WordPress or go for a paid option? There are so many choices out there that I’m totally confused .. Any suggestions? Thank you!

  25. What i do not realize is in fact how you’re not really a lot more well-favored than you may be right now. You are so intelligent. You realize therefore significantly in relation to this topic, produced me personally consider it from so many numerous angles. Its like men and women don’t seem to be interested until it’s something to accomplish with Lady gaga! Your personal stuffs excellent. Always take care of it up!

  26. Hello! I’ve been following your site for a long time now and finally got the bravery to go ahead and give you a shout out from Porter Tx! Just wanted to mention keep up the great job!

  27. This is very interesting, You are a very skilled blogger. I have joined your feed and look forward to seeking more of your magnificent post. Also, I have shared your web site in my social networks!

  28. Have you ever thought about publishing an e-book or guest authoring on other sites? I have a blog centered on the same information you discuss and would really like to have you share some stories/information. I know my subscribers would value your work. If you are even remotely interested, feel free to send me an e mail.

  29. Greetings! I know this is somewhat off topic but I was wondering which blog platform are you using for this site? I’m getting fed up of WordPress because I’ve had issues with hackers and I’m looking at options for another platform. I would be awesome if you could point me in the direction of a good platform.

  30. Hello there, I believe your website could be having browser compatibility issues. When I look at your website in Safari, it looks fine but when opening in Internet Explorer, it has some overlapping issues. I just wanted to give you a quick heads up! Besides that, wonderful blog!

  31. I absolutely love your blog and find the majority of your post’s to be exactly what I’m looking for. Does one offer guest writers to write content for you personally? I wouldn’t mind producing a post or elaborating on some of the subjects you write in relation to here. Again, awesome web site!

  32. Hey there! I just wanted to ask if you ever have any problems with hackers? My last blog (wordpress) was hacked and I ended up losing many months of hard work due to no data backup. Do you have any solutions to protect against hackers?

  33. Thanks for one’s marvelous posting! I seriously enjoyed reading it, you could be a great author.I will be sure to bookmark your blog and definitely will come back someday. I want to encourage yourself to continue your great writing, have a nice weekend!

Comments are closed.