Hardware

AMD Demoes Ryzen AI at Computex 2023

Taran 31 May 2023

I visited AMD’s office here in Taipei, Taiwan, during Computex 2023 to have a conversation with David McAfee, the company’s Corporate VP and General Manager of the Client Channel Business. Our conversation was far-ranging on a number of topics that I’ll write about separately, but I also had a chance to observe AMD’s Ryzen XDNA AI engine at work in a laptop demo. McAfee also discussed the steps that AMD is taking to prepare the operating system and software ecosystem for the burgeoning AI use cases that will run locally on the PC, which we’ll dive into further below.

After following the AMD-codenamed inspired hallway map, I found my way to the demo room to see AMD’s latest tech in action. 

AMD’s demo laptop was an Asus Strix Scar 17 that comes powered by AMD’s 4nm ‘Phoenix’ Ryzen 9 7940HS processor paired with Radeon 780M graphics. These 35-45W chips come with the Zen 4 architecture and RDNA 3 graphics. AMD also had an Asus ROG Zephyrus G14 running the same demo. 

The XDNA AI engine, a dedicated accelerator that resides on-die with the CPU cores, is the object of our interest. The overall goal for the XDNA AI engine is to execute lower-intensity inference workloads, like audio and video processing, at lower power than you could achieve on a CPU or GPU while delivering faster response times than online services, thus boosting performance and saving battery power.

This engine can handle up to 4 concurrent AI streams, though it can be rapidly reconfigured to handle varying amounts of streams. AMD claims this engine, a progeny of its Xilinx IP, is faster than the neural engine present on Apple’s M2 processors. The engine is plumbed directly into the chips’ memory subsystem, so it shares a pool of coherent memory with the CPU and integrated GPU. I’ve included AMD’s slides from the launch in the above album — they give an overview of how the engine works. 

First, I popped open the task manager to see if the AI engine would enumerate itself as visible cores with utilization metrics, but the XDNA AI engine doesn’t show up as a visible device. As you can see in the above album, I found the AI engine listed as the ‘AMD IPU Device’ in the device manager. However, we couldn’t observe the load or other telemetry from the cores during the tests.

Here we can see the XDNA AI engine crunching away at a facial recognition workload. To the right of the screen, We can see a measurement of the latency for each step of the workload, and while the bars are impressively low and the workload ran quickly through a series of images as the AI engine crunched through the inference workload, we don’t have any context on just how those figures compare to other types of solutions. 

Image credit: Tom’s Hardware

AMD’s demo did have a button to test its onboard AI engine against the online Azure ONNX EP service, but the demo team told us they had encountered issues with the software, so it wasn’t working. Naturally, we would expect the in-built Ryzen AI engine to have lower latency than the Azure service, and that is logically what AMD was trying to demonstrate here. Unfortunately, we were left without a substantiative comparison point for the benchmark results. 

However, the benchmark does show that AI is alive and breathing on AMD’s Ryzen 7040 processors, and the company is also well underway in bolstering the number of applications that can leverage its AI engine. 

AMD announced last week at Microsoft’s Build conference that it had created a new set of developer tools that leverage the open-source Vitis AI Execution Provider (EP), which is then upstreamed in ONNX runtime, to ease the work required to add software support for the XDNA AI engine. McAfee explained that the Vitis AI EP serves as a sort of bare metal translation layer that allows developers to run models without having to alter the base model. That simplifies integration.

AMD isn’t providing performance metrics for its AI engine yet, but McAfee noted that it’s hard to quantify the advantages of an onboard AI engine with just one performance metric, like TOPS, as the other advantages of higher power efficiency and lower latency are all parts of the multi-faceted advantages of having an AI engine. AMD will share figures in the future, though.

McAfee reiterated the company’s plans to continue to execute its XDNA AI roadmap, eventually adding the engine to other Ryzen processors in the future. However, the software ecosystem for AI on the PC is still in its early days, and AMD will continue to explore the tradeoffs versus the real-world advantages.

Much of the advantage of having an inbuilt AI engine resides in power efficiency, a must in power-constrained devices like laptops, but that might not be as meaningful in an unconstrained desktop PC that can use a more powerful dedicated GPU or CPU for inference workloads, but without the battery life concerns. I asked McAfee if those factors could impact AMD’s decision on whether or not it would bring XDNA to desktop PCs, and he responded that it will boil down to whether or not the feature delivers enough value that it would make sense to dedicate valuable die area to the engine. AMD is still evaluating the impact, particularly as Ryzen 7040 works its way into the market.

For now, AMD isn’t confirming any of its future plans, but McAfee said that while AMD is committed to the AI engine being a part of its future roadmaps, it might not come to all products. On that note, he said there could conceivably be other options for different types of chips, like desktop PCs, that leverage AMD’s chiplet strategy. Other options, like add-in cards, are also possible solutions.

One thing is for sure: We’ll continue to see the scalable integrated XDNA AI engine make an appearance in many of AMD’s products in the future. Hopefully, next time we’ll see a better demo, too. 

By Paul Alcorn for tomshardware.com

94 Replies to “AMD Demoes Ryzen AI at Computex 2023”

  1. Simply want to say your article is as amazing. The clearness on your publish is simply spectacular and i can think you are knowledgeable in this subject. Well together with your permission allow me to grasp your RSS feed to stay up to date with imminent post. Thank you one million and please continue the gratifying work.

  4. Simply want to say your article is as amazing. The clearness in your post is simply nice and i can assume you are an expert on this subject. Well with your permission allow me to grab your RSS feed to keep up to date with forthcoming post. Thanks a million and please keep up the gratifying work.

  5. You’re so cool! I don’t think I have read anything like this before. So great to find someone with a few unique thoughts on this issue. Really.. thanks for starting this up. This site is something that’s needed on the web, someone with a little originality!

  6. Do you mind if I quote a couple of your posts as long as I provide credit and sources back to your webpage? My blog site is in the very same area of interest as yours and my visitors would truly benefit from a lot of the information you present here. Please let me know if this alright with you. Many thanks!

  9. Thank you a bunch for sharing this with all people you really recognize what you are talking approximately! Bookmarked. Please also talk over with my web site =). We could have a link trade agreement among us

  10. This is a good tip especially to those new to the blogosphere. Brief but very accurate information Thank you for sharing this one. A must read article!

  14. Fantastic goods from you, man. I’ve understand your stuff previous to and you’re just too wonderful. I really like what you’ve acquired here, really like what you’re stating and the way in which you say it. You make it entertaining and you still take care of to keep it smart. I cant wait to read far more from you. This is actually a great site.

  16. I’m really enjoying the design and layout of your site. It’s a very easy on the eyes which makes it much more enjoyable for me to come here and visit more often. Did you hire out a designer to create your theme? Fantastic work!

  19. My brother suggested I might like this website. He was totally right. This post actually made my day. You cann’t imagine just how much time I had spent for this information! Thanks!

  23. I am really loving the theme/design of your web site. Do you ever run into any internet browser compatibility problems? A couple of my blog visitors have complained about my website not operating correctly in Explorer but looks great in Opera. Do you have any solutions to help fix this issue?

  28. My spouse and I stumbled over here from a different page and thought I might as well check things out. I like what I see so now i am following you. Look forward to exploring your web page again.

  29. Greetings! I know this is kinda off topic however I’d figured I’d ask. Would you be interested in exchanging links or maybe guest writing a blog article or vice-versa? My site addresses a lot of the same subjects as yours and I believe we could greatly benefit from each other. If you happen to be interested feel free to send me an e-mail. I look forward to hearing from you! Superb blog by the way!

  30. My brother suggested I might like this website. He was totally right. This post actually made my day. You cann’t imagine just how much time I had spent for this information! Thanks!

  34. I always used to read post in news papers but now as I am a user of web so from now I am using net for posts, thanks to web.

  36. Have you ever considered about including a little bit more than just your articles? I mean, what you say is valuable and all. Nevertheless think of if you added some great pictures or video clips to give your posts more, “pop”! Your content is excellent but with images and video clips, this website could certainly be one of the most beneficial in its niche. Good blog!

  37. hey there and thank you for your information I’ve definitely picked up anything new from right here. I did however expertise some technical issues using this web site, since I experienced to reload the site many times previous to I could get it to load properly. I had been wondering if your web hosting is OK? Not that I am complaining, but sluggish loading instances times will often affect your placement in google and can damage your high quality score if advertising and marketing with Adwords. Anyway I’m adding this RSS to my e-mail and can look out for a lot more of your respective fascinating content. Make sure you update this again soon.

  39. I have been surfing online more than three hours today, yet I never found any interesting article like yours. It’s pretty worth enough for me. In my opinion, if all site owners and bloggers made good content as you did, the net will be much more useful than ever before.

  40. Hi there terrific blog! Does running a blog similar to this take a massive amount work? I have very little knowledge of programming but I was hoping to start my own blog soon. Anyway, if you have any suggestions or tips for new blog owners please share. I know this is off topic but I just needed to ask. Thanks!

  43. Excellent post. I used to be checking continuously this blog and I am inspired! Very useful information particularly the ultimate part 🙂 I take care of such info a lot. I used to be seeking this particular info for a long timelong time. Thank you and good luck.

  45. When I originally commented I seem to have clicked the -Notify me when new comments are added- checkbox and now every time a comment is added I recieve four emails with the same comment. Is there a way you can remove me from that service? Many thanks!

  48. Hey There. I found your blog using msn. This is an extremely well written article. I will be sure to bookmark it and come back to read more of your useful information. Thank you for the post. I will definitely comeback.

  52. Hey I know this is off topic but I was wondering if you knew of any widgets I could add to my blog that automatically tweet my newest twitter updates. I’ve been looking for a plug-in like this for quite some time and was hoping maybe you would have some experience with something like this. Please let me know if you run into anything. I truly enjoy reading your blog and I look forward to your new updates.

  54. Hola! I’ve been following your website for a while now and finally got the bravery to go ahead and give you a shout out from Kingwood Tx! Just wanted to mention keep up the great job!

  58. Thanks for one’s marvelous posting! I actually enjoyed reading it, you could be a great author.I will be sure to bookmark your blog and definitely will come back sometime soon. I want to encourage you to continue your great job, have a nice weekend!

  62. First off I want to say fantastic blog! I had a quick question in which I’d like to ask if you don’t mind. I was curious to know how you center yourself and clear your mind before writing. I have had a hard time clearing my mind in getting my thoughts out. I do enjoy writing but it just seems like the first 10 to 15 minutes are usually wasted just trying to figure out how to begin. Any ideas or tips? Cheers!

  66. Woah! I’m really enjoying the template/theme of this website. It’s simple, yet effective. A lot of times it’s very difficult to get that “perfect balance” between user friendliness and visual appeal. I must say you have done a amazing job with this. In addition, the blog loads very fast for me on Safari. Outstanding Blog!

  77. We are a group of volunteers and starting a new scheme in our community. Your web site provided us with valuable information to work on. You have done an impressive job and our whole community will be grateful to you.

  78. Wow that was odd. I just wrote an really long comment but after I clicked submit my comment didn’t show up. Grrrr… well I’m not writing all that over again. Regardless, just wanted to say great blog!

  88. hey there and thank you for your information I’ve definitely picked up anything new from right here. I did however expertise some technical issues using this site, since I experienced to reload the site a lot of times previous to I could get it to load properly. I had been wondering if your web hosting is OK? Not that I am complaining, but sluggish loading instances times will often affect your placement in google and can damage your high quality score if advertising and marketing with Adwords. Anyway I’m adding this RSS to my e-mail and can look out for a lot more of your respective interesting content. Make sure you update this again soon.

  89. I will right away take hold of your rss as I can not find your email subscription link or newsletter service. Do you have any? Please permit me recognise so that I may subscribe. Thanks.

Comments are closed.