Do you really need an NPU now?
116,755
Published 2024-07-18
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
►►► This video ◄◄◄
Microsoft with Copilot+ PCs, Google on the Pixel, Apple with iPhone and Macs, Qualcomm with Snapdragon X, Intel and AMD, all the tech companies want you to care about the NPU, Neural Processing unit or Neural engine in their new machines to run AI workloads, neural networks, etc. But are these chips any good?
The Story Behind
This video on Nebula: nebula.tv/videos/techaltar-do-you-really-need-an-n…
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
►►► TechAltar links ◄◄◄
Social media:
mas.to/@techaltar
threads.net/techaltar
bsky.app/profile/techaltar.bsky.social
instagram.com/TechAltar
discord.gg/npKQebe
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
►►► Attributions & Sources ◄◄◄
Channel Music by Edemski: soundcloud.com/edemski
Other music by Epidemic Sound: nebula.tv/epidemic
All Comments (21)
-
The first 500 people to use my link will get a 1 month free trial of Skillshare (sponsored): skl.sh/techaltar06241
-
People: we want better battery life in laptops. Microsoft: we will use NPU to do tons of work in the background. People: disable it to get better battery life.
-
Engineer: AI Needs a ton of ram. Tim Cook: Great, let’s ship our MacBook PRO with 8Gb.
-
guess that is why Apple was saying 8G is enough in the recent past so they would have a solid up-sale later
-
I already saw laptops with NPUs but 8gb of soldered ram 😂
-
I'm sure Apple's 8GB laptops will be totally 'equivalent' to 16GB for AI use...
-
This is the best explanation of NPU so far! Other people that have talked about it are either only talking from political/emotional standpoint or from the money aspect. No one has ever discussed it in a practical application angle like you did. Great work, man!
-
We need a video explaining the clean shave, brutal betrayal 😂
-
Curious note: in the early days of NPU in phones, they were less powerful and power efficient than GPUs. Huawei, Samsung, and Qualcomm relied a lot on their GPU to do AI work. Google with Visual Core started to deviate and then with Tensor, few months after Tensor Snapdragon 8 Gen 1 was the first Qualcomm chip with a really powerful NPU.
-
I've transitioned from 'wow, that's kind of cool. Wonder what they'll come up with next?" to "Fuck off with all the AI, please," in about six months.
-
One way I could be more interested is if the NPU had a little more data types, and would be good for other DSP-style calculations, like impulse responses for audio.
-
I thought the Intel 4004 had wood paneling on it and I thought "That's so retro." Then I realized it's copper.
-
12:53 the use of the word "was" in this sentence made me giggle and rub my hands together all evil like
-
They're designed to monitor everything you say, read, and type. There's no way this ends up going badly.. It will likely only be niche manufacturers who will offer laptops without a neural engine for privacy reasons. After Microsoft's debacle with Copilot, there's no reason to think they won't be pumping this in with the usage data sent back to them.
-
Thank you sooo much for explaining this more in detail instead of just saying "neuronal network" as if everybody knows how they work.
-
Just when they faced limits with CPU and GPU suddenly out of nowhere appears new NPU thing that you definitely need in every device.
-
Thank you for giving this beardless man the chance to upload a guest video on your channel - looking forward to a video by the real Martin next time 👍
-
Whats concerns me is that at some point in the future you will have massive for profit corporations having easy access to billions of NPU's.
-
Dude i must say this is the best video that i have come across that explains the need and differences of various components (such as CPU and GPU) in simple terms.
-
NPU . Normal processing unit
