It is explained in the first 2 minutes. That's not too much to ask for imo.
Background:
An architecture that uses something called "shared memory" makes that the normal system RAM and the GPU VRAM are the same.
This has the effect that prosumer machines, which have always had a lot of ram, have now a lot of vram available too. This has the happy accident that you can surprisingly large ai models on these computers.
What's new:
Now (MacOS 26.2) Macs can enable RDMA over Thunderbolt 5. This makes the data transfer between multiple of these computers (cluster) much faster. With software such as e.g. https://github.com/exo-explore/exo making this a ridiculous setup.
It is explained in the first 2 minutes. That's not too much to ask for imo.
Background:
An architecture that uses something called "shared memory" makes that the normal system RAM and the GPU VRAM are the same.
This has the effect that prosumer machines, which have always had a lot of ram, have now a lot of vram available too. This has the happy accident that you can surprisingly large ai models on these computers.
What's new:
Now (MacOS 26.2) Macs can enable RDMA over Thunderbolt 5. This makes the data transfer between multiple of these computers (cluster) much faster. With software such as e.g. https://github.com/exo-explore/exo making this a ridiculous setup.