On infrastructure
- AI's bottleneck is a power plant
Microsoft signed a 20-year deal to restart a reactor at Three Mile Island to power its data centers. The constraint on AI is moving from chips to electricity, and baseload nuclear is suddenly back.
2 min reads likes comments - The embedding table is the model
Facebook open-sourced DLRM, its deep learning recommendation model. It shows what big recommenders actually look like: mostly memory, with a small network on top.
2 min reads likes comments - Google built its own chip for neural nets
The Tensor Processing Unit has been running in Google's data centers for a year. When a company designs custom silicon for a workload, the workload is here to stay.
2 min reads likes comments