Tied embed, RoPE, SwiGLU, GQA
4 days agoShareSave。业内人士推荐Line官方版本下载作为进阶阅读
上周，Meta超级智能实验室的马特维洛索（Mat Velloso）在短暂任职后离职。而此前，Meta长期担任首席AI科学家的杨立昆（Yann LeCun）也告别了管理一线。业界对此议论纷纷：难道扎克伯格真的给不起钱了吗？，更多细节参见safew官方版本下载
在印度 Express Adda 的论坛上，Sam Altman 聊了很多 AI 话题，从 AGI 到中美 AI 竞争，再到数据中心用水问题。但最火的那段，是他回应 AI 能耗批评时说的：「人们总谈训练 AI 模型需要多少能源……但训练人类也需要大量能源，得花 20 年时间，消耗那么多食物，才能变聪明。」
There's no drastic divide between this trio. Like the "Father" family, they've drifted apart, seemingly content to have lives of their own. But in this household, their proximity practically itches. Lilith looks for ways to razz her sister, sparking a juvenile sibling rivalry that forces Tim into flushed retreat. But these intrusions and escapes are all in the gentle way of making nice. The tragedy of these moments is in how we can see their urge to connect and their fear to, all in a furtive glance, a choked laugh, or a licked bit of pastry.