New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

备稿计划: AI 中的预训练 #167

Open

iugo opened this issue Dec 22, 2024 · 0 comments

Member

iugo commented Dec 22, 2024 •

edited

Loading

Ilya Sutskever 在 NeurIPS 2024 的演讲

https://www.infoq.cn/article/l4f2XWrXMFzY6yfU5jO5

神经网络
数据的重要性
Scaling Law

OpenAI 也在强调 "逻辑性". 也就是在公司内部, 其实已经知道了 "数据规模" 对于目前模型的模型来说, 已经来到了一个节点, 不再是堆砌更多数据就可以得到效果.

iugo mentioned this issue

OpenAI 的 12 天发布会 #166

Closed

iugo changed the title ~~AI 中的预训练~~ 备稿计划: AI 中的预训练

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment