OpenAI即将推出通用型大语言模型,强调其并非为特定问题或数学领域专门训练。该模型通过增加测试时的计算资源,性能实现显著提升,展现了通用模型在扩展计算时的潜力。官方表示当前重点在于快速发布,供用户自主探索,暂未在开放问题上追求极限优化。这标志着大模型发展的一条新路径。
OpenAI is aiming for a release of their upcoming general-purpose LLM.
"We have not pushed this model to the limit on open problems. Our focus is to get it out quickly so that everyone can use it for themselves."
What makes this so impressive is that a general-purpose LLM, not specifically trained for math or this problem, appears to get dramatically better simply by using more test-time compute!
OpenAI has a run.