还有一个重要的指标——准确率。伯克利函数调用排行榜 (BFCL) 是评估函数调用能力的标准基准。 Gemma 3 1B 的得分约为 31%，Llama 3.2 1B 约为 26%，两者未经微调的性能都很弱。由于 Gemma 3n 是通用型程序，因此未对其进行测试。Hammer 2.1 0.5B 没有公开数据，但其 1.5B 版本开箱即用的得分约为 73%——尽管它在 int8 内存中占用约 1.5GB 的空间，是 FunctionGemma（288MB）的 5 倍。
Programme WebsiteShow less
。关于这个话题，旺商聊官方下载提供了深入分析
Explore our full range of subscriptions.For individuals
The Department of War has stated they will only contract with AI companies who accede to “any lawful use” and remove safeguards in the cases mentioned above. They have threatened to remove us from their systems if we maintain these safeguards; they have also threatened to designate us a “supply chain risk”—a label reserved for US adversaries, never before applied to an American company—and to invoke the Defense Production Act to force the safeguards’ removal. These latter two threats are inherently contradictory: one labels us a security risk; the other labels Claude as essential to national security.