Chelsea_SunChelsea_Sun ・ Oct. 29, 2024
TCCI’s OMNE Framework for AI Memory Claims Top Spot on GAIA Leaderboard, Outperforming Meta, Microsoft

TMTPOST -- OMNE Multiagent Framework for long-term artificial intelligence (AI) memory, developed by the Tianqiao & Chrissy Chen Institute (TCCI)’s in-house AI team, has ranked first on the GAIA (General AI Assistants) benchmark leaderboard, marking a major breakthrough in AI.  

OMNE outperformed frameworks from some of the world’s leading institutions, including Microsoft Research. This achievement builds on years of brain and memory research at TCCI, equipping agents with Long-Term Memory (LTM) capabilities, which enable the framework to engage in deeper, slower thinking and enhance the decision-making capabilities of Large Language Models (LLMs) in complex problem-solving.

This milestone is a major accomplishment for TCCI’s AI team since the institute’s founder, former Chinese tech giant Tianqiao Chen, announced the “All-In AI Strategy” last year.
TCCI

TCCI's team claims the first spot on GAIA leadership board

OMNE currently boasts an overall success rate of 40.53%, surpassing submissions from well-known institutions such as Meta, Microsoft, Hugging Face, Princeton University, the University of Hong Kong, the British AI Safety Research Institute, and Baichuan, among others. In comparison, GPT-4 equipped with plugins achieved a success rate of only 15%.

GAIA, co-launched by Meta AI, Hugging Face, and AutoGPT, is a benchmarking system designed to rigorously test AI assistants on real-world challenges. It evaluates core competencies such as Reasoning, Multi-Agent Coordination, Web Browsing, and Tool Usage. As one of the most demanding datasets for multi-agent intelligence, topping the GAIA leaderboard showcases the depth of Shanda’s AI expertise and their ability to push the boundaries of innovation.

OMNE is a multi-agent collaboration framework based on long-term memory (LTM). Each agent has the same and independent system structure and can autonomously learn and understand the complete world model, thereby independently understanding the environment. The multi-agent collaboration system based on LTM enables the AI system to adapt to individual behavior changes in real time, optimize task planning and execution, and promote personalized and efficient self-evolution.

The major breakthrough is the integration of long-term memory mechanism, which greatly reduces the search space of MCTS and improves the decision-making ability on complex problems. By introducing more efficient logical reasoning, OMNE not only improves the intelligence level of a single agent, but also significantly enhances the overall capabilities of the multi-agent system by optimizing the collaboration mechanism. This enhancement mechanism is inspired by the study of the columnar structure of the human cerebral cortex. As the basic unit of the brain’s cognitive and behavioral functions, the cortical column realizes information processing through a complex collaboration mechanism. By strengthening the collaboration between single intelligence and agents, the AI model may gradually produce the emergence of cognitive abilities, build an internal representation model, and then promote a leap in the overall intelligence of the system.

“We are incredibly proud to see OMNE top the GAIA leaderboard,” said the head of TCCI AI team. “This achievement demonstrates the vast potential of using long-term memory to drive AI self-evolution and solve real-world problems. We believe that advancing research in Long-Term Memory and AI self-evolution is crucial for the ongoing development and practical application of AI technologies.”

The Tianqiao and Chrissy Chen Institute (TCCI) was created in 2016 by Chen and his wife Chrissy Luo with a US $1 billion commitment to help advance brain science. The organization’s vision is to improve the human experience by understanding how our brains perceive, learn, and interact with the world.

TCCI created the Tianqiao and Chrissy Chen Institute for Neuroscience at Caltech in 2016 and the Tianqiao Chen Institute for Translational Research, a partnership with the Shanghai Zhou Liangfu Medical Development Foundation, Huashan Hospital and Shanghai Mental Health Center in 2017. In 2020, the Chen Institute opened the Chen Frontier Lab for Applied Neurotechnology and in 2021 the Chen Frontier Lab for AI and Mental Health opened. In early 2023, the Chen Institute launched the Chen Scholars program which supports early- to mid-career physician scientists. The Institute has a strong focus on artificial intelligence due to its ability to accelerate the pace of scientific research.

TCCI’s paper on AI Long-Term Memory, “Long Term Memory: The Foundation of AI Self-Evolution”, has been published on arXiv.

TCCI has also launched the Chen Institute and Science Prize for AI Accelerated Research at ChenInstitute.org/Prize.

 

LIKE 0
Related Posts
Humans to Play a Central Role in AI Development: Academician of the Chinese Academy of Sciences
Humans to Play a Central Role in AI Development: Academician of the Chinese Academy of Sciences
Xiaomi Monthly Delivery First Tops 20,000 Cars, Closer to Meet Annual Target This Month
Xiaomi Monthly Delivery First Tops 20,000 Cars, Closer to Meet Annual Target This Month
Chinese EV Makers BYD, Zeekr and Xpeng Further Set Delivery Record in October
Chinese EV Makers BYD, Zeekr and Xpeng Further Set Delivery Record in October
TMTPost Founder Jany Hejuan Zhao Makes the “Top Ten Women CEOs in China” List
TMTPost Founder Jany Hejuan Zhao Makes the “Top Ten Women CEOs in China” List
Meta Shares Fall 4% Despite 37% of Earnings Surge Driven by AI
Meta Shares Fall 4% Despite 37% of Earnings Surge Driven by AI
Microsoft Shares Tumble Most in Two Years on Sales Slowdown Guidance, AI-Driven Spending Balloon
Microsoft Shares Tumble Most in Two Years on Sales Slowdown Guidance, AI-Driven Spending Balloon

  • Subscribe To Our News