29 September 2024, Sun |
7:28 PM
The Technology Innovation Institute (TII), part of Abu Dhabi’s Advanced Technology Research Council (ATRC), has announced the release of the Falcon Mamba 7B, a groundbreaking State Space Language Model (SSLM). This new model has been independently verified by Hugging Face as the top-performing open-source SSLM globally.
Falcon Mamba 7B distinguishes itself from previous models in the Falcon series by utilizing SSLM architecture instead of the traditional transformer-based approach. This innovation offers significant advantages in memory efficiency, enabling the generation of extensive text without additional memory requirements.
According to H.E. Faisal Al Bannai, Secretary General of ATRC, “The Falcon Mamba 7B marks TII’s fourth consecutive top-ranked AI model, reinforcing Abu Dhabi’s position as a global hub for AI research and development. This achievement underscores the UAE’s unwavering commitment to innovation.”
The new model outperforms leading transformer architecture models like Meta’s Llama 3.1 8B and Mistral’s 7B across various benchmarks introduced by Hugging Face. Dr. Najwa Aaraj, Chief Executive of TII, remarked, “The Falcon Mamba 7B represents true pioneering work and paves the way for future AI innovations that will enhance human capabilities and improve lives.”
SSLMs, such as the Falcon Mamba 7B, are particularly adept at understanding complex, evolving information, which makes them highly suitable for applications in estimation, forecasting, and control tasks. Additionally, these models excel in Natural Language Processing tasks, including machine translation, text summarization, and audio processing.
Dr. Hakim Hacid, Acting Chief Researcher of TII’s AI Cross-Center Unit, commented, “As we introduce the Falcon Mamba 7B, I’m proud of the collaborative ecosystem of TII that nurtured its development. This release represents a significant stride forward, inspiring fresh perspectives and further fueling the quest for intelligent systems.”
With over 45 million downloads of Falcon LLMs, the Falcon Mamba 7B continues to demonstrate TII’s commitment to advancing AI technology. It will be released under the TII Falcon License 2.0, an Apache 2.0-based license that includes an acceptable use policy promoting the responsible use of AI. More information on the Falcon Mamba 7B can be found at [FalconLLM.TII.ae](http://FalconLLM.TII.ae).
