[AI Combat] Open source and commercially available 40B large language model Falcon 40B

Falcon 40B Introduction

• 官网
  https://www.tii.ae/news/uaes-technology-innovation-institute-launches-open-source-falcon-40b-large-language-model
  
  Abu Dhabi-UAE: 25 May, 2023 – The Technology Innovation Institute (TII), a leading global scientific research center and the applied research pillar of Abu Dhabi’s Advanced Technology Research Council (ATRC), today strengthened its growing international influence in the field of artificial intelligence by announcing that “Falcon 40B,” the UAE’s first large-scale AI model, is now open source for research and commercial use. This pioneering move demonstrates Abu Dhabi’s commitment to fostering collaboration across sectors and driving advancements in generative AI.

  ABU DHABI, UAE: 25th May, 2023 - The Technology Innovation Institute (TII), a world-leading scientific research center and the applied research pillar of the Abu Dhabi Advanced Technology Research Council (ATRC), today announced the UAE's first large-scale artificial intelligence model " Falcon 40B ", is now open source for research and commercial use. This pioneering move demonstrates Abu Dhabi's commitment to foster cross-sectoral collaboration to advance the development of generative artificial intelligence.

  Falcon, a foundational large language model (LLM) with 40 billion parameters, trained on one trillion tokens, grants unprecedented access to researchers and small and medium-sized enterprise (SME) innovators alike. TII is providing access to the model’s weights as a more comprehensive open-source package, with the aim of enabling access to powerful LLM capabilities, promoting transparency and accountability, and supporting innovation and research in the field.

  Falcon is a basic large language model (LLM) with 40 billion parameters, trained on a trillion tokens, providing unprecedented opportunities for researchers and SME innovators . TII provides access to the model weights as a more comprehensive open source package , with the aim of enabling access to strong LLM capabilities, promoting transparency and accountability, and supporting innovation and research in the field.

open source address

• falcon-40b
  https://huggingface.co/tiiuae/falcon-40b
  

• falcon-40b-instruct
  https://huggingface.co/tiiuae/falcon-40b-instruct
  

• falcon-7b
  https://huggingface.co/tiiuae/falcon-7b

• falcon-7b-instruct
  https://huggingface.co/tiiuae/falcon-7b-instruct

Falcon 40B review

The Falcon-40b model currently tops the Open LLM leaderboard, beating out LlaMa-30b-supercat and LlaMa-65b:

open source agreement

Falcon LLM adopts the open source Apache 2.0 license, which broadly allows "free use" based on open source principles.

However, if you want to obtain a commercial license, you have to pay. After applying to TII, the commercial fee is 10% of the annual income. [The terms of section 8.2 of the agreement: 10% of the income exceeding 1 million US dollars! Annual income does not exceed $1 million without fees! 】