LLaMa

tags :

Summary #

LLaMA (Large Language Model Meta AI) is a family of large language models (LLM), released by Meta AI starting in February 2023.

• For the first version of LLaMa, four model sizes were trained: 7, 13, 33 and 65 billion parameters. LLaMA’s developers reported that the 13B parameter model's performance on most NLP benchmarks exceeded that of the much larger GPT-3 (with 175B parameters) and that the largest model was competitive with state of the art models such as PaLM and Chinchilla.
  • Whereas the most powerful LLMs have generally been accessible only through limited API (if at all), Meta released LLaMA’s model weights to the research community under a noncommercial license. Within a week of LLaMA’s release, its weights were leaked to the public on 4chan via BitTorrent.

wikipedia

Paper published

https://ai.facebook.com/blog/large-language-model-llama-meta-ai/