Stability AI releases LLMs

Stability AI debuted StableLM , its collection of open-source language models for generating text and code.

The developer of Stable Diffusion, a popular text-to-image model, said it plans to release more advancedlanguage models and AI tools in the future.

  • StableLM was launched today as a chatbot demo on the open-source AI platform Hugging Face.
  • The "fine-tuned" chat model was built on a custom enhanced version of Pile, the open-source dataset featuring tokens of data from Wikipedia, Stack Exchange, and PubMed.
  • It currently features two versions, one that's 3 billion parameters and another that's 7 billion.
  • Parameters are a rough indication of a model's sophistication. Stability plans to release 15-billion- and 65-billion-parameter models later.
  • The company noted that the StableLM is in early "alpha" on Hugging Face as well as GitHub , where developers can go to use and alter the model.

A report from March said Stability was in talks with investors to raise additional funding at a $4B valuation.

  • Shortly after, CEO Emad Mostaque expressed a desire to take the company public in the future and dismissed the idea that it that it would ever be acquired.
  • Stability was last valued at $1B in a $101M seed funding in October 2022. 



Post a Comment

Previous Next

Contact Form