TLDR:
- Salesforce debuts XGen 7B, a new language learning model boasting an extended sequence length up to 8K, outdoing previous models' 2K limit.
- Unlike other models, XGen 7B can be freely used for commercial purposes, thanks to its Apache 2.0 license.
Introduction:
Salesforce, a company renowned for its robust AI models and open-source contributions, recently launched XGen 7B, an advanced language learning model. XGen 7B takes a leap from the conventional sequence length of 2K, extending it to an impressive 8K. This shift is expected to bring significant improvements in text summarization, prediction of protein sequences, and more.