Back to Blog

Introducing J1-Grande!

,
,
,
May 31, 2024
No items found.

AI21 Studio releases Grande, a high-quality, affordable language model at the convenient size of 17B parameters.

During the past few weeks, we've been quietly test-driving Grande with AI21 Studio users. The feedback was incredible. In fact, while Grande is significantly closer in size to J1-Large (7.5B parameters), a great majority of users have found that J1-Grande’s quality is comparable to that of J1-Jumbo (178B parameters). This is great news for all budget-conscious practitioners; J1-Grande, our mid-size model, offers access to supreme quality text generation at a more affordable rate. 

Check it out: we asked each of the Jurassic-1 models to generate a humorous poem about a friendship between a dog and a cat:

You’ll find that while each of the three models composed comical (though quite meaningful) poems, Grande and Jumbo exhibit a far more sophisticated level of writing. Try it out for yourself in the AI21 Studio playground.

With a response time twice as fast as Jumbo, at one-third the cost of Jumbo, Grande delivers an excellent combination of price, quality and speed to even the most seemingly complex use-cases. To learn more about subscription plans, visit the pricing page.

Benchmarks

Distilling the quality of a language model into a single metric is notoriously difficult. Nevertheless, we find it helpful to compare the performance of different models on standard NLP tasks. Below we examine the accuracy of J1-Large, J1-Grande and J1-Jumbo on a diverse selection of tasks, including common knowledge question answering, reading comprehension and common sense.  

None of the models were trained specifically for the tasks presented. We compared the models in two distinct circumstances: 

  1. Few-shot: demonstrating with a few examples of ideal outputs for it to mimic (as seen here)
  2. Zero-shot: void of any guidance whatsoever (as seen here).
Data indicates the average accuracy of the broad range of tasks assigned to the Jurassic-1 models in experiments of both Zero-shot and Few-shot.Zero-shot trials included ARC-Challenge, ARC-Easy, BoolQ, HellaSwag, PIQA, RACE-high, RACE-middle, RTE, StoryCloze, and Winogrande. Few-shot trails included ARC-Challenge, ARC-Easy, OpenBookQA, BoolQ, RTE, StoryCloze and Winogrande. All tasks were posed in a multiple-choice format. See Jurassic-1 white paper for more details.
The perplexity (PPL) of Jurassic-1 models is illustrated by average log-probabilities per byte, where a higher number is a more impressive figure. The Zero-shot and Few-shot findings correspond to the same circumstances and data in the bar graph above.

Learn more at https://www.ai21.com/studio or try it yourself in the playground.

Related Blogs