AI21 Labs trains a massive language model to rival OpenAI’s GPT-3

guest · Aug 11, 2021

Watch out, GPT-3, here comes AI21's 'Jurassic' language model
August 11, 2021
https://www.zdnet.com/article/watch-out-gpt-3-here-comes-ai21s-jurassic-language-model/

What's bigger than a 175-billion-parameter natural language processing program?

A 178-billion-parameter program, of course. Such is just one of the attributes of Jurassic, a computer program introduced Wednesday by Tel Aviv-based artificial intelligence startup AI21 Labs.
Click to expand...

GPT-3, of course, is the language program from the San Francisco-based startup OpenAI that rocked the world in 2020 by generating sentences and whole articles that seemed quite human-like. GPT-3 also shocked the world by being kept inside a fairly restrictive beta testing arrangement by OpenAI.

AI21 is promising to go OpenAI not one better, but two better, with what it claims are superior benchmark results on a test known as "few shot learning," and a more open program for beta testers.
Click to expand...

While the test results will probably be scrutinized many different ways as people kick the tires, the larger objective of AI21 seems to be to have built a more-accessible GPT-3 on the other side of the OpenAI wall, to take advantage, as a business, of the desire for many users to gain access to the capability.
Click to expand...

AI21 Labs Makes Language AI Applications Accessible to Broader Audience

AI21 Labs, an AI company specializing in Natural Language Processing (NLP), has released Jurassic-1 Jumbo, the world's largest and most sophisticated language model, to anyone interested in prototyping custom text-based AI applications.

Jurassic-1™ is being released inside AI21 Studio™ as an open beta, meaning anyone can sign up and quickly experiment with new and exciting language-based applications. Should developers then wish to go live with their applications and serve production-scale traffic, they can apply for access to custom models on a commercial basis. Unlike OpenAI's GPT-3, this approach is open to everyone.
Click to expand...

guest · Aug 11, 2021

AI21 Labs trains a massive language model to rival OpenAI’s GPT-3
August 11, 2021
https://venturebeat.com/2021/08/11/ai21-labs-trains-a-massive-language-model-to-rival-openais-gpt-3/

For the better part of a year, OpenAI’s GPT-3 has remained among the largest AI language models ever created, if not the largest of its kind.
But an AI lab based in Tel Aviv, Israel — AI21 Labs — says it’s planning to release a larger model and make it available via a service, with the idea being to challenge OpenAI’s dominance in the “natural language processing-as-a-service” field.

AI21 Labs claims that Jurassic-1 can recognize 250,000 lexical items including expressions, words, and phrases, making it bigger than most existing models including GPT-3, which has a 50,000-item vocabulary.

“AI21 Labs was founded to fundamentally change and improve the way people read and write. Pushing the frontier of language-based AI requires more than just pattern recognition of the sort offered by current deep language models,” CEO Shoham told VentureBeat via email.
Click to expand...

The way forward
The coauthors of the OpenAI and Stanford paper suggest ways to address the negative consequences of large language models, such as enacting laws that require companies to acknowledge when text is generated by AI — possibly along the lines of California’s bot law.

AI21 Labs hasn’t committed to these principles, but Shoham stresses that the Jurassic-1 models are only the first in a line of language models that it’s working on, to be followed by more sophisticated variants.

“We take misuse extremely seriously and have put measures in place to limit the potential harms that have plagued others,” Shoham said.
Click to expand...

AI21 Labs, which emerged from stealth in October 2019, has raised $34.5 million in venture capital to date from investors including Pitango and TPY Capital. The company has around 40 employees currently, and it plans to hire more in the months ahead.
Click to expand...

Log in or Sign up

AI21 Labs trains a massive language model to rival OpenAI’s GPT-3

guest Guest

guest Guest

Log in or Sign up

AI21 Labs trains a massive language model to rival OpenAI’s GPT-3

guest Guest

guest Guest

Useful Searches