OpenAI makes an all-purpose API for its text-based AI capabilities

guest · Jun 12, 2020

OpenAI makes an all-purpose API for its text-based AI capabilities
June 11, 2020
https://techcrunch.com/2020/06/11/o...rpose-api-for-its-text-based-ai-capabilities/

If you’ve ever wanted to try out OpenAI’s vaunted machine learning toolset, it just got a lot easier. The company has released an API that lets developers call its AI tools in on “virtually any English language task.”

Basically, if you’ve got a task that requires understanding words in English, OpenAI wants to help automate it. The various abilities of the GPT-3 family of natural language understanding models are at the disposal of developers, at least if you can get into the private beta. (Request access here.)
What that looks like in action is a little difficult to explain, because it depends on what you want it to do.

For instance, you could rely on its ability to look through lots of text at once to answer a question about an article or find a relevant portion.

“We hope that the API will greatly lower the barrier to producing beneficial AI-powered products, resulting in tools and services that are hard to imagine today,” wrote the company in a blog post.
Click to expand...

It’s also made clear that harmful or abusive uses of the API will be immediately banned, which to the company seems safer than releasing the model into the wild.
Click to expand...

OpenAI API

We’re releasing an API for accessing new AI models developed by OpenAI. Unlike most AI systems which are designed for one use-case, the API today provides a general-purpose “text in, text out” interface, allowing users to try it on virtually any English language task.
Click to expand...

guest · Sep 6, 2020

OpenAI GPT3 Profit Margins
August 23, 2020 (Updated: September 3, 2020)
https://pakodas.substack.com/p/estimating-gpt3-api-cost

Do you know how much GPT3 API will cost?
A rough calculation tells me it can go to a maximum of 790 requests/$.

GPT3 is pretty huge(175B parameters = 700GB) and you know how costly GPU inferences can be. Even if we find a use case for it, we still need to justify the ROI. There are many blogs on the potential applications but I haven’t found anything on its pricing.
Let’s try to guess it with the fundamentals of cloud pricing. [...]
Click to expand...

Update (3rd September)
OpenAI announcement
• Explore: Free tier: 100K [BPE] tokens, Or, 3-month trial, Whichever comes first
• Create: $100/mo, 2M tokens/mo, 8 cents per additional 1k tokens
• Build: $400/mo, 10M tokens/mo, 6 cents per additional, 1k tokens
• Scale: Contact Us

[...] This means OpenAI is charging 55x the cloud cost. My estimate of cloud was based on AWS but they use Azure which is even cheaper. So they are charging like >=60x the cloud cost.
This looks very profitable.
Click to expand...

According to reports, OpenAI announced the pricing scheme for GPT-3's API usage from October.
See: https://t.co/kJu4dtOZSH
h/t @gwern @sonnylazuardi .. ~ pic.twitter.com/fDMVudwi5H
— Anmol Rana (@ref_sys) September 3, 2020
Click to expand...

Log in or Sign up

OpenAI makes an all-purpose API for its text-based AI capabilities

guest Guest

guest Guest

Log in or Sign up

OpenAI makes an all-purpose API for its text-based AI capabilities

guest Guest

guest Guest

Useful Searches