#NewsBytesExplainer: GPT-3, the powerful AI that generates stories, poems, code

Generative pre-training transformer or GPT is an AI-based language model that uses a generative adversarial network (GAN) framework, involving a set of neural networks competing against each other, to produce text from a given excerpt.

The model was announced in 2018 and upgraded to GPT-2 a year later. That system was more sophisticated at predicting words and writing full paragraphs of content.

GPT-2 was so quick and effective at generating texts that the team at OpenAI was worried that it may be used to spread fake news and hoaxes.

So, instead of releasing the full code of the AI model, they launched a watered-down version of the algorithm to the public, allowing it to create self-rewriting text games, among other things.

Now, building on the work done, OpenAI has released GPT-3 to select users through an API.

The new model beats its predecessor and is the most powerful language model ever built.

You just input text, and it uses it to capture a certain pattern and write an entire article or poem, depending on how the API is configured, in the same way.

In the few days since GPT-3's release, a number of samples of text generated by the AI model have started circulating on the internet.

If appropriately configured by a human, the model can generate some really good stuff, starting from creative fiction and handy business memos to a working JavaScript code and even news stories.

GPT-3 achieves these mind-blowing results using the trove of data fed into it.

The algorithm has been trained effectively on all of the text available on the internet or some 500 billion words (GPT-2 was trained on 40 billion).

Through this ginormous dataset, it identifies certain linguistic patterns humans cannot see and uses them to predict what should be added to a given text.

Once it generates an output for a given text, it can combine both the generated and original content and treat it as input to produce the next batch of text.

This way, based on all published content, it can continue and generate long articles, poems, or news stories, complete with punctuation as well as the context.

While GPT-3 makes for a powerful text generator, it comes with certain caveats one should know about.

First, it must be noted that the text generator uses fed data patterns to generate a word-by-word output, but it does not have its own understanding of the text given in or given out.

It cannot grasp the meaning of input and reason like humans.

Along with reasoning, the AI language model can also struggle with the problem of coherence.

Specifically, unlike humans who can continue to write with the same narrative and tone, GPT-3 can go off-track.

It generates words and phrases using the surrounding input and, therefore, might fail to maintain a consistent narrative or meaning in long passages. The sentences can even contradict each other.

Despite the downsides, a text generation tool of this kind can be used for various applications by entrepreneurs and developers.

It can lead us to a future where text generation is automated in most, if not all, of the cases. But, do not worry (about your job) just yet, as the ability to create original and truly meaningful text appears to be far away.