Page Loader
Summarize
xAI open sources Grok amidst Musk's advocacy for transparent AI
The release of Grok will put pressure on all other LLM providers

xAI open sources Grok amidst Musk's advocacy for transparent AI

Mar 18, 2024
11:13 am

What's the story

Elon Musk's privately held company, xAI, has made the base model weights and network architecture of its AI chatbot, Grok, available to developers and researchers on GitHub. The open-source release is a 314-billion-parameter Mixture-of-Experts model, known as Grok-1, as stated by the company's blog post. This version of the model is from a checkpoint in October last year and has not been fine-tuned for any specific application.

Release details

Grok's open-source release under Apache 2.0 license

As noted by VentureBeat, the Grok model is being released under the Apache 2.0 license, which allows for commercial use but does not include the data used to train it or connections to X for real-time data. In November 2023, xAI said that Grok was developed over a four-month period and is designed for applications such as coding generation, creative writing, and answering questions.

Advocacy for transparency

Musk's advocacy for open source AI models

Musk, the owner of xAI, has been a vocal advocate for open-sourcing AI models. After acquiring Twitter (now X), he released the code behind its algorithms and criticized companies that do not open-source their AI models. This includes OpenAI, a company he helped found but is now suing over allegations of breaching an original agreement to be open source.

Insights

Grok's initial launch and comparison with rivals

When Grok was initially launched, users needed an X subscription to access it. The chatbot was positioned as a more irreverent, up-to-date alternative to OpenAI's ChatGPT or Google's Gemini. Early testing, however, suggested that it lacked distinctive features that could help it compete against more advanced chatbots. The move to open source Grok is seen as part of Musk's ongoing advocacy for transparency in AI research, further strengthening his argument against OpenAI.