https://techcrunch.com/2024/03/17/xai-open-sources-base-model-of-grok-but-without-any-training-code/

Elon Musk’s xAI has open-sourced the base code of Grok AI model, but without any training code. The company described it as the “314 billion parameter Mixture-of-Expert model” on GitHub.

In a blog post, xAI said that the model wasn’t tuned for any particular application such as using it for conversations. The company noted that Grok-1 was trained on a “custom” stack without specifying details. The model is licensed under Apache License 2.0, which permits commercial use cases.