Elon Musk's AI Company xAI Releases Grok-1 Model Weights and Architecture

According to PANews, Elon Musk's artificial intelligence company xAI has announced the release of the weights and architecture of its 314-billion-parameter hybrid expert model, Grok-1. The large language model was trained from scratch by xAI using a hybrid expert model architecture, with 25% of the weights active on a given token. The base model weights and network architecture are now available under the Apache 2.0 license. Grok-1's pre-training phase was completed in October 2023, and the currently released version is the original base model checkpoint, not fine-tuned for any specific application. Users interested in utilizing the model can follow the guidelines provided on github.com/xai-org/grok.