Elon Musk’s X to Introduce the advanced artificial intelligence Grok 1.5 by next week.
Takeaway Points
- Elon Musk, in a recent post, said that Grok 2 will be available by next week.
- Elon said the new AI is currently undergoing training and is going to outdo the current AI on all metrics.
- Grok 1.5 is capable of understanding long contexts and advanced reasoning.
- In the tests that were conducted, Grok 1.5 scored 50.6% on the math benchmark and 90% on the GSM8K benchmark.
Introducing Grok 1.5
The owner of X, Elon Musk, in a recent post he made on Friday said that the latest version of the artificial intelligence (AI) model Grok 2 will be available by next week. Elon said that the new AI is currently undergoing training and is going to outdo the current AI on all metrics.
“Should be available on 𝕏 next week. Grok 2 should exceed current AI on all metrics. In training now,” Elon said.
xAI, in a blog post on Thursday, introduced the latest model, Grok 1.5 saying that it is capable of understanding long contexts and advanced reasoning. According to xAI, in a few days, this model will be available to existing Grok users on the X platform and early testers.
Features in Grok 1.5
Grok 1.5 was improved in its performance in coding and math-related tasks. In the tests that were conducted, Grok 1.5 scored 50.6% on the math benchmark and 90% on the GSM8K benchmark. two math benchmarks covering a wide range of grade school to high school competition problems. It scored 74.1% on the HumanEval benchmark, which evaluates code generation and problem-solving abilities, according to the report.
Another feature of Grok 1.5 is the capacity to process long contexts. xAI said that this AI model has the capacity to process long contexts of up to 128K tokens within its context window. This lets the Grok memory capacity increase up to 16 times the previous context length, enabling it to use information from substantially longer documents.
xAI said, “Cutting-edge Large Language Model (LLMs) research that runs on massive GPU clusters demands robust and flexible infrastructure. Grok-1.5 is built on a custom distributed training framework based on JAX, Rust, and Kubernetes. This training stack enables our team to prototype ideas and train new architectures at scale with minimal effort. A major challenge of training LLMs on large compute clusters is maximizing reliability and uptime of the training job. Our custom training orchestrator ensures that problematic nodes are automatically detected and ejected from the training job. We also optimized checkpointing, data loading, and training job restarts to minimize downtime in the event of a failure”
According to the report, with time, Grok 1.5 will be introduced to a wider audience and have several new features too.
About Grok
Grok is a generative artificial intelligence chatbot developed by xAI based on a large language model. This was introduced on Nov 4, 2023. It was designed to answer anything and give some suggestions.
xAI said that one of the advantages of Grok is that “it has real-time knowledge of the world via the 𝕏 platform. It will also answer spicy questions that are rejected by most other AI systems.”