xAI will open source Grok this week. The move follows Elon Musk's complaint that OpenAI has deviated from its open source roots. Musk has filed a lawsuit against OpenAI claiming that OpenAI, which was supposed to make its technology freely available to the public, has become closed-source and has shifted its focus to maximizing profits for Microsoft. Musk has long been a proponent of open source - Tesla has open sourced many of its patents. It is unclear what aspects of Grok will be open sourced.

xAI has released the weights and architecture for Grok-1. Grok-1 is a Mixture-of-Experts model with 314 billion parameters. The released model is a raw base model checkpoint from the Grok-1 pretraining phase, which means that it is not fine-tuned for any specific application. It was trained from scratch by xAI using a custom training stack.

Elon Musk shared on X that Grok, xAI's language model, will be open sourced in the coming days.

xAI has released the weights and architecture of its 314 billion parameter Mixture-of-Experts model, Grok-1. It is written in JAX and uses a modern Transformer architecture with GeGLU, ROPE, sandwich Norm, and other niceties.

Elon Musk announced that xAI’s Grok chatbot, previously exclusive to Premium+ subscribers, will soon be available to all Premium subscribers on X.

xAI announced its next model, with 128k context length and improved reasoning capabilities. It excels at retrieval and programming.

Elon Musk's xAI is in talks with investors to raise $3B in a funding round that would value the artificial intelligence startup at $18B.

xAI has announced that its latest flagship model has vision capabilities on par with (and in some cases exceeding) state-of-the-art models.

Grok-1.5V or Grok 1.5 "Vision" is xAI's first-generation multimodal model. The bot will be able to respond to uploaded pictures and screenshots and reason through complex documents, science diagrams, charts, screenshots, and photographs. It will also have real-world spatial understanding to better understand the physical world depicted in the images uploaded by its users.

Elon Musk's AI company, xAI, is advancing its Grok chatbot to support multimodal inputs, allowing users to upload photos and receive text-based answers.

xAI is planning to build a supercomputer to power the next version of its Grok AI chatbot. Elon Musk says he wants to get the proposed supercomputer running by the fall of 2025. xAI could be partnering with Oracle for the project. When completed, the supercomputer will be at least four times the size of the biggest GPU clusters that exist today. Musk estimates that running the Grok 3 model and beyond will require 100,000 Nvidia H100 chips.

Silicon Valley AI firms are fighting to partner with Character.ai, a fast-growing role-playing startup founded by AI pioneer Noam Shazeer. This comes as many large firms are pouring money into smaller companies.

xAI has announced raising $6 billion in funding to help bring the startup's first products to market, build advanced infrastructure, and accelerate the research and development of future technologies. The funding comes from several sources, including Andreessen Horowitz, Sequoia Capital, and Saudi Arabian Prince Al Waleed bin Talal. Elon Musk plans to launch xAI's new data center by the fall of 2025. Musk has said he would prefer to build products outside of Tesla when it comes to AI and robotics unless he gets more control.

xAI has announced a $6 billion Series B funding round led by top investors to advance its AI systems, including the Grok-1 models with enhanced capabilities. The funding will fuel product go-to-market strategies, infrastructure, and R&D.

xAI's next model is slated for August. It reportedly took 20k H100s to train. Grok 3 is rumored for the end of the year and potentially requires 100k H100s.

xAI has ended its deal with Oracle. It will build its own datacenter after Grok 2 training finishes. The company originally contracted for 24k H100s from Oracle.

xAI has activated a supercomputer cluster comprised of 100,000 Nvidia H100 GPUs in Memphis, Tennessee. It is effectively the most powerful AI training cluster in the market today. The supercomputer is expected to be used to train Grok, the company's large language model. xAI is estimated to have spent about $3 billion to $4 billion on the project. xAI also recently announced that it is hiring to increase its human talent advantage.

xAI has released its newest model, Grok 2, a frontier class model capable of reasoning, code, and mathematics. It is collaborating with Black Forest Labs to bring FLUX to X users.

xAI has started the 100,000 Colossus H100 training cluster, the largest in the world, with plans to double it in size in a few months.

Elon Musk's xAI is building "Colossus," the world's largest supercomputer, in Memphis to support its AI chatbot, Grok. The project has faced criticism for environmental oversight issues and its substantial energy and water demands. Despite these concerns, xAI aims to rapidly advance its AI capabilities while impacting the local community.

Elon Musk recently hosted a recruiting event for his new AI startup, xAI, at the original headquarters of OpenAI in San Francisco. This gathering, which featured free food, drinks, and live music created by AI, was marked by heightened security measures, including metal detectors and ID checks. The event coincided with OpenAI's annual Dev Day, where CEO Sam Altman was discussing the company's significant funding achievements, creating a competitive atmosphere. During the event, Musk articulated his vision for xAI, emphasizing the goal of developing digital superintelligence that is as benign as possible. He invited attendees to join his mission to create useful applications from this intelligence. Musk expressed his belief that artificial general intelligence (AGI) could be achieved within a couple of years and compared the rapid growth of xAI to the SR-71 Blackbird, a high-speed reconnaissance aircraft known for its strategic advantage during the Cold War. He identified xAI, along with OpenAI, Anthropic, and Google, as the key players in the AI landscape for the next five years, aiming for xAI to achieve a level of dominance in AI similar to SpaceX's in the aerospace industry. xAI was founded in March 2023 and has quickly expanded from a small office to a larger space in Palo Alto. Musk has recruited a team from his other companies and brought in experienced researchers from leading tech firms. The startup secured $6 billion in funding, significantly boosting its valuation and resources. However, xAI's initial product, Grok, has faced challenges, relying on external technologies for core features due to the need for rapid development. Musk's competitive stance against OpenAI is fueled by a history of conflict, including his departure from the organization and subsequent legal disputes. He has expressed distrust in OpenAI's profit-driven model and aims to create a more open and accessible AI. The recruiting event attracted engineers from rival companies, highlighting Musk's ability to sell his vision and attract talent despite the fierce competition in the AI sector. Musk's approach to AI emphasizes speed and innovation, appealing to those who prefer a less conventional work environment. He believes that a "maximum, truth-seeking AI" is essential for achieving safety in AI development. The event was organized quickly, reflecting Musk's commitment to advancing xAI and his broader ambitions in the tech industry.