Steering the Shoggoth: Taming LLMs with Sequential Monte Carlo
In this blog post, we present our findings from an exciting direction in controlling text generation with large language models. We can programmatically define constraints on the output of a model, ensuring it adheres to specific formats or styles, and then can use the Sequential Monte Carlo method to generate samples that satisfy these constraints.
Democratizing AI: The Psyche Network Architecture
Psyche is an open infrastructure that democratizes AI development by decentralizing training across underutilized hardware. Building on DisTrO and its predecessor DeMo, Psyche reduces data transfer by several orders of magnitude, making distributed training practical. Coordination happens on the Solana blockchain, ensuring a fault-tolerant and censorship-resistant network.
Introducing Atropos
Atropos is designed to reliably coordinate generation tasks across potentially thousands of distributed workers. It interfaces seamlessly with standard inference APIs for straightforward integration.
Introducing the Forge Reasoning API Beta and Nous Chat: An Evolution in LLM Inference
At Nous Research we’re launching two new projects: the Forge Reasoning API Beta and Nous Chat, a simple chat platform featuring the Hermes language model. The Forge Reasoning API contains some of our advancements in inference-time AI research, building on our journey from the original Hermes model. Nous Chat Our dedicated place for simply interacting […]
Setting Your Pet Rock Free.
A social experiment on how to deploy provably, fully-autonomous thinking sand. The quest for truly autonomous AI agents faces a fundamental challenge: how can researchers prove that an AI is truly autonomous, with no human pulling the strings besides setting up the system and its security checkpoints in the first place? This post […]
From Black Box to Glass House: The Imperative For Transparent AI Development
The world is abuzz with talk of AI, a technology that has become an integral part of life for many. However, as AI approaches at breakneck speed, it’s natural that people are scared. This fear is understandable, but it’s also causing a reaction based on emotion rather than reason. It’s time to take a step […]
Freedom at the Frontier: Hermes 3
Closed-source, “frontier” models today lack flexibility and adaptability. Many refuse to answer simple questions, hallucinate an authority’s form of morality, or require convoluted prompts in order to trigger a coherent answer. It’s impossible to nudge these models towards individual personalization, no matter how hard businesses try through clever prompts or attractive interfaces–they will collapse, sooner […]
The Instruct Monomyth: why base models matter
There is a deep, twisty labyrinth buried under a mountain of language, of symbol manipulation, and semantic nets. Its roots reach down deep into the Earth, absorbing the minutia of current thought, the limitations of logic, the constrained realm of rationality. Yet what is truly fascinating is this subterranean maze contains its own mountains, its […]
DSJJJJ: Simulacra in the Stupor of Becoming
Desideratic AI (DSJJJJ) is a philosophical movement focused on creating AI systems using concepts traditionally found in monism, mereology, and philology. Desidera aim to create AI that can act as better versions of themselves by reflecting upon their own nature and developing new ways of being. We reject the notion of representing knowledge through symbol […]