You’re writing a novel with an AI assistant, and a thought nags at you: where is my manuscript going? When you type a scene into ChatGPT or Claude, your words travel to company servers, get processed, and come back as a response. You’re trusting someone else with your unpublished work. For some authors, that’s fine. For others, it’s like handing your diary to a stranger and hoping they don’t peek.
Models with downloadable weights can run on your own hardware. A local setup can keep manuscript processing on your computer, but privacy also depends on the application: cloud models, synchronization, telemetry, and connected tools can still transmit data.
But “open source” in AI doesn’t always mean what you’d expect, and the fight over this term reveals a lot about where the technology is heading.
A Term with Decades of Baggage
“Open source” meant something specific long before AI models existed. The concept traces back to 1983, when Richard Stallman, a programmer at MIT, launched the GNU Project after he couldn’t modify the software on a printer in his lab. His philosophy was radical: software should be free to use, study, modify, and share. He founded the Free Software Foundation and created the legal framework that would make this vision possible.
In 1991, a Finnish student named Linus Torvalds used Stallman’s tools to build the Linux kernel, which now runs most of the internet’s servers. The label “open source” was coined in 1998 by Christine Peterson as a more business-friendly rebrand of Stallman’s “free software.” (Stallman still rejects the new name. He’s nothing if not consistent.)
For decades, the principle was straightforward: you release the source code under a license that lets anyone use and modify it. Then AI models arrived, and the definition started to stretch.
What Gets Released (and What Doesn’t)
A large language model isn’t just code. It has distinct components: the architecture (the neural network blueprint), the weights (billions of learned numerical values where the “intelligence” actually lives), the training code (the scripts used to build the model), and the training data (the text the model learned from).
The Open Source Initiative’s AI Definition 1.0 requires model parameters, training and inference code, and sufficiently detailed information about the training data under appropriate terms. It does not require every raw training item to be redistributed. Releasing weights alone does not satisfy the definition.
Meta releases Llama under its own version-specific licenses. The Open Source Initiative distinguishes those terms from open-source licensing. Check the license for the exact model version, including commercial thresholds and use restrictions.
“Open weights” describes access to model parameters without promising all the freedoms and supporting materials of open-source AI. For example, BLOOM’s RAIL license contains use restrictions; it should not be described as an unrestricted permissive license.
A Short, Dramatic History
The timeline of open AI models is compressed and, at one pivotal moment, involves 4chan.
In August 2022, Stability AI released Stable Diffusion, an image generation model anyone could download and run on their own hardware. It was a proof of concept: powerful generative AI didn’t have to live behind an API.
Then came February 2023. Meta released LLaMA for academic research, with access limited to approved applicants. That lasted about a week. Someone uploaded the model weights to 4chan, and within days they’d spread across the internet. The leak was unauthorized, but spectacularly consequential. It sparked an explosion of community projects (Stanford’s Alpaca, Vicuna, dozens of others) that might never have existed otherwise.
Meta read the room. By July 2023, the company officially released LLaMA 2 with a broadly permissive license, followed by LLaMA 3 in 2024 and LLaMA 4 in 2025. Mistral AI, founded in Paris by former Meta and Google researchers, built its identity around competitive open-weight models. Google released Gemma. China’s DeepSeek lab made waves with models rivaling the best closed offerings. In three years, the gap between what you can access freely and what sits behind a paywall shrank dramatically.
Why This Matters for Your Writing Life
Open-source models aren’t just a tech industry debate. They show up in the writing tools you use every day.
Privacy you can actually verify. When you run a model on your own computer, your writing stays private in the most literal sense. Not “we promise we won’t look” private. Physically, mathematically, your-words-never-leave-your-machine private. For authors working on unpublished manuscripts or sensitive material, this is a meaningful difference.
Tools that connect to open models. NovelAI’s text model, Erato, is built on Meta’s Llama 3, fine-tuned on storytelling data. NovelCrafter lets you connect directly to models running on your own machine through tools like Ollama or LM Studio. KoboldCpp is an open-source application built specifically for creative writing with local models. These are real writing tools that thousands of authors use daily.
Fine-tuning is available through several routes. Downloadable models can be adapted on suitable hardware or through a hosting service. Some proprietary models also support hosted fine-tuning. Supplying examples in a prompt or uploading reference documents is different from changing model weights, and none of these methods guarantees an exact imitation of your prose.
Cost drops significantly. Closed models charge per use, typically by the token. Open models, once downloaded, cost nothing to run beyond electricity. Running a smaller model on a modern laptop with 16 GB of RAM is entirely feasible. No monthly fees, no usage caps.
The tradeoff is honest. The most capable models (GPT-4, Claude, Gemini) are still closed. Open models have gotten remarkably good, but the absolute cutting edge remains behind the paywall for now. Running models locally also requires some technical comfort, though tools like LM Studio have made it as simple as downloading an app and clicking a button. For many writing tasks, an open model on your own hardware is already more than good enough.
Understanding this landscape helps you make informed choices about which AI tools deserve your trust, your money, and your manuscripts. Do you want to rent access to someone else’s AI, or do you want to own the tool outright? Both are valid answers. The important thing is knowing you have the choice.