The phrase “open source” is doing work here it was never designed to do. When people call a model like Llama, Mistral or Qwen open source, they usually mean the weights are published: the trained file that makes the model work can be downloaded by anyone. It rarely means the training data and the full recipe are public. Open weights is the more accurate term.
That distinction has commercial teeth, because the licenses attached vary. Some are genuinely permissive. Others restrict commercial use, add conditions once a company passes a certain size, or forbid using the output to train a rival model. If someone tells you a model is free, read the license for that release first.
Paying a monthly fee to the vendor behind GPT, Claude or Gemini buys hosting, updates, safety filtering, support and, above all, somebody else's responsibility for keeping the thing running. You never size a server, patch an operating system, or get called at 7am because a service died overnight.
The trade is real. What you type goes to a company outside your building, under terms you should actually read for whether business-tier data gets used in training. And the model can change underneath you. A vendor retires the version your prompts were tuned around, and a workflow that ran cleanly for months starts behaving differently.
An open-weight model can be downloaded and run on a machine you control: a capable workstation in the back office, or a server you rent by the month. Nothing you type travels to a third party. For some businesses that is the whole argument, and it is a good one.
The cost shape changes too. Instead of paying per use, you pay for hardware or rental, and that figure stays flat whether you run ten jobs a day or ten thousand. Steady high volume favors that. Occasional bursts do not, because an idle machine bills the same as a busy one. Prices move often, so check current figures.
Then there is the part nobody puts in the sales deck: security patching, model updates, backups, monitoring and access control. That is not a reason to avoid self-hosting. It is a line item, and the line item is usually a person.
The choice is not only between a big vendor's subscription and a box in your storage closet. Several hosting companies serve open-weight models per use, on infrastructure they maintain. You get competitive pricing and the ability to switch hosts or bring the work in-house later without rebuilding everything, because these models are more interchangeable than proprietary ones.
What that path does not give you is privacy. Your data still travels to somebody else's servers under somebody else's terms. If data control was your reason for looking at open weights, this option does not solve it.
For the overwhelming majority of local businesses, a dental practice, a contractor, a six-person law firm, the closed subscription is the right answer and it is not a close call. The models are stronger, support exists, and the monthly cost is smaller than the hours you would spend maintaining an alternative. If nobody in your building enjoys managing servers, that settles it.
Four conditions flip it: regulated client information you have promised not to send outside, volume steady enough that fixed hardware beats metered billing, a real requirement that data never leave the premises, or a technical person on staff who wants to own it. If none of those fit, buy the subscription and spend your attention on customers, which is how we scope this work locally.
Plenty of small agencies now advertise some version of we self-host, so your data is private. That is only true if the person saying it maintains the machine: patching it, monitoring logins, keeping backups. A forgotten server humming in a back office on default settings is a worse privacy story than a major vendor's business tier. Ask who administers it and what happens if that person leaves.
Not automatically. Downloading the weights is usually free, but the license governs commercial use and some add conditions for larger companies. Running the model still costs real money in hardware or rented server time. Read the license for the exact version you plan to use rather than trusting a blanket claim.
Only at consistently high volume. Self-hosting turns a per-use bill into a fixed hardware and maintenance cost, cheaper when the machine stays busy and more expensive when it sits idle. For a small business sending a few hundred requests a week, a subscription almost always wins.
Only if you run it yourself on hardware you control and maintain properly. Using an open-weight model through a hosting company still sends data off site, and a neglected server in your own office can be less secure than a major vendor with a dedicated security team. Safety comes from the setup, not the license.
Start with a paid business tier from an established closed vendor. It works immediately, someone supports it, and it costs less than the time alternatives demand. Revisit in a year, once you know your real volume and whether any data genuinely cannot leave the building. Switching later is not hard.
Want this handled for you?
Get a free audit of your website, Google reviews, and local SEO — we’ll show you exactly where you’re losing customers. Delivered in 24 hours, no sales call.
Get my free audit → or book a 15-min callWe help local businesses in Stamford, Greenwich, Norwalk, and Fairfield County implement AI marketing that generates real results.
Get Your Free AI Marketing Audit →