Question
We're a 12-person team shipping an AI feature this quarter. Open-weight models or a proprietary API?
Decision memo
4 sourcesOpen-weight or proprietary: a build decision for small teams
For most small teams shipping this quarter, start on a proprietary API and keep an open-weight path open. The trade-offs that actually move the decision are below.
Time to first value
A hosted API puts a working model behind your feature in a day; standing up open weights adds infrastructure, autoscaling, and an on-call rotation before you serve a single request.1
For a team of twelve with a quarter-long deadline, that gap is the whole story: the fastest path to learning from real users wins, and self-hosting spends the first weeks on plumbing rather than the product.4
Cost at your scale
Control and lock-in
Recommendation
Start on a proprietary API and design for portability: keep prompts and evals model-agnostic, put the provider behind one interface, and revisit when steady volume crosses the cost line.2
woven in 1.84s · 4 sources · 412 tokens