On Sat, Aug 08, 2026 at 06:50:27AM -0500, Lucas Nussbaum wrote:

> 2/ There are inference services that cost as little as $10 per month for
> a reasonable volume of usage of Open Weight models (OpenCode Go is an
> example).

If you download OpenCode, the company Opencode Zen will provide free
access to a number of free (as in beer) LLM models[1], including "Big
Pickle", which is believed to be a stealth open weight frontier model.
Many people believe that as of this writing (it changes from time to
time), it is a variant of GLM-5.2 with 753b parameters and an 1M
context window.

[1] https://opencode.school/lessons/models/

The LLM access is rate limited, but I've never run into those limits,
myself.  And "Big Pickle" is quite impressively good and can be used
for a number of useful tasks.

It's likely that queries sent to Big Pickle are being used for
training purposes, so I wouldn't recommend using it to analyze
propreitary code that you are trying to keep private.  But if you are
trying to fix bugs or review patch submissions for open source code,
it's all public information anyway.

Cheers,

                                                - Ted

P.S.  As far as the concern about the electricity and water usage, I will
point folks at the estimates of how much electricity and water might
be used to watch a movie on Netflix or Hulu or Disney+.  Or to make a
pair of jeans, for that matter.  Or the amount of CO2 generated when
someone flies to a DebConf.  Should we worry about ecological
sustainability?  Sure!  But I sometimes think that this is more of an
excuse to justify a position that someone has already has made for
other reasons.

Reply via email to