Sand simulation

I think being able to step back from a bad decision is mutually exclusive with being a CEO of a huge company

2 Likes

Best places to watch this wreck play out, and discover alternative inference providers/approaches?

Was hoping to wrap-up and share https://control.makergalaxy.com, but that’s on hold now.

This is why I’ve been spending more and more time on my ā€˜in house’ AI stack. It will never be a full Claude replacement, but I’ve found I can do quite a bit with it.

I don’t have a lot of money to throw at it, so it’s just a single linux server with a single 5060ti 16G card on it (for now). I’m using opencode (which is where I’ve been spending a lot of time making changes). The idea is to allow opencode to use claude api credits for initial planning and ā€˜harder’ tasks, then push the smaller grunt agents to my local AI. Right now, I’m even having all the harder tasks ran on it using one of the newer MoE models. It’s working OK. It’s just slower. Which is fine for my personal work.

ā€œwork workā€ is paying for claude enterprise. I have a personal claude plan I’ll use when the opencode gets stuck on an issue or is taking too long. I’ve only hit my limits a few times on my $20 plan using this setup.

2 Likes