Claude models were blocked from logging into my own VM with my own credentials I gave it using ssh that I also gave it by its guard rails. I wouldn't doubt other models are nerfed but...you should provide some context around your comment

That's a highly weird law. Someone let the cat outside or feeds/keeps it there thus should accept the way cats are as their responsibility.

It’s more that society accepts that cats are part of it, and considers that people should adapt to cat behavior patterns rather than we not having any free roaming cats.

It’s a deliberate choice to treat pets the same as non pets.

No Ethernet, so no POE. I'm not seeing a price, or even a kickstart reward, so this doesnt exist?

In this context its not a switch - its a Keyboard / Video / Mouse - but over IP - remote control of a PC (including boot and bios)

Yeah its a really poor decision - the things chonky, put two USB-C on there.

AMD Pro CPUs generally come with their own version of this - Realtek BCM

45 security apps cut the ram and CPU performance in half out of the gate, then you have Win11 with its web gui and users who complain about any slowness so i7 or r7 is about the norm most places / bulk big 3 oems make for business.

and rowhammer etc mitigations microcode updates

personally I have an i7 in the lab that turned into a crawl on Youtube because they started sending VP9 video by default, but i7 doesn't have hardware decode for it. Got a plugin to force h264 (h264ify) and it's back to normal.

Then you have situations where a software update adds a CPU instruction dependency and straight up doesn't work anymore.

Had to install and force-retain an old version of Spotify client on a bench lab PC because the new versions require AVX-1/2. It's a streaming audio player...

> because the new versions require AVX-1/2

Well, an 128kbit MP3 requires at least a 486DX2-66 but you also need to run the OS. /s

I've worked at a bunch of orgs and no one is bothering to look at ram size changes they just note what it's at when they get a call.

Run a local model that is uncensored and it won't say no to pretty much anything

What local model would even come close? Kind of feels like you're not using/used SOTA models if they're realistic alternatives to the same kind of tasks. Qwen-3.8-27B-Abliterated-by-MaxxedWeightsGuy82 or similar isn't gonna cut it, almost certainly.

Any recommendations?

GLM 5.3 is probably the best open weight model for cybersecurity/exploit development right now. Though it is still significantly behind the proprietary ones and you probably need your own datacenter to run it effectively. Same goes for the full Qwen 3.8 model. You can try the smaller versions, but even more capability will get left on the table that way.

I run an abliterated distillation of Qwen 3.8 27B, slightly quantized to fit on my 4090, and I've been evaluating it to use as a worker bee for research directed by a smarter model.

Much like in the article, abliterated Qwen will not obey restrictions on its behavior encoded in the prompt. If you want something not to happen, it better be enforced in the harness or environment (e.g. sandbox). It is much different than the Anthropic models I'm used to, which will, the vast majority of time, follow rules (before auto mode, I used to always run them in "yolo" mode).

I am curious whether there's a connection between abliteration and rule following. These abliterated models are the ones you most want to follow your rules.

Language models have always had an issue with negatives.

A negative like do “not” xyz is just not encoded the same as spelling out what you want vs what you don’t want.

Harder to write though.

I would say in this case abliteration is the likely culprit. To uncensor a model this way, you literally deactivate the parts that would enact refusals. As in things it was told not to do. But the real process is more like brain surgery performed by a alchemist according to an ancient religious book where noone involved really understands what is actually happening in the model.

Exactly, I wrote a blog post in what feels like a long time ago on this topic.

https://vexjoy.com/posts/positive-framing-agents-skills/

Interesting read, thanks for re-sharing!

I noticed your joy-check link 404's now... I tried poking around your /skills/ folder but didn't find it easily. Should you still have that available I'd love to check it out.

edit: Found it if others are looking: https://github.com/notque/vexjoy-agent/blob/main/skills/code...

Oh, thanks for letting me know. I need to fix that.

Efficiently at scale or even as an individual?

You'll need tons of tokens for these to churn through heavy reasoning and feedback driven tasks. You might even want to run many agents in parallel. Combine that with GPU memory requirements in the terabyte range just to hold the weights and you've pretty much left local consumer setups entirely.

Note that Mac Studio Ultra M3 (or upcoming M5) with 512GB is effective. You don't have to do this work fast, overnight is fine.

Unless trying to use it interactively and adversarially, in which case it's not fast enough plus would be why those of us without our own datacenters will get told we can't have nice things.

Qwen3.8

This month I reduced my spend on cloud AI and started using local models as primary - it's maybe 2 or 4 times slower for some things but it still is getting the job done just fine. I talked to a friend of mine who's been doing the same running smaller Qwen models locally for coding.