I build the exact same system, but for (mandarin, simplified) Chinese which i'm learning. Wanted to create such a system for a while, but it's a lot of hooking up the correct libs and making a UI etc. never found the energy. Thanks to 'ai' I was able to do this finally, think more people needed this push :-) It's web-based and can be self-hosted in a docker.

Nice! Yeah I think the functionality is never very complicated, I'm more so interested the UX and trying to add features that reduce friction and slowly build an app that can be stable and relied upon.

Care to share with a fellow learner? :)

i published it to github today, its still very alpha but it does the job https://github.com/enimatek-nl/shuoshuo

Link please?

I also "evolved" into 27b (q8 unsloth) and pi.dev (tried many combinations) feels for me the same as opus 4.5 that i use at work, faster even (using 2x 3080 20GB gives me 60-80tk/s). Though you do need to feed it more details up front (about what exactly you are planning to do and a good written skill.md) but I work that way anyways, im hyped for 3.8

I own a dedicated 48vCPU with even 160GB RAM.. its not that expensive, check ebay, maybe now with mem prices it will be a bit more steep but as a hobby it's not crazy to think one owns such a piece of hardware. My dual GPU setup was more expensive I think.

I bought two RTX3080s with 20GB during my holiday in china (set me back 700euros) I'm getting 800-1000 input tps and 60-100tps output with Qwen 3.6 27b Q8 (MTP, P2P, 200k context) this feels like opus4.5 level while coding (pi harness). Also easy to just host your own openai compatible api from home this way and still use your MacBook as dev station.

Graphene is NOT a jailbroken/rooted OS, its a real secure unrooted, bootloader locked OS, and MS Authenticotor works just fine. If anything does not work its related to dependency of the App maker on a certain attestation google play services grapheneos.org/articles/attestation-compatibility-guide

Root =/= insecure. You probably have administrator access on your home computer operating system, and can very likely do online banking via the web browser with no issues. A secure API is possible regardless of the host metal, operating system, or user permissions.

Do you refer to app-accessible root or user root access? The former is absolutely inherently insecure and compromises the security model of Android/GOS.

Root on computers is insecure. Malware can steal secrets from other applications. We're just used to it, but the Android security model is much better.

Bingo!

Compliance =!= Security

This does not play a role - even if you lock your bootloader Play Integrity Checks still fails, and that means you can't use certain apps, MDM and overall restricts your usage. Thank Google for that.

I bought two 3080/20gb and one of those MACHINIST X99 mainboards as well (one with two full x16 pcie slots) those boards come with a xeon cpu included (for the pcie lane support) it set me back 800 euros total (had a spare psu, ssd and mem in a drawer) and now im also happily running 80tk/s Qwen 3.6 Q8 (MTP).

Good call, I really hesitated between the X570 and the X99, are you using P2P?

$ nvidia-smi topo -p2p r

GPU0 GPU1

GPU0 X CNS

GPU1 CNS X

i guess not, i use llama.cpp with:

--spec-draft-n-max 3 --spec-type draft-mtp --split-mode tensor --tensor-split 1,1

and my (gen) tk/s are between 60-80 tk/s

will test this uncensored model and ngram added as well this weekend

btw, i also set my powerlimit to 220watt per card (with nvidia-smi) that will cost you around 1 tk/s but safe you a LOT of power and heat :)

CNS means Chipset not supported and I doubt it is the case, are you sure you are using the patched nvidia module? modinfo nvidia to check which one is loaded

I'm using bazzite on my ai-rig just because it has the gpu-optimized things setup (also nvidia-open). Looking at P2P seems to be available only for 90-versions of the nvidia rtx gpu line, not 80, and some versions of 50xx? (apparently the 5080?). Anyways, i downloaded that uncensored model and tweaked those kv settings etc. still getting 60-80tk/s but im able to get my context on 180224 now, used to be 131072 which gave me some trouble, this is already a win :)

Ok, i went through the P2P rabbithole, and incase anyone reads this, just use Fedora Rawhide, and run that repo install.sh mentioned in the blog post :) Now i have:

  GPU0 GPU1

 GPU0 X OK

 GPU1 OK X

l'm curious if Bartosz will actually contact him for that final casting, i know i would definitely love to own one. And mainly because I love mechanical watches, especially what's inside, but I don't like to wear or really use them, this is a great solution for this "problem".

How does bitwarden’s backend being build in a gc language matter? There is also an api compatible project in rust called Vaultwarden if gc matters. Is 1password and lastpass’s backend better in that regard? would be nice if he could elaborate on that point.

I had the same question.

I think it’s that he also complains about LastPass storing things in memory, so perhaps the GC thing just makes it more difficult to analyze what it’s doing in memory? In a non-GC language you’d be able to see explicitly what is going in and out of memory, but with GC the runtime is doing that for you.

> In a non-GC language you’d be able to see explicitly what is going in and out of memory, but with GC the runtime is doing that for you.

I hear you about the GC's calls to free, but if one is concerned about leaking key material, there's an existing pattern for that, no GC nonsense required: use a (byte|char) array and then zero it after use: https://docs.oracle.com/en/java/javase/11/docs/api/java.base...

It runs the same risk as does any general purpose computing in that your process can crash or some attacker can be on the machine sniffing all the things, but it's certainly better than `password = new String("hunter22") // good luck`

I also grant you that managing the key material must be disciplined across the whole lifecycle of that material, so `char[] password = readString().toCharArray()` doesn't help

And to add to this, i learned to not use the 'bluetooth' icon to manage the AirPods, instead use the 'triangle with broadcast signal'-icon found next to the volume in the control centre or on many other different locations on your ipad, iphone or apple tv.

Just turn off the auto-connect feature and start using that icon, all the mentioned 'annoyances' will go away :)

> triangle with broadcast signal

The AirPlay icon.

https://developer.apple.com/design/human-interface-guideline...

Ah wow! This is so obvious to use AirPlay to manage them. Thank you! Will see how this goes.

- Frontend: Angular 7+

- Backend: NodeJS with Hapi and Mongoose / Mongodb

- Auth module in Hapi (JWT)

- All in Typescript and VSCode

These libraries have been stable for a while now. Tried GraphQL / Apollo for a while but the amount of breaking updates made me go back to the stack mentioned above. Currently i'm exploring dotnet core (in C#) and blazor.