does this only work with llamaCPP ? I.e. can't use GPU models with this? | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

seydor on May 22, 2023 | parent | context | favorite | on: PrivateGPT

does this only work with llamaCPP ? I.e. can't use GPU models with this?

joebiden2 on May 22, 2023 [–]

llama supports GPU by now: https://old.reddit.com/r/LocalLLaMA/comments/13gok03/llamacp...

seydor on May 22, 2023 | [–]

How do i enable GPU in privateGPT w llamaCpp ? It turns my CPU to a vacuum cleaner

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact