• 5 Posts
  • 37 Comments
Joined 3 years ago
cake
Cake day: June 11th, 2023

help-circle




  • NPU? Is that a marketing term for underpowered GPUs or something? I would not use a laptop for any substantial GPU usage if I could help it. Use the laptop as a laptop and a server with GPUs for heavier / noisier workload if possible. I run ollama on a desktop at home and have them connected my devices through tailscale virtual network. laptop stays silent with “long” battery life while desktop takes the load remotely. I think this workflow can be used for more than just ollama, but kind of depends. VPS might be an option too.







  • I didn’t want to commit more than a cheap flash drive. However I tried what you said since I had a m.2 enclousure laying around. I did all of this through virt-manager by passing the external device through. The installer complained when I passed the device as a usb device. I solved it by just passing device path of the external drive to the vm and the installer didn’t know any better.

    I don’t see any other reason why this would not work for any usb device. usb flash drives as well. I might try this at some point.