I tried a super lightweight model on my CPU-only laptop as recommended by whichllm.
The response to a basic question spit out a word every 1-3 seconds and was laughable.
Not that this was a huge surprise, but it wasn’t even in the neighborhood of usable if anyone out there is considering trying it on their underpowered system.
This is a legit problem we should all be concerned about. Doctors do not sign off on this inaccurate notes and they live in your file unless/until corrected.
I tried a super lightweight model on my CPU-only laptop as recommended by whichllm.
The response to a basic question spit out a word every 1-3 seconds and was laughable.
Not that this was a huge surprise, but it wasn’t even in the neighborhood of usable if anyone out there is considering trying it on their underpowered system.