There are ultra low powered LLMs but even then you’re looking at at least 2GB, and the most typical graphics card has 8, so it’s going to be some impact at least. Their intelligence/capability scales hard with memory usage too, so for most things you might want to use it for the smallest ones likely would not be good enough.
For example there’s a Rimworld mod that adds locally generated flavor text dialogue, using such a low powered model. But it’s a really simple feature that doesn’t affect actual gameplay at all. Games where the gameplay interacts with LLM output in any way are going to have higher hardware requirements, to the point where they will need to use the graphics card more for that part and less for the actual graphics; it’s enough of a bottleneck that anyone wanting to do this will basically need to design the game around it.
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: [email protected]
No game suggestions, friend requests, surveys, or begging.
No Let’s Plays, streams, highlight reels/montages, random videos or shorts.
No off-topic posts/comments, within reason.
Use the original source, no clickbait titles, no duplicates.
(Submissions should be from the original source if possible, unless from paywalled or non-english sources.
If the title is clickbait or lacks context you may lightly edit the title.)
Basic tasks like that aren’t super resource heavy, so I don’t think it would impact hardware requirements all that much.
Training the models is the most resource intensive part.
There are ultra low powered LLMs but even then you’re looking at at least 2GB, and the most typical graphics card has 8, so it’s going to be some impact at least. Their intelligence/capability scales hard with memory usage too, so for most things you might want to use it for the smallest ones likely would not be good enough.
For example there’s a Rimworld mod that adds locally generated flavor text dialogue, using such a low powered model. But it’s a really simple feature that doesn’t affect actual gameplay at all. Games where the gameplay interacts with LLM output in any way are going to have higher hardware requirements, to the point where they will need to use the graphics card more for that part and less for the actual graphics; it’s enough of a bottleneck that anyone wanting to do this will basically need to design the game around it.