The laziest and worst method is to use ChatGPT and have it “pretend to be some character” with a system prompt.
If you want something really good, you would need to train the model from scratch based only on knowledge that one particular character would learn from their world up until that point. However this is going to be a ton of work just for one character.
For a middle ground you could probably cheat a little and start with a model that’s close to the knowledge base you would want most characters to have. Then you would use something like a LoRA, or RAG on top of it for each individual character.
For instance, if you wanted to make a game in a Victorian Era setting, you could start with this model that’s only trained on text from the 1800’s:
https://github.com/haykgrigo3/TimeCapsuleLLM
To make it better you would have multiple base models that are trained on various backgrounds that NPCs could have (Farmers vs Merchants vs Soldiers vs Nobility, etc).
Even then, this would not work well for certain games. For example, if you’re trying to tell a specific story, you don’t want a character that will go off script or give away some information that spoils an intended plot twist.
I mean there might be a way, but it’s not easy.
The laziest and worst method is to use ChatGPT and have it “pretend to be some character” with a system prompt.
If you want something really good, you would need to train the model from scratch based only on knowledge that one particular character would learn from their world up until that point. However this is going to be a ton of work just for one character.
For a middle ground you could probably cheat a little and start with a model that’s close to the knowledge base you would want most characters to have. Then you would use something like a LoRA, or RAG on top of it for each individual character.
For instance, if you wanted to make a game in a Victorian Era setting, you could start with this model that’s only trained on text from the 1800’s: https://github.com/haykgrigo3/TimeCapsuleLLM
To make it better you would have multiple base models that are trained on various backgrounds that NPCs could have (Farmers vs Merchants vs Soldiers vs Nobility, etc).
Even then, this would not work well for certain games. For example, if you’re trying to tell a specific story, you don’t want a character that will go off script or give away some information that spoils an intended plot twist.