It seems that Valve is working on a "SteamGPT" feature that will apparently deal with Steam support issues and is somehow connected to Trust Score and CS2 anti-cheat?
I know Valve wants to remain a small-ish company, but automating in-house support has literally never improved things for the customer. It’s even worse if it’s tied into their anti-cheat - a false positive can lock you and your entire family out of multiplayer, and good luck getting a human to overturn it after the former support staff is moved to other teams.
I’d say it’s weird they didn’t focus on using this to help fix their nearly nonexistent community moderation, but I’ve been told their hands-off approach is deliberate due to a libertarian bent among the higher ups.
One thing Valve is known for is testing things. They typically make sure technology works before rolling it out everywhere.
I’m willing to bet that they have either solved most of the problems a tool like this has by massively limiting its scope, or it never actually gets past a beta test phase.
This. They have explicitly said that they are testing AI applications throughout the company and that it is not a concerted effort. It’s a few devs wanting to try it to see if it actually adds real value or not. That’s it.
There’s the directory with the file in the screenshots, service_steamgpt.proto, updated 4 days ago along with a number of others, seems like it and a whole batch of related files did not exist before then.
I am uncertain if this … basically scraping operation is tracking the main Steam client or the Beta or what.
There is not a very helpful description of what exactly is being pulled here, in the readme/project description.
EDIT:
Perhaps if you are more familiar with Protobufs, you can take a gander at these and come away with a guesstimate as to what these are doing?
My guess is that this is part of some kind of machine learning pipeline, where users label edge cases to help train the model. Since it operates on account data, match data, and logs (see CSteamGPT_GetTask_Response), an anti-cheat use case would make sense, but it’s hard to say for sure.
This looks like data exchanged between the Steam client and server, and doesn’t contain any logic on its own.
This is an incorrect assertion. Making common actions self service without needing a human is almost always a customer win. For example automatic refunds on request if your request meets the correct criteria, instead of needing a human to look at it and make an arbitrary decision. Or having a knowledge base of common issues that can help people fix problems on their own without needing to talk to a person. Both are much faster and more repeatable.
But this is not viable for every use case. If there is a major issue with my Bank account, I want to speak to person, period.
Specific actions have automated workflows is of a course a good thing.
Documentation is also good, but it often doesn’t account for edge cases or your unique situation. Not to mention, the majority of the public is not going have the desire to deal with documentation.
They improved their support ticket throughput by orders of magnitude by automating a lot of it already. There are lots of versions of automation, too, like collecting information about the user’s problem before you even get to a human.
Right, but there’s a difference between automating a refund if they can detect the purchase happened in the last two weeks and has less than two hours of playtime, versus complex support problems being handled by an LLM that can be mislead or hallucinate.
I suppose it’s fine if it’s limited to giving advice on solving the problem and has to escalate to a human if any server side action is required, but it being tied to anti-cheat has me worried that’s not the case.
Their current recommendation engine is already a marvel and the only one I’ve ever come across that actually directs me to niche stuff I might be interested in.
with the amount of information they collect on their customers, it better be damn good. honestly, the only reason it’s not a huge privacy problem is because they zealously guard that data to protect their near monopoly on PC gaming.
Gabe has been pandering to gamers and mostly giving us what we want, but when he dies, we better hope the next dude in charge isn’t some corporate suit that only cares about maximizing profits in every way that they can, or the enshitification of Steam is going to really fucking hurt. imagine if Valve was run like Microsoft. for example, the next guy might cut a deal with Microsoft to stop supporting Proton.
I can still hardly believe that the tech industry at large just decided to broadly roll out LLM integration into essentially every element of their businesses, having just no idea what they actually do.
Like 2 years ago now, I was figuratively pulling my hair out, reading the discussion panel schedule for Microsoft led conferences on LLMs and cybersecurity.
Literally every topic was a different kind of way that smashing an LLM into a complex business system… increases potential failure points, broadens attack surfaces… because networked LLMs literally are security vulnerabilities.
Not a single topic about how to use LLMs defensively, how to use them to turbocharge malware signature recognition, nothing like that.
All just a bunch of ‘make sure you don’t do this!’ warnings, and then everyone did them anyway.
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: [email protected]
Welcome to the largest gaming community on Lemmy! Discussion for all kinds of games. Video games, tabletop games, card games etc.
Rules
1. Submissions have to be related to games
Video games, tabletop, or otherwise. Posts not related to games will be deleted.
This community is focused on games, of all kinds. Any news item or discussion should be related to gaming in some way.
2. No bigotry or harassment, be civil
No bigotry, hardline stance. Try not to get too heated when entering into a discussion or debate.
We are here to talk and discuss about one of our passions, not fight or be exposed to hate. Posts or responses that are hateful will be deleted to keep the atmosphere good. If repeatedly violated, not only will the comment be deleted but a ban will be handed out as well. We judge each case individually.
3. No excessive self-promotion
Try to keep it to 10% self-promotion / 90% other stuff in your post history.
This is to prevent people from posting for the sole purpose of promoting their own website or social media account.
4. Stay on-topic; no memes, funny videos, giveaways, reposts, or low-effort posts
This community is mostly for discussion and news. Remember to search for the thing you’re submitting before posting to see if it’s already been posted.
We want to keep the quality of posts high. Therefore, memes, funny videos, low-effort posts and reposts are not allowed. We prohibit giveaways because we cannot be sure that the person holding the giveaway will actually do what they promise.
5. Mark Spoilers and NSFW
Make sure to mark your stuff or it may be removed.
No one wants to be spoiled. Therefore, always mark spoilers. Similarly mark NSFW, in case anyone is browsing in a public space or at work.
6. No linking to piracy
Don’t share it here, there are other places to find it. Discussion of piracy is fine.
We don’t want us moderators or the admins of lemmy.world to get in trouble for linking to piracy. Therefore, any link to piracy will be removed. Discussion of it is of course allowed.
I know Valve wants to remain a small-ish company, but automating in-house support has literally never improved things for the customer. It’s even worse if it’s tied into their anti-cheat - a false positive can lock you and your entire family out of multiplayer, and good luck getting a human to overturn it after the former support staff is moved to other teams.
I’d say it’s weird they didn’t focus on using this to help fix their nearly nonexistent community moderation, but I’ve been told their hands-off approach is deliberate due to a libertarian bent among the higher ups.
One thing Valve is known for is testing things. They typically make sure technology works before rolling it out everywhere.
I’m willing to bet that they have either solved most of the problems a tool like this has by massively limiting its scope, or it never actually gets past a beta test phase.
This. They have explicitly said that they are testing AI applications throughout the company and that it is not a concerted effort. It’s a few devs wanting to try it to see if it actually adds real value or not. That’s it.
It’s the best way, if it’s useful it’ll be used, if not then you’re not wasting time or money. Suits Valve’s methodology.
The file and class or function name or w/e literally has .proto in it.
As in prototype.
That’s because it’s a Protobuf file. Has nothing to do with prototypes.
Well you got me there.
https://github.com/SteamTracking/SteamTracking/tree/master/ProtobufsWebui
There’s the directory with the file in the screenshots, service_steamgpt.proto, updated 4 days ago along with a number of others, seems like it and a whole batch of related files did not exist before then.
I am uncertain if this … basically scraping operation is tracking the main Steam client or the Beta or what.
There is not a very helpful description of what exactly is being pulled here, in the readme/project description.
EDIT:
Perhaps if you are more familiar with Protobufs, you can take a gander at these and come away with a guesstimate as to what these are doing?
My guess is that this is part of some kind of machine learning pipeline, where users label edge cases to help train the model. Since it operates on account data, match data, and logs (see
CSteamGPT_GetTask_Response), an anti-cheat use case would make sense, but it’s hard to say for sure.This looks like data exchanged between the Steam client and server, and doesn’t contain any logic on its own.
This is an incorrect assertion. Making common actions self service without needing a human is almost always a customer win. For example automatic refunds on request if your request meets the correct criteria, instead of needing a human to look at it and make an arbitrary decision. Or having a knowledge base of common issues that can help people fix problems on their own without needing to talk to a person. Both are much faster and more repeatable.
But this is not viable for every use case. If there is a major issue with my Bank account, I want to speak to person, period.
Specific actions have automated workflows is of a course a good thing.
Documentation is also good, but it often doesn’t account for edge cases or your unique situation. Not to mention, the majority of the public is not going have the desire to deal with documentation.
They improved their support ticket throughput by orders of magnitude by automating a lot of it already. There are lots of versions of automation, too, like collecting information about the user’s problem before you even get to a human.
Right, but there’s a difference between automating a refund if they can detect the purchase happened in the last two weeks and has less than two hours of playtime, versus complex support problems being handled by an LLM that can be mislead or hallucinate.
I suppose it’s fine if it’s limited to giving advice on solving the problem and has to escalate to a human if any server side action is required, but it being tied to anti-cheat has me worried that’s not the case.
Their support staff are always being commended, seems odd to me.
At the same time they allow rusdian war crime simulators.
The non existent community moderation is by design and purpose. Valve wants it that way. They refuse to be any sort of gatekeepers in it.
I think it could have been an interesting usecase to chat with a steambot to get game recommendations.
Their current recommendation engine is already a marvel and the only one I’ve ever come across that actually directs me to niche stuff I might be interested in.
with the amount of information they collect on their customers, it better be damn good. honestly, the only reason it’s not a huge privacy problem is because they zealously guard that data to protect their near monopoly on PC gaming.
Gabe has been pandering to gamers and mostly giving us what we want, but when he dies, we better hope the next dude in charge isn’t some corporate suit that only cares about maximizing profits in every way that they can, or the enshitification of Steam is going to really fucking hurt. imagine if Valve was run like Microsoft. for example, the next guy might cut a deal with Microsoft to stop supporting Proton.
This is not meant to be a chatbot.
It is meant to evaluate gaming sessions of CS2 (and/or potentially any VAC enabled game, maybe).
Its an experimental, prototype of improving VAC’s serverside, backend analysis capabilities, to better detect cheaters and hackers.
You don’t need kernel level access into everyone’s pcs.
You can run analytics on what the server records as happening in the game session, to detect odd patterns and things that should be impossible.
LLMs are … the entire thing that they do is handle massive inputs of data, and then evaluate that data.
The part of an LLM that generates a response, in text form, to that data, is a whole other thing.
They can also output… code, or spreadsheets, or images, or 3d models, or… any other kind of data.
Like say, a printout of suspicious activity in a game session, with statistically derived confidence intervals and timestamps and analysis.
The you have another, differently tuned LLM, ingest the data the first LLM produces, and turn it into something else.
You see the ModelEvaluation and then MetaModelEvaluation?
That looks like what they’re doing to me.
Detailed Server Logs -> Model Evaluation -> MetaModelEvaluation.
If you’ve ever run a dedicated multiplayer server and had to deal with hackers… you’re gonna be looking through server logs to sniff out nonsense.
Server-side cheat detection, very oversimplified, is having automatic systems do that.
Ah interesting. More along the line of those ML-based intrusion detection products.
I can still hardly believe that the tech industry at large just decided to broadly roll out LLM integration into essentially every element of their businesses, having just no idea what they actually do.
Like 2 years ago now, I was figuratively pulling my hair out, reading the discussion panel schedule for Microsoft led conferences on LLMs and cybersecurity.
Literally every topic was a different kind of way that smashing an LLM into a complex business system… increases potential failure points, broadens attack surfaces… because networked LLMs literally are security vulnerabilities.
Not a single topic about how to use LLMs defensively, how to use them to turbocharge malware signature recognition, nothing like that.
All just a bunch of ‘make sure you don’t do this!’ warnings, and then everyone did them anyway.
I’d rather cut out my eyes than talk to a robot about my steam library.
I definitely value my eyes more than you do.