Is DLSS5 essentially just taking a screenshot of the game and feeding it into a generative AI that gets to decide what it thinks it should look like with lit...
I think to your second point, since this AI Instagram filter is based on a 2D picture with no understanding of the light source or materials, even the background with this tech will ruin things.
One of the things I said in another post is that the DLSS demo with Grace was that I wasn’t just thrown by the face, I honestly was also thrown by the brightly lit background that really undermined what that scene was trying to convey.
To me the original scene was somber, she’s visiting a murder scene, the background amplifies that somber, feeling of dread with everything darker, shadows everywhere threatening to consume the light. The DLSS 5 scene, everything is brighter, shinier and now that same scene isn’t helping to convey the getting atmosphere, it’s like the darkness is being overcome.
That’s a very good point, and now that I’ve seen more coverage (including this video) and got a better understanding of how the tech works (based on 2D frames plus motion vectors) I’m inclined to agree.
I wonder if it would be possible to feed this system information about object materials and 3D lighting and spatial atmosphere so it’s not just “painting over” every frame? Or if that would even help it? Because the way it works now, I’m honestly concerned every major new game will soon start to look homogenous.
Yeah, turning up the lighting (essentially) on certain aspects of the background seems like an actual accessibility use case. There are probably far more direct ways of doing it that don’t interfere with artistic intent as much. I wonder if we will ever get away from raster lighting in a way that isnt buttfucking computationally expensive.
Maybe? But considering that it’s a 2D image with no underlying information about the models it would probably put light on things that shouldn’t be lit up, actually detracting from what it should look like.
Yeah see Gamer’s Nexus’s video for examples on how much extra random light got added to scenes. The rooftops of Assassin’s Creed Shadows look like a solar farm in the hot desert sun.
Maybe? It’s a road trip simulator with European scenery, things light up irl regardless, you are the driver, watch the road.
People are so salty about this, I wonder how this tech will go xD
The alternative here is a mod that requires you to pay a subscription monthly w/ IP DRM, I would like to see SCS’ answer.
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: [email protected]
Welcome to the largest gaming community on Lemmy! Discussion for all kinds of games. Video games, tabletop games, card games etc.
Rules
1. Submissions have to be related to games
Video games, tabletop, or otherwise. Posts not related to games will be deleted.
This community is focused on games, of all kinds. Any news item or discussion should be related to gaming in some way.
2. No bigotry or harassment, be civil
No bigotry, hardline stance. Try not to get too heated when entering into a discussion or debate.
We are here to talk and discuss about one of our passions, not fight or be exposed to hate. Posts or responses that are hateful will be deleted to keep the atmosphere good. If repeatedly violated, not only will the comment be deleted but a ban will be handed out as well. We judge each case individually.
3. No excessive self-promotion
Try to keep it to 10% self-promotion / 90% other stuff in your post history.
This is to prevent people from posting for the sole purpose of promoting their own website or social media account.
4. Stay on-topic; no memes, funny videos, giveaways, reposts, or low-effort posts
This community is mostly for discussion and news. Remember to search for the thing you’re submitting before posting to see if it’s already been posted.
We want to keep the quality of posts high. Therefore, memes, funny videos, low-effort posts and reposts are not allowed. We prohibit giveaways because we cannot be sure that the person holding the giveaway will actually do what they promise.
5. Mark Spoilers and NSFW
Make sure to mark your stuff or it may be removed.
No one wants to be spoiled. Therefore, always mark spoilers. Similarly mark NSFW, in case anyone is browsing in a public space or at work.
6. No linking to piracy
Don’t share it here, there are other places to find it. Discussion of piracy is fine.
We don’t want us moderators or the admins of lemmy.world to get in trouble for linking to piracy. Therefore, any link to piracy will be removed. Discussion of it is of course allowed.
I haven’t seen this video yet (will when I get home) but based on another by Gameranx, DLSS 5 looks like it will simultaneously:
If they can program it to just skip over character models, it might actually be good tech. Of course I have near zero faith in that happening.
I think to your second point, since this AI Instagram filter is based on a 2D picture with no understanding of the light source or materials, even the background with this tech will ruin things.
One of the things I said in another post is that the DLSS demo with Grace was that I wasn’t just thrown by the face, I honestly was also thrown by the brightly lit background that really undermined what that scene was trying to convey.
To me the original scene was somber, she’s visiting a murder scene, the background amplifies that somber, feeling of dread with everything darker, shadows everywhere threatening to consume the light. The DLSS 5 scene, everything is brighter, shinier and now that same scene isn’t helping to convey the getting atmosphere, it’s like the darkness is being overcome.
That’s a very good point, and now that I’ve seen more coverage (including this video) and got a better understanding of how the tech works (based on 2D frames plus motion vectors) I’m inclined to agree.
I wonder if it would be possible to feed this system information about object materials and 3D lighting and spatial atmosphere so it’s not just “painting over” every frame? Or if that would even help it? Because the way it works now, I’m honestly concerned every major new game will soon start to look homogenous.
Yeah, turning up the lighting (essentially) on certain aspects of the background seems like an actual accessibility use case. There are probably far more direct ways of doing it that don’t interfere with artistic intent as much. I wonder if we will ever get away from raster lighting in a way that isnt buttfucking computationally expensive.
Tldw?
DLSS 5 is a 2D Instagram filter that normalizes/yassifises faces using a AI model trained on what Nvidia thinks is what people should look like.
Are there examples of how games like Minecraft (if possible) would look like?
JDVance-ifier
“This will be minecraft in 2016”
It’s slop.
It would look great with Euro Truck Simulator or Lushfoil Photography Sim, their styles pair well.
Maybe? But considering that it’s a 2D image with no underlying information about the models it would probably put light on things that shouldn’t be lit up, actually detracting from what it should look like.
I’m also assuming consistency is going to be an issue. Will characters look the same at the start of a sequence as the end? Or from load to load?
Yeah see Gamer’s Nexus’s video for examples on how much extra random light got added to scenes. The rooftops of Assassin’s Creed Shadows look like a solar farm in the hot desert sun.
Maybe? It’s a road trip simulator with European scenery, things light up irl regardless, you are the driver, watch the road.
People are so salty about this, I wonder how this tech will go xD The alternative here is a mod that requires you to pay a subscription monthly w/ IP DRM, I would like to see SCS’ answer.