The Turing test of online reviews: Can we tell the difference between human-written and GPT-4-written online reviews? - Marketing Letters
link.springer.com
external-link
Online reviews serve as a guide for consumer choice. With advancements in large language models (LLMs) and generative AI, the fast and inexpensive creation of human-like text may threaten the feedback function of online reviews if neither readers nor platforms can differentiate between human-written and AI-generated content. In two experiments, we found that humans cannot recognize AI-written reviews. Even with monetary incentives for accuracy, both Type I and Type II errors were common: human reviews were often mistaken for AI-generated reviews, and even more frequently, AI-generated reviews were mistaken for human reviews. This held true across various ratings, emotional tones, review lengths, and participants’ genders, education levels, and AI expertise. Younger participants were somewhat better at distinguishing between human and AI reviews. An additional study revealed that current AI detectors were also fooled by AI-generated reviews. We discuss the implications of our findings on trust erosion, manipulation, regulation, consumer behavior, AI detection, market structure, innovation, and review platforms.
Snot Flickerman
link
fedilink
English
419M

Seems like good old Word Of Mouth where information is relayed among people who know each other in real life, is probably going to make a big comeback for this kind of stuff.

Because if you can’t trust any media on the internet being “real” the only trustworthy sources you’ll have is the real people in your real life.

Avid Amoeba
link
fedilink
17
edit-2
9M

Along with non-profit verified review orgs like Consumer Reports.

Maybe this will lead to the Internet going back to how it used to be in the beginning. Wouldn’t that be something.

Boy I can’t wait for the flash animation renaissance

Diplomjodler
link
fedilink
79M

I would never trust any recommendations of any people I know.

zout
link
fedilink
138M

Are you sure? Because that might say as much about you as about the people you know.

It definitely does.

The average person is notoriously shit at doing objective analysis, so yeah, you shouldn’t trust people you know.

Create a post

This is the official technology community of Lemmy.ml for all news related to creation and use of technology, and to facilitate civil, meaningful discussion around it.


Ask in DM before posting product reviews or ads. All such posts otherwise are subject to removal.


Rules:

1: All Lemmy rules apply

2: Do not post low effort posts

3: NEVER post naziped*gore stuff

4: Always post article URLs or their archived version URLs as sources, NOT screenshots. Help the blind users.

5: personal rants of Big Tech CEOs like Elon Musk are unwelcome (does not include posts about their companies affecting wide range of people)

6: no advertisement posts unless verified as legitimate and non-exploitative/non-consumerist

7: crypto related posts, unless essential, are disallowed

  • 1 user online
  • 38 users / day
  • 149 users / week
  • 309 users / month
  • 2.32K users / 6 months
  • 1 subscriber
  • 3.01K Posts
  • 43.4K Comments
  • Modlog