OpenAI, the company that launched ChatGPT a little over a year ago, has recently taken to social media to address concerns regarding the “lazy” performance of GPT-4 on social media and Google Reviews.
Screenshot from X, December 2023This move comes after growing user feedback online, which even includes a one-star review on the company’s Google Reviews.
OpenAI Gives Insight Into Training Chat Models, Performance Evaluations, And A/B Testing
OpenAI, through its @ChatGPTapp Twitter account, detailed the complexities involved in training chat models.
Screenshot from X, December 2023The organization highlighted that the process is not a “clean industrial process” and that variations in training runs can lead to noticeable differences in the AI’s personality, creative style, and political bias.
Thorough AI model testing includes offline evaluation metrics and online A/B tests. The final decision to release a new model is based on a data-driven approach to improve the “real” user experience.
OpenAI’s Google Review Score Affected By GPT-4 Performance, Billing Issues
This explanation comes after weeks of user feedback about GPT-4 becoming worse on social media networks like X.
Idk if anyone else has noticed this, but GPT-4 Turbo performance is significantly worse than GPT-4 standard.
I know it's in preview right now but it's significantly worse.
— Max Weinbach (@MaxWinebach) November 8, 2023
There has been discussion if GPT-4 has become "lazy" recently. My anecdotal testing suggests it may be true.
I repeated a sequence of old analyses I did with Code Interpreter. GPT-4 still knows what to do, but keeps telling me to do the work. One step is now many & some are odd. pic.twitter.com/OhGAMtd3Zq
— Ethan Mollick (@emollick) November 28, 2023
Complaints also appeared in OpenAI’s community forums.
Screenshot from OpenAI, December 2023The experience led one user to leave a one-star rating for OpenAI via Google Reviews. Other complaints regarded accounts, billing, and the artificial nature of AI.
Screenshot from Google Reviews, December 2023A recent user on Product Hunt gave OpenAI a rating that also appears to be related to GPT-4 worsening.
Screenshot from Product Hunt, December 2023GPT-4 isn’t the only issue that local reviewers complain about. On Yelp, OpenAI has a one-star rating for ChatGPT 3.5 performance.
OpenAI is now only 3.8 stars on Google Maps and a dismal 1 star on Yelp!
GPT-4’s degradation has really hurt their rating. Hope the business survives.https://t.co/RF8uJH1WQ5 pic.twitter.com/OghAZLCiVu
— Nate Chan (@nathanwchan) December 9, 2023
The complaint:
Screenshot from Yelp, December 2023In related OpenAI news, the review with the most likes aligns with recent rumors about a volatile workplace, alleging that OpenAI is a “Cutthroat environment. Not friendly. Toxic workers.”
Screenshot from Google Reviews, December 2023The reviews voted the most helpful on Glassdoor about OpenAI suggested that employee frustration and product development issues stem from the company’s shift in focus on profits.
Screenshots from Glassdoor, December 2023This incident provides a unique outlook on how customer and employee experiences can impact any business through local reviews and business ratings platforms.
Screenshot from Google, December 2023Google SGE Highlights Positive Google Reviews
In addition to occasional complaints, Google reviewers acknowledged the revolutionary impact of OpenAI’s technology on various fields.
The most positive review mentions about the company appear in Google SGE (Search Generative Experience).
Screenshot from Google SGE, December 2023Conclusion
OpenAI’s recent insights into training chat models and response to public feedback about GPT-4 performance illustrate AI technology’s dynamic and evolving nature and its impact on those who depend on the AI platform.
Especially the people who just received an invitation to join ChatGPT Plus after being waitlisted while OpenAI paused new subscriptions and upgrades. Or those developing GPTs for the upcoming GPT Store launch.
As AI advances, professionals in these fields must remain agile, informed, and responsive to technological developments and the public’s reception of these advancements.
Featured image: Tada Images/Shutterstock
