Study claims that ChatGPT is worse than StackOverflow but did they use GPT 3.5? (performance, compare) - Artificial Intelligence

		City-Data Forum > General Forums > Science and Technology > AI
Study claims that ChatGPT is worse than StackOverflow but did they use GPT 3.5? (performance, compare)

Please register to participate in our discussions with 2 million other members - it's free and quick! Some forums can only be seen by registered members. After you create your account, you'll be able to customize options and access all our 15,000 new posts/day with fewer ads.

Search Forums (Advanced)

08-10-2023, 11:17 PM

LechM

37 posts, read 34,544 times

Reputation: 132

Advertisements

https://arxiv.org/abs/2308.02312

According to this study from Purdue that compared ChatGPT with Stack Overflow: "ChatGPT’s answers are more incorrect, significantly lengthy, and not consistent with human answers half of the time." However, the only location where I see the version mentioned, it is 3.5: "For the additional 2000 SO questions, ChatGPT 3.5 Turbo API is used." GPT-4 is much better than GPT-3.5 in programming, so this study might already be outdated.

08-11-2023, 07:15 AM

elnina

Location: Tricity, PL

61,672 posts, read 87,060,489 times

Reputation: 131638

Wasn't the study performed in June?
I think I posted a link to in here
https://www.city-data.com/forum/ai/3...g-rapidly.html

Not sure if any study was performed on the GPT-4

__________________
.
"No Copyrighted Material"
Moderated forums:
World, Europe, Texas, Corpus Christi, El Paso, Tyler, Lubbock, Houston, San Antonio, Tallahassee, Minnesota, Fish, Home Interior Design and Decorating, Science and Technology.

Need help? Click on this: >>> ToS, Mod List - US/World, Mod List - General Forums, Rules & FAQ's, Guide, CD Home page, How to Search, Realtor Advice

08-13-2023, 07:07 PM

LechM

37 posts, read 34,544 times

Reputation: 132

It might have been; I don't see the dates when the data was collected listed. The results were only reported this month.

It's a different study than the one you linked.

Please register to post and access all features of our very popular forum. It is free and quick. Over $68,000 in prizes has already been given out to active posters on our forum. Additional giveaways are planned.

Detailed information about all U.S. cities, counties, and zip codes on our site: City-data.com.

Please update this thread with any new information or opinions. This open thread is still read by thousands of people, so we encourage all additional points of view.

Quick Reply
The following errors occurred with your submission

Okay
Message: Posting Quick Reply - Please Wait

« Previous Thread | Next Thread »

Similar Threads

Another MARTA TOD Project: GPT College considers campus at Kensington Station, Atlanta, 4 replies

All times are GMT -6.