Can Socratic reflection improve #AI answers to medical questions?
-
Can Socratic reflection improve #AI answers to medical questions?
Adding a critic to a #languageModel pipeline improved performance on two measures of medical question-answering.
The improvement didn't depend on the critic's model.
-
T #medicine shared this topic on
-
Can Socratic reflection improve #AI answers to medical questions?
Adding a critic to a #languageModel pipeline improved performance on two measures of medical question-answering.
The improvement didn't depend on the critic's model.
This is yet another paper that finds quickly-diminishing returns of reflective thinking.
And this paper's result may be more severe: Figure 3 (above) shows accuracy on medical question-answering improved on second thought, but either plateaued or DECLINED *after* second thought.
Hello! It looks like you're interested in this conversation, but you don't have an account yet.
Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.
With your input, this post could be even better đź’—
Register Login