Mystery AI Hype Theater 3000, Episode 16 - Med-PaLM or Facepalm? A Second Opinion On LLMs In Healthcare
-
Alex and Emily are taking another stab at Google and other companies' aspirations to be part of the healthcare system - this time with the expertise of Stanford incoming assistant professor of dermatology and biomedical data science Roxana Daneshjou. A look at the gap between medical licensing examination questions and real life, and the inherently two-tiered system that might emerge if LLMs are brought into the diagnostic process.
References:
Google blog post describing Med-PaLM:
https://sites.research.google/med-palm/Nature: Large language models encode clinical knowledge:
https://www.nature.com/articles/s41586-023-06291-2Politico: Microsoft teaming up with Epic Systems to integrate generative AI into electronic medical records software
https://www.politico.com/newsletters/future-pulse/2023/08/24/a-health-care-ai-pact-that-matters-00112463MedRXiv: Beyond the hype: large language models propagate race-based medicine (Omiye, Daneshjou, et al)
https://www.medrxiv.org/content/10.1101/2023.07.03.23292192v1.full.pdfFresh AI hell:
Fake summaries of fake reviews:
https://bsky.app/profile/hypervisible.bsky.social/post/3k4wouet3pg2u
https://www.engadget.com/amazon-begins-rolling-out-ai-generated-review-summaries-164510165.htmlSchool administrators asking ChatGPT which books they have to remove from school libraries, given Iowa’s book ban:
https://www.popsci.com/technology/iowa-chatgpt-book-ban/
“Each of these texts was reviewed using AI software to determine if it contains a depiction of a sex act. Based on this review, there are 19 texts that will be removed from our 7-12 school library collections and stored in the Administrative Center while we await further guidance or clarity.”
https://globegazette.com/news/local/book-ban-implemented-in-mason-city-school-library/article_1e45064a-386a-11ee-82f7-c3e222c4871a.htmlLoquacity and Visible Emotion: ChatGPT as a Policy Advisor
Written by authors at the Bank of Italy
https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4533699AI generated school bus routes get students home at 10pm:
https://www.wdrb.com/news/education/jcps-bus-routes-generated-by-software-with-flawed-track-record-in-another-district/article_448ccd7a-3783-11ee-a2d8-dfef3db3eb07.htmlLethal AI generated books
https://mastodon.world/@rosamundi/110909701501300643How would RBG respond?
https://www.linkedin.com/feed/update/urn:li:activity:7100766139445596160/
You can check out future streams at http://twitch.tv/dair_institute.
Follow Emily at https://twitter.com/EmilyMBender and https://dair-community.social/@EmilyMBender
Follow Alex at https://twitter.com/alexhanna and https://dair-community.social/@alexMusic: Toby Menon.
Production: Christie Taylor.
Graphic Design: Naomi Pleasure-Park. -
T #medicine shared this topic on
Hello! It looks like you're interested in this conversation, but you don't have an account yet.
Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.
With your input, this post could be even better 💗
Register Login