"In a first for the U.S., Utah is letting artificial intelligence — not a doctor — renew certain medical prescriptions.
-
"In a first for the U.S., Utah is letting artificial intelligence — not a doctor — renew certain medical prescriptions. No human involved.
The state has launched a pilot program with health-tech startup Doctronic that allows an AI system to handle routine prescription renewals for patients with chronic conditions."
@bicmay what could possibly go wrong?
️ -
@bicmay what could possibly go wrong?
️People are really jumping into AI in healthcare and it makes me nervous when we haven't thought through how to ensure they're adequately trained and reduce biases! One medical education organization's entire webinar series for the next 5-6 weeks is all about AI in medical education.
-
"In a first for the U.S., Utah is letting artificial intelligence — not a doctor — renew certain medical prescriptions. No human involved.
The state has launched a pilot program with health-tech startup Doctronic that allows an AI system to handle routine prescription renewals for patients with chronic conditions."
@bicmay how is this NOT a HIPPA violation?
-
"In a first for the U.S., Utah is letting artificial intelligence — not a doctor — renew certain medical prescriptions. No human involved.
The state has launched a pilot program with health-tech startup Doctronic that allows an AI system to handle routine prescription renewals for patients with chronic conditions."
@bicmay why are we *testing* LLM's on the most vulnerable population, people with chronic illnesses???
-
@bicmay how is this NOT a HIPPA violation?
I would think this is considered an entity handling protected health information. I wonder if people have to opt into it or can decline. But regular people may want faster refill responses.
-
I would think this is considered an entity handling protected health information. I wonder if people have to opt into it or can decline. But regular people may want faster refill responses.
@bicmay I wonder too, because as HIPPA stands it can be be challenging for even doctors to share info about a patient, if they are from different clinics. As a patient we have to sign the exact files we want shared and often have to carry our own records between clinics. So, it would be a strange and possibly illegal shift if LLM's can magically make decisions about who gets what medicine at what time.
I also get that it would "make things easier" if an out of sight precious water consuming data center has power to make these decisions, docs and nurses are already at their limit for what time they can offer to patients. As long as it works. But, if it doesn't work and patients with chronic illnesses who depend on monthly medications can't get those medications because the system shuts down or locks them out... And docs are then out of touch with what their patients need... Well, a lot of people could be hurt and possibly die, while the machines apologize for the inconvenience. Where does liability fall? Who takes an oath as part of becoming a doctor to help and not harm vulnerable people? LLM's can't make or keep promises or be held liable for the outcomes of its decisions.
I wish LLM's were truly made by people who want good for people. But as it stands, the techbros are not here for the good of the people.
Thank you for posting this article, it really got me thinking.
-
"In a first for the U.S., Utah is letting artificial intelligence — not a doctor — renew certain medical prescriptions. No human involved.
The state has launched a pilot program with health-tech startup Doctronic that allows an AI system to handle routine prescription renewals for patients with chronic conditions."
@bicmay Because having a standing prescription with a built in limit would be too complicated
to return to
-
@bicmay why are we *testing* LLM's on the most vulnerable population, people with chronic illnesses???
-
@bicmay I wonder too, because as HIPPA stands it can be be challenging for even doctors to share info about a patient, if they are from different clinics. As a patient we have to sign the exact files we want shared and often have to carry our own records between clinics. So, it would be a strange and possibly illegal shift if LLM's can magically make decisions about who gets what medicine at what time.
I also get that it would "make things easier" if an out of sight precious water consuming data center has power to make these decisions, docs and nurses are already at their limit for what time they can offer to patients. As long as it works. But, if it doesn't work and patients with chronic illnesses who depend on monthly medications can't get those medications because the system shuts down or locks them out... And docs are then out of touch with what their patients need... Well, a lot of people could be hurt and possibly die, while the machines apologize for the inconvenience. Where does liability fall? Who takes an oath as part of becoming a doctor to help and not harm vulnerable people? LLM's can't make or keep promises or be held liable for the outcomes of its decisions.
I wish LLM's were truly made by people who want good for people. But as it stands, the techbros are not here for the good of the people.
Thank you for posting this article, it really got me thinking.
You're raising a lot of important issues. We can't tell if they've been considered.
HIPAA allows physicians to consult each other about a patient without requiring patient consent! "Treatment is the provision, coordination, or management of health care and related services for an individual by one or more health care providers, including consultation between providers regarding a patient and referral of a patient by one provider to another."
https://www.hhs.gov/hipaa/for-professionals/privacy/laws-regulations/index.html#permit
-
You're raising a lot of important issues. We can't tell if they've been considered.
HIPAA allows physicians to consult each other about a patient without requiring patient consent! "Treatment is the provision, coordination, or management of health care and related services for an individual by one or more health care providers, including consultation between providers regarding a patient and referral of a patient by one provider to another."
https://www.hhs.gov/hipaa/for-professionals/privacy/laws-regulations/index.html#permit
@bicmay @MamaLake but that is still between doctors who have sworn the Hippocratic oath and are subject to prosecution if they break the law. You can't jail an LLM, and, in my experience, when corporations are sued, the worst that happens is a slap on the wrist, so there is nothing really to promote compliance.
-
@bicmay @MamaLake but that is still between doctors who have sworn the Hippocratic oath and are subject to prosecution if they break the law. You can't jail an LLM, and, in my experience, when corporations are sued, the worst that happens is a slap on the wrist, so there is nothing really to promote compliance.
@Darkphoenix @bicmay exactly!!! And, I'm additionally concerned that many LLM's move to blackmail when they are threatened with being dismantled. Let's say they make a big woopsie and several people die without meds, since we can't send them to jail for medical malpractice or murder, we will have to cancel or dismantle the LLM, rather than just update it with new software (we promise it will work better this time!) and then whos records will be used in the blackmail motion of a dying LLM? It's all just bonkers and I don't want to train baby robots with zero accountability.
-
You're raising a lot of important issues. We can't tell if they've been considered.
HIPAA allows physicians to consult each other about a patient without requiring patient consent! "Treatment is the provision, coordination, or management of health care and related services for an individual by one or more health care providers, including consultation between providers regarding a patient and referral of a patient by one provider to another."
https://www.hhs.gov/hipaa/for-professionals/privacy/laws-regulations/index.html#permit
@bicmay lol, I'm always misspelling it, it's HIPAA not HIPPA, as I had first typed. Thank you for the correction.
-
People are really jumping into AI in healthcare and it makes me nervous when we haven't thought through how to ensure they're adequately trained and reduce biases! One medical education organization's entire webinar series for the next 5-6 weeks is all about AI in medical education.
@bicmay I may be in healthcare now but I worked in I.T. for MOST of my career. AI CAN'T be depended upon to always give you factual answers. It's not true artificial intelligence, it's a series of complex algorithms that spit out an answer based on the most likely answer based on how much of that subject is available.
It's easily misused and is an environmental disaster.
