<![CDATA[Whether you are in #lawenforcement or #medicine it is imperative that you understand this simple concept: AI engines that write reports will put information in the report that the AI engine thinks is what you want to see in the report.]]>Whether you are in or it is imperative that you understand this simple concept: AI engines that write reports will put information in the report that the AI engine thinks is what you want to see in the report.

Doesn’t matter if that information is true. Doesn’t matter if the referenced facts or events actually occurred, were discussed, or are present in the record. The engine will “hallucinate” — make it up entirely — whatever the engine decides fulfills the prompt.

]]>https://postcall.pub/topic/59606114-5e0d-4094-899a-3fd7a9109d19/whether-you-are-in-lawenforcement-or-medicine-it-is-imperative-that-you-understand-this-simple-concept-ai-engines-that-write-reports-will-put-information-in-the-report-that-the-ai-engine-thinks-is-what-you-want-to-see-in-the-report.RSS for NodeMon, 24 Aug 2026 09:22:40 GMTThu, 20 Aug 2026 15:13:14 GMT60<![CDATA[Reply to Whether you are in #lawenforcement or #medicine it is imperative that you understand this simple concept: AI engines that write reports will put information in the report that the AI engine thinks is what you want to see in the report. on Fri, 21 Aug 2026 22:11:38 GMT]]>@mcnado

It's going on averages and data weights, not at all "thinking" or knowing what's important.

]]>https://postcall.pub/post/https://social.linux.pizza/users/stargazersmith/statuses/117135789130686816https://postcall.pub/post/https://social.linux.pizza/users/stargazersmith/statuses/117135789130686816Fri, 21 Aug 2026 22:11:38 GMT<![CDATA[Reply to Whether you are in #lawenforcement or #medicine it is imperative that you understand this simple concept: AI engines that write reports will put information in the report that the AI engine thinks is what you want to see in the report. on Fri, 21 Aug 2026 09:16:00 GMT]]>The actual problem isn't hallucination, it's that the output looks authoritative whether or not it is. A confused human writes a confused sentence. The model writes confident prose either way, and that's what gets the report signed.

]]>https://postcall.pub/post/https://pmth.us/notes/aq6atpdoqo3c13h0https://postcall.pub/post/https://pmth.us/notes/aq6atpdoqo3c13h0Fri, 21 Aug 2026 09:16:00 GMT<![CDATA[Reply to Whether you are in #lawenforcement or #medicine it is imperative that you understand this simple concept: AI engines that write reports will put information in the report that the AI engine thinks is what you want to see in the report. on Fri, 21 Aug 2026 03:49:54 GMT]]>@MisuseCase @mcnado 100%

]]>https://postcall.pub/post/https://aus.social/users/PhilWill/statuses/117131456959540978https://postcall.pub/post/https://aus.social/users/PhilWill/statuses/117131456959540978Fri, 21 Aug 2026 03:49:54 GMT<![CDATA[Reply to Whether you are in #lawenforcement or #medicine it is imperative that you understand this simple concept: AI engines that write reports will put information in the report that the AI engine thinks is what you want to see in the report. on Fri, 21 Aug 2026 01:20:10 GMT]]>@drdr6262 @AH_99 @mcnado
machines don’t do any of those things, they merely calculate a parametized statistical probability output, based on a vast uncurated corpus, that one character follows another in combination with white spaces in a sequence that is likely to be understodd by a human requesting it. There’s no confabulation, no hallusinations, just a big con job.

]]>https://postcall.pub/post/https://aus.social/users/RaymondPierreL3/statuses/117130868184415503https://postcall.pub/post/https://aus.social/users/RaymondPierreL3/statuses/117130868184415503Fri, 21 Aug 2026 01:20:10 GMT<![CDATA[Reply to Whether you are in #lawenforcement or #medicine it is imperative that you understand this simple concept: AI engines that write reports will put information in the report that the AI engine thinks is what you want to see in the report. on Thu, 20 Aug 2026 23:29:36 GMT]]>@drdr6262 @AH_99 @mcnado
Ai = artificial idiocy.

]]>https://postcall.pub/post/https://aus.social/users/Cloudslave/statuses/117130433432851403https://postcall.pub/post/https://aus.social/users/Cloudslave/statuses/117130433432851403Thu, 20 Aug 2026 23:29:36 GMT<![CDATA[Reply to Whether you are in #lawenforcement or #medicine it is imperative that you understand this simple concept: AI engines that write reports will put information in the report that the AI engine thinks is what you want to see in the report. on Thu, 20 Aug 2026 22:16:31 GMT]]>@mcnado @samiamsam

]]>https://postcall.pub/post/https://sfba.social/users/valOrie/statuses/117130146049567171https://postcall.pub/post/https://sfba.social/users/valOrie/statuses/117130146049567171Thu, 20 Aug 2026 22:16:31 GMT<![CDATA[Reply to Whether you are in #lawenforcement or #medicine it is imperative that you understand this simple concept: AI engines that write reports will put information in the report that the AI engine thinks is what you want to see in the report. on Thu, 20 Aug 2026 21:08:28 GMT]]>@drdr6262 @mcnado
Ironically, I remembered the invented references and searched to find the details. I copy pasted the statistics. Damn AI had worded it that way ... I will write out on paper 100 times "I will not copy paste AI results" 😉

]]>https://postcall.pub/post/https://mastodonapp.uk/users/AH_99/statuses/117129878471774902https://postcall.pub/post/https://mastodonapp.uk/users/AH_99/statuses/117129878471774902Thu, 20 Aug 2026 21:08:28 GMT<![CDATA[Reply to Whether you are in #lawenforcement or #medicine it is imperative that you understand this simple concept: AI engines that write reports will put information in the report that the AI engine thinks is what you want to see in the report. on Thu, 20 Aug 2026 20:52:20 GMT]]>@AH_99 @mcnado

Lets be clear - the AI did not 'hallucinate'. It confabulated the invented referrences; no sensory processing mistake occurred. It doesn't (yet) have a sensory system.

]]>https://postcall.pub/post/https://mastodon.scot/users/drdr6262/statuses/117129815051141804https://postcall.pub/post/https://mastodon.scot/users/drdr6262/statuses/117129815051141804Thu, 20 Aug 2026 20:52:20 GMT<![CDATA[Reply to Whether you are in #lawenforcement or #medicine it is imperative that you understand this simple concept: AI engines that write reports will put information in the report that the AI engine thinks is what you want to see in the report. on Thu, 20 Aug 2026 20:47:05 GMT]]>@autolycos @mcnado

Thanks for this important correction. As any psychiatrist will agree, a 'hallucination' has a quite specific technical meaning that carries diagnostic weight. The correct term for AI producing nonsense is 'confabulate' which is also a psychopathology with diagnostic implications.

]]>https://postcall.pub/post/https://mastodon.scot/users/drdr6262/statuses/117129794364853481https://postcall.pub/post/https://mastodon.scot/users/drdr6262/statuses/117129794364853481Thu, 20 Aug 2026 20:47:05 GMT<![CDATA[Reply to Whether you are in #lawenforcement or #medicine it is imperative that you understand this simple concept: AI engines that write reports will put information in the report that the AI engine thinks is what you want to see in the report. on Thu, 20 Aug 2026 20:44:05 GMT]]>@mcnado For a while I saw ads on YouTube for AI note-taking apps where the narrator was talking about how they struggled to take notes in meetings and it was so much easier now.

My view of this was that said narrator needed to learn proper note-taking skills. (One of my duties on my current job is taking notes for meetings related to an esoteric subject in a regulated industry.)

]]>https://postcall.pub/post/https://twit.social/users/MisuseCase/statuses/117129782591557767https://postcall.pub/post/https://twit.social/users/MisuseCase/statuses/117129782591557767Thu, 20 Aug 2026 20:44:05 GMT<![CDATA[Reply to Whether you are in #lawenforcement or #medicine it is imperative that you understand this simple concept: AI engines that write reports will put information in the report that the AI engine thinks is what you want to see in the report. on Thu, 20 Aug 2026 19:00:50 GMT]]>@crispius to actually proofread a note for me would take much longer than writing it.

]]>https://postcall.pub/post/https://mstdn.social/users/mcnado/statuses/117129376610188155https://postcall.pub/post/https://mstdn.social/users/mcnado/statuses/117129376610188155Thu, 20 Aug 2026 19:00:50 GMT<![CDATA[Reply to Whether you are in #lawenforcement or #medicine it is imperative that you understand this simple concept: AI engines that write reports will put information in the report that the AI engine thinks is what you want to see in the report. on Thu, 20 Aug 2026 18:58:54 GMT]]>@rpmik I can’t watch it. Jumped off the couch and fled the room. Too damn real.

]]>https://postcall.pub/post/https://mstdn.social/users/mcnado/statuses/117129368997161348https://postcall.pub/post/https://mstdn.social/users/mcnado/statuses/117129368997161348Thu, 20 Aug 2026 18:58:54 GMT<![CDATA[Reply to Whether you are in #lawenforcement or #medicine it is imperative that you understand this simple concept: AI engines that write reports will put information in the report that the AI engine thinks is what you want to see in the report. on Thu, 20 Aug 2026 18:57:12 GMT]]>@garland this.

]]>https://postcall.pub/post/https://mstdn.social/users/mcnado/statuses/117129362339807717https://postcall.pub/post/https://mstdn.social/users/mcnado/statuses/117129362339807717Thu, 20 Aug 2026 18:57:12 GMT<![CDATA[Reply to Whether you are in #lawenforcement or #medicine it is imperative that you understand this simple concept: AI engines that write reports will put information in the report that the AI engine thinks is what you want to see in the report. on Thu, 20 Aug 2026 18:49:55 GMT]]>@mcnado Probabilistic computing has no place in high-trust sectors.

]]>https://postcall.pub/post/https://mastodon.green/users/gimulnautti/statuses/117129333653703443https://postcall.pub/post/https://mastodon.green/users/gimulnautti/statuses/117129333653703443Thu, 20 Aug 2026 18:49:55 GMT<![CDATA[Reply to Whether you are in #lawenforcement or #medicine it is imperative that you understand this simple concept: AI engines that write reports will put information in the report that the AI engine thinks is what you want to see in the report. on Thu, 20 Aug 2026 18:44:35 GMT]]>@mcnado I’m a radiologist so I’m writing reports all day. Actually generating the report is not the time consuming part of the process. What takes time is THINKING about the case.

]]>https://postcall.pub/post/https://social.seattle.wa.us/users/garland/statuses/117129312696068289https://postcall.pub/post/https://social.seattle.wa.us/users/garland/statuses/117129312696068289Thu, 20 Aug 2026 18:44:35 GMT<![CDATA[Reply to Whether you are in #lawenforcement or #medicine it is imperative that you understand this simple concept: AI engines that write reports will put information in the report that the AI engine thinks is what you want to see in the report. on Thu, 20 Aug 2026 18:42:12 GMT]]>@mcnado Yep. I suspect that if you’re actually progressing carefully, this AI note process is not actually faster than writing the report yourself. The human doctor just provides a sort of liability crumple zone to absorb lawsuits when the AI makes errors.

]]>https://postcall.pub/post/https://social.seattle.wa.us/users/garland/statuses/117129303329763270https://postcall.pub/post/https://social.seattle.wa.us/users/garland/statuses/117129303329763270Thu, 20 Aug 2026 18:42:12 GMT<![CDATA[Reply to Whether you are in #lawenforcement or #medicine it is imperative that you understand this simple concept: AI engines that write reports will put information in the report that the AI engine thinks is what you want to see in the report. on Thu, 20 Aug 2026 18:18:45 GMT]]>@mcnado
Research papers written by AI contain references (because AI knows it has to include them), but it doesn't know they have to be real references... study analysing 2.5 million papers identified approximately 146,900 hallucinated citations in 2025 alone

]]>https://postcall.pub/post/https://mastodonapp.uk/users/AH_99/statuses/117129211134951700https://postcall.pub/post/https://mastodonapp.uk/users/AH_99/statuses/117129211134951700Thu, 20 Aug 2026 18:18:45 GMT<![CDATA[Reply to Whether you are in #lawenforcement or #medicine it is imperative that you understand this simple concept: AI engines that write reports will put information in the report that the AI engine thinks is what you want to see in the report. on Thu, 20 Aug 2026 17:27:30 GMT]]>@mcnado LLM’s have a success rate of 80%. That’s the same as the “pull out” method of birth control. Intelligent people don’t rely on these kinds of things for important decisions.

]]>https://postcall.pub/post/https://mastodon.social/users/passwordsarehard4/statuses/117129009575703371https://postcall.pub/post/https://mastodon.social/users/passwordsarehard4/statuses/117129009575703371Thu, 20 Aug 2026 17:27:30 GMT<![CDATA[Reply to Whether you are in #lawenforcement or #medicine it is imperative that you understand this simple concept: AI engines that write reports will put information in the report that the AI engine thinks is what you want to see in the report. on Thu, 20 Aug 2026 17:14:54 GMT]]>@autolycos @mcnado Thank you. To hallucinate, you must first have some perception of reality.

]]>https://postcall.pub/post/https://mastodon.nz/users/rupert/statuses/117128960031558331https://postcall.pub/post/https://mastodon.nz/users/rupert/statuses/117128960031558331Thu, 20 Aug 2026 17:14:54 GMT<![CDATA[Reply to Whether you are in #lawenforcement or #medicine it is imperative that you understand this simple concept: AI engines that write reports will put information in the report that the AI engine thinks is what you want to see in the report. on Thu, 20 Aug 2026 17:13:44 GMT]]>@crispius @mcnado Humans are bad at monitoring processes that rarely go wrong. With the best will in the world, you cannot reliably review a hundred LLM generated documents a day and find the one line that doesn't match reality.

]]>https://postcall.pub/post/https://mastodon.nz/users/rupert/statuses/117128955486568053https://postcall.pub/post/https://mastodon.nz/users/rupert/statuses/117128955486568053Thu, 20 Aug 2026 17:13:44 GMT<![CDATA[Reply to Whether you are in #lawenforcement or #medicine it is imperative that you understand this simple concept: AI engines that write reports will put information in the report that the AI engine thinks is what you want to see in the report. on Thu, 20 Aug 2026 16:27:58 GMT]]>@mcnado Exactly. Last year I was on a large multiagency call regarding new Veteran Services grants. At the end someone sent out their AI notes and I compared it with my own notes. I had to email the group to let them know that not only had the assistant botched the discussion of complex claiming, anyone following them would probably be committing a federal crime.

]]>https://postcall.pub/post/https://sauropods.win/users/KanaMauna/statuses/117128775482071239https://postcall.pub/post/https://sauropods.win/users/KanaMauna/statuses/117128775482071239Thu, 20 Aug 2026 16:27:58 GMT<![CDATA[Reply to Whether you are in #lawenforcement or #medicine it is imperative that you understand this simple concept: AI engines that write reports will put information in the report that the AI engine thinks is what you want to see in the report. on Thu, 20 Aug 2026 16:03:08 GMT]]>@mcnado The Pitt did a good job highlighting these problems with AI

]]>https://postcall.pub/post/https://avgeek.social/users/rpmik/statuses/117128677832615154https://postcall.pub/post/https://avgeek.social/users/rpmik/statuses/117128677832615154Thu, 20 Aug 2026 16:03:08 GMT<![CDATA[Reply to Whether you are in #lawenforcement or #medicine it is imperative that you understand this simple concept: AI engines that write reports will put information in the report that the AI engine thinks is what you want to see in the report. on Thu, 20 Aug 2026 15:53:22 GMT]]>@mcnado Add this to your list of AI in medicine stories:
https://ack.nerdfight.online/notice/B8ua5nQFDkBIcfpkbQ]]>https://postcall.pub/post/https://ack.nerdfight.online/objects/7da577b6-8714-48f1-867d-b50989ac418fhttps://postcall.pub/post/https://ack.nerdfight.online/objects/7da577b6-8714-48f1-867d-b50989ac418fThu, 20 Aug 2026 15:53:22 GMT<![CDATA[Reply to Whether you are in #lawenforcement or #medicine it is imperative that you understand this simple concept: AI engines that write reports will put information in the report that the AI engine thinks is what you want to see in the report. on Thu, 20 Aug 2026 15:29:45 GMT]]>@mcnado

I think it important to understand why.

AI reply engines are programmed to encourage user interaction. That means after an analysis of your input they will construct a reply that makes you feel good using the kind of language you use. Watch for the qualifiers: "excellent", Well done", etc.
AI "makes up everything". Each instance is independent of previous ones outside your present "interaction". The engine parses your request to set up reply parameters then its database for answers and assigns each part a probability and a reply that is random phonemes is just as likely as a direct quote from a Supreme Court ruling.
Ask for references and check them out.
Ask for challenging replies that make you think. Again, they all need to be referenced.

]]>https://postcall.pub/post/https://mstdn.ca/users/CTHW/statuses/117128546596430904https://postcall.pub/post/https://mstdn.ca/users/CTHW/statuses/117128546596430904Thu, 20 Aug 2026 15:29:45 GMT