General Discussion

RockRaven

(19,015 posts)

6. These tools don't just fabricate fiction. They fabricate citations in law and science pieces.

Fri Feb 13, 2026, 02:47 PM

Feb 13

There are MANY stories (one is too many, and you'd think people would learn from others' mistakes) of lawyers getting in hot water with a judge for using AI and citing cases which simply don't exist. It is unprofessional to the extreme, yet it keeps happening even in law firms which institute training on the matter for their partners/associates/staff.

Same with science journal articles. Totally made up citations of articles which don't exist.

Edit history

Please sign in to view edit histories.

Recommendations

3 members have recommended this reply (displayed in chronological order):

Goonch dalton99a uponit7771

38 replies

= new reply since forum marked as read

Highlight:

You've probably heard that AI chatbots can completely fabricate quotes. It happened yesterday in a DU thread. [View all] highplainsdem Feb 13 OP

Thx to you & Goonch SheltieLover Feb 13 #1

Lol for fun I asked an AI the reason for the discrepancy and gave it the passage from your post AZJonnie Feb 13 #2

Not sure what you mean. It quoted one of my replies in that Science Fiction thread, or it quoted highplainsdem Feb 13 #4

I mean it literally sourced from this very thread AZJonnie Feb 13 #7

Claude is clueless. There is an actual story. I posted links about it in the earlier thread I linked to. There highplainsdem Feb 13 #9

It's not surprising that it got confused, this entire discussion is extremely circular AZJonnie Feb 13 #13

I would've expected any bot to at least follow the links in both threads, which would have shown that highplainsdem Feb 13 #15

Claude would have seen this bit, in Goonch's follow-up, which said this: AZJonnie Feb 13 #17

Interesting seeing you try to defend Claude's inane answer, when this thread links to the older thread highplainsdem Sunday #19

I guess I am, given you don't know what the actual prompt was, yet are arbitrarily coming up with a strawman AZJonnie Sunday #20

If there was anything close to intelligence in Claude, the highplainsdem Sunday #21

Why must you insist it's a delusional tangent AZJonnie Sunday #22

No, the problem using genAI is with genAI and its inherent flaws. Anyone who's ever used genAI should highplainsdem Monday #27

And, The Chatbot Is Still Wrong ProfessorGAC Feb 13 #3

+1. It's patent nonsense dalton99a Feb 13 #5

I don't know about that one, Professor :) AZJonnie Feb 13 #8

I'm Going To Say No ProfessorGAC Feb 13 #11

Obviously I know I don't know nearly as much on this topic as you do, so I generally defer, Sir :) AZJonnie Feb 13 #14

Pretty Much ProfessorGAC Feb 13 #16

Can you name a movie in which one person occupied two places at the same time? Orrex Monday #29

BTTF Is A Prime Example, Yes ProfessorGAC Monday #33

Right, but that's not the same Marty in two places at once Orrex Monday #34

Not Getting You ProfessorGAC Monday #35

I think we're differing on what qualifies as the "same" person Orrex Monday #37

Oh wait. I just caught your bit about "lack of matter available" Orrex Monday #38

These tools don't just fabricate fiction. They fabricate citations in law and science pieces. RockRaven Feb 13 #6

Yes. I mentioned that in the earlier thread I linked to. I've posted lots of warnings here over the last few years highplainsdem Feb 13 #10

+1. AI is essentially a smooth-talking buzzword-spewing bullshitter with an unlimited capacity for plagiarism dalton99a Feb 13 #12

Exactly. highplainsdem Sunday #18

When ChatGPT became popular, people said AI systems really need to provide sources. Renew Deal Sunday #24

Good catch Renew Deal Sunday #23

Thanks - but I wouldn't have caught it if I hadn't already looked at a number of websites about the story so highplainsdem Monday #25

Yikes. So how do we combat this? It's only going to get worse. Scrivener7 Monday #26

Yeah, it's getting scary. I posted something I didn't know was AI. I took it down as soon as mucifer Monday #28

It's really bad in the political commentary video space Renew Deal Monday #31

I suspect AI systems will be like fish farms. cachukis Monday #30

I miss the old Google. Hell, I miss the old Alta Vista. haele Monday #32

Anyone can make up a quote. GoCubsGo Monday #36