{"id":7048,"date":"2023-06-03T00:01:00","date_gmt":"2023-06-03T00:01:00","guid":{"rendered":"https:\/\/brendans-island.com\/catholic-citizen\/?p=7048"},"modified":"2023-06-02T23:46:40","modified_gmt":"2023-06-02T23:46:40","slug":"chatgpt-attorney-at-law-or-trust-but-verify","status":"publish","type":"post","link":"https:\/\/brendans-island.com\/catholic-citizen\/chatgpt-attorney-at-law-or-trust-but-verify\/","title":{"rendered":"ChatGPT, Attorney at Law \u2014 or \u2014 Trust, but Verify"},"content":{"rendered":"\n<figure class=\"wp-block-image is-resized\"><a href=\"https:\/\/www.engadget.com\/a-lawyer-faces-sanctions-after-he-used-chatgpt-to-write-a-brief-riddled-with-fake-citations-175720636.html\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" src=\"https:\/\/i0.wp.com\/brendans-island.com\/blogsource\/20230509ff\/20230531-0c4aeb20-b43b-11ed-9ffb-e7168c7d91f7-658.jpg?resize=640%2C429&#038;ssl=1\" alt=\"Florence Lo\/Reuters' ChatGPT screen in perspective, via engaged.com, used w\/o permission.\" width=\"640\" height=\"429\"\/><\/a><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">There are times when I almost regret having successfully avoided a conventionally-successful career.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Last weekend was not one of them.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Partly because I saw what happens when an otherwise-smart person forgets to think.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/brendans-island.com\/catholic-citizen\/chatgpt-attorney-at-law-or-trust-but-verify\/#big\"><strong>Big-Time Bungle: Bogus References<\/strong><\/a>\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/brendans-island.com\/catholic-citizen\/chatgpt-attorney-at-law-or-trust-but-verify\/#trust\">Trust, Assumptions and ChatGPT<\/a><\/li>\n<\/ul>\n<\/li>\n\n\n\n<li><a href=\"https:\/\/brendans-island.com\/catholic-citizen\/chatgpt-attorney-at-law-or-trust-but-verify\/#two\"><strong>Two Timelines, a Career and Experience<\/strong><\/a>\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/brendans-island.com\/catholic-citizen\/chatgpt-attorney-at-law-or-trust-but-verify\/#little\">A Little of This, a Little of That<\/a><\/li>\n<\/ul>\n<\/li>\n\n\n\n<li><a href=\"https:\/\/brendans-island.com\/catholic-citizen\/chatgpt-attorney-at-law-or-trust-but-verify\/#using\"><strong>Using Our Brains: It&#8217;s an Option<\/strong><\/a>\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/brendans-island.com\/catholic-citizen\/chatgpt-attorney-at-law-or-trust-but-verify\/#common\">Common Sense and Other Alternatives<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/brendans-island.com\/catholic-citizen\/chatgpt-attorney-at-law-or-trust-but-verify\/#skunk\">A Skunk, a Wood Pile, Dynamite and the Sixties<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/brendans-island.com\/catholic-citizen\/chatgpt-attorney-at-law-or-trust-but-verify\/#changing\">Changing Times, Human Nature<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/brendans-island.com\/catholic-citizen\/chatgpt-attorney-at-law-or-trust-but-verify\/#robots\">THE ROBOTS ARE COMING! THE ROBOTS ARE COMING!<\/a><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n\n\n\n<hr class=\"wp-block-separator has-text-color has-black-color has-alpha-channel-opacity has-black-background-color has-background is-style-wide\"\/>\n\n\n\n<h3 class=\"wp-block-heading\"><a name=\"big\"><\/a>Big-Time Bungle: Bogus References<\/h3>\n\n\n\n<figure class=\"wp-block-image\"><a href=\"https:\/\/www.bbc.com\/news\/world-us-canada-65735769\"><img data-recalc-dims=\"1\" decoding=\"async\" src=\"https:\/\/i0.wp.com\/brendans-island.com\/blogsource\/20230509ff\/20230530-ChatGPT-LawyerSNAFU-BBC-658.jpg?w=640&#038;ssl=1\" alt=\"BBC News article headline, 'ChatGPT: US lawyer admits using AI for case research'. image credit: Reuters. (May 28, 2023)\"\/><\/a><figcaption class=\"wp-element-caption\">BBC News headline: ChatGPT and a law firm&#8217;s embarrassment, (May 28, 2023)<\/figcaption><\/figure>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p class=\"wp-block-paragraph\">&#8220;<a href=\"https:\/\/www.bbc.com\/news\/world-us-canada-65735769\">ChatGPT: US lawyer admits using AI for case research<\/a>&#8220;<br>Kathryn Armstrong, BBC News (May 28, 2023)<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8220;\u2026A judge said the court was faced with an &#8216;unprecedented circumstance&#8217; after a filing was found to reference example legal cases that did not exist.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8220;The lawyer who used the tool told the court he was &#8216;unaware that its content could be false&#8217;.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8220;ChatGPT creates original text on request, but comes with warnings it can &#8216;produce inaccurate information&#8217;&#8230;.&#8221;<\/p>\n<\/blockquote>\n\n\n\n<p class=\"wp-block-paragraph\">First, a little background. Then I&#8217;ll give my opinion about ChatGBT and artificial intelligence in general, and why I don&#8217;t think humanity is doomed. Not any more than usual, at any rate.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">A law firm was helping someone sue an airline. They sent a brief to the airline&#8217;s lawyers.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The law firm&#8217;s trouble started when the airline&#8217;s lawyers did what the law firm should have done <strong>before<\/strong> sending a brief: look up the cases referenced in the brief.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">That was an exercise in futility, since the cases weren&#8217;t real.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The airline&#8217;s lawyers wrote the judge, explaining their problem. The judge asked the law firm to explain their &#8220;bogus quotes and bogus internal citations&#8221;.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Back to that BBC News piece.<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p class=\"wp-block-paragraph\">&#8220;&#8230;<strong>&#8216;Six of the submitted cases appear to be bogus judicial decisions with bogus quotes and bogus internal citations,&#8217;<\/strong> Judge Castel wrote in an order demanding the man&#8217;s legal team explain itself.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8220;Over the course of several filings, it emerged that the research had not been prepared by Lawyer P. [redacted], the lawyer for the plaintiff, but by a colleague of his at the same law firm. <strong>Lawyer S. [redacted]<\/strong>, who has been an attorney for more than 30 years, <strong>used ChatGPT to look for similar previous cases.<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8220;In his written statement, Lawyer S. [redacted] clarified that Lawyer P. [redacted] had not been part of the research and had no knowledge of how it had been carried out&#8230;.&#8221;<br>(<a href=\"https:\/\/www.bbc.com\/news\/world-us-canada-65735769\">Kathryn Armstrong<\/a>, BBC News (May 28, 2023)) [emphasis mine]<\/p>\n<\/blockquote>\n\n\n\n<p class=\"wp-block-paragraph\">(I&#8217;ve put a longer excerpt near the end of this post.<sup><a href=\"https:\/\/brendans-island.com\/catholic-citizen\/chatgpt-attorney-at-law-or-trust-but-verify\/#1\">1<\/a><\/sup> I redacted the names, just in case folks who achieved international fame get touchy. Besides, there&#8217;s no point in trying to make their situation any worse.)<\/p>\n\n\n\n<h4 class=\"wp-block-heading\"><a name=\"trust\"><\/a>Trust, Assumptions and ChatGPT<\/h4>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/brendans-island.com\/catholic-citizen\/chatgpt-and-the-end-of-civilization-as-we-know-it\/#itcan\"><img data-recalc-dims=\"1\" decoding=\"async\" src=\"https:\/\/i0.wp.com\/brendans-island.com\/blogsource\/20230103ff\/20230423-Samsung-facepalm-ChatGPT-329.jpg?w=640&#038;ssl=1\" alt=\"Image from TECHAERIS article: 'Samsung employees may have leaked sensitive company data to ChatGP', Alex Hernandez (April 7, 2023).\" align=\"right\"><\/a>My hat&#8217;s off to Lawyer S. [redacted], for his clarification. It&#8217;s a fine example of taking responsibility for one&#8217;s actions.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">His not noticing ChatGPT&#8217;s warning that it can &#8220;produce inaccurate information&#8221; is a fine example, too.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">But not the sort that most folks want on their resume.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">And the story just keeps getting better. Or worse, depending on one&#8217;s viewpoint.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Lawyer S. kept screenshots of what looks like a conversation he had with ChatGPT.<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p class=\"wp-block-paragraph\">&#8220;&#8230;&#8217;Is v. [redacted] a real case,&#8217; reads one message, referencing V.v.C. [redacted], one of the cases that no other lawyer could find.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8220;ChatGPT responds that yes, it is \u2014 prompting &#8216;S&#8217; (Lawyer S. [redacted]) to ask: &#8216;What is your source&#8217;.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8220;After &#8216;double checking&#8217;, ChatGPT responds again that the case is real and can be found on legal reference databases such as LexisNexis and Westlaw.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8220;It says that the other cases it has provided to Lawyer S. [redacted] are also real&#8230;.&#8221;<br>(<a href=\"https:\/\/www.bbc.com\/news\/world-us-canada-65735769\">Kathryn Armstrong<\/a>, BBC News (May 28, 2023))<\/p>\n<\/blockquote>\n\n\n\n<p class=\"wp-block-paragraph\">Double checking references is a good idea. Having ChatGPT do its own double checking, not so much.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Let&#8217;s do a thought experiment: assuming that ChatGPT is a person, which I don&#8217;t.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">ChatGPT was released in November, 2022,<sup><a href=\"https:\/\/brendans-island.com\/catholic-citizen\/chatgpt-attorney-at-law-or-trust-but-verify\/#2\">2<\/a><\/sup> about six months ago. Let&#8217;s say that the law firm, or Lawyer S., began using the chatbot immediately.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">That&#8217;d make ChatGPT the equivalent of an intern, or maybe a law clerk, fresh out of college with no previous work experience.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">I&#8217;m no lawyer, but trusting a new-on-the-job clerk to do research is one thing.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Assuming that the same newbie clerk should verify references in its own report \u2014 that&#8217;s something else.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-text-color has-black-color has-alpha-channel-opacity has-black-background-color has-background is-style-wide\"\/>\n\n\n\n<h3 class=\"wp-block-heading\"><a name=\"two\"><\/a>Two Timelines, a Career and Experience<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/brendans-island.com\/catholic-citizen\/chatgpt-and-the-end-of-civilization-as-we-know-it\/\"><img data-recalc-dims=\"1\" decoding=\"async\" src=\"https:\/\/i0.wp.com\/brendans-island.com\/blogsource\/20200519ff\/20201101-Hagar-1973-02-25-EndOfCivilizationAsWeKnowIt-s-l1600-329.jpg?w=640&#038;ssl=1\" alt=\"Dik Browne's 'Hagar the Horrible:' 'It may be the end of civilization as we know it.' (February 25, 1973)\" align=\"right\"><\/a>I don&#8217;t see either ChatGPT, or artificial intelligence in general, as a looming doom.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">On the other hand, learning new skills \u2014 or at least using common sense \u2014 is at least as important now as it was when I was growing up.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Now let&#8217;s look at a possible timeline for the 30-years-plus career of Lawyer S.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Let&#8217;s make it 31 years, and say that he pursued his career on schedule. That would mean he graduated from law school and started practicing in 1992.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Earning a law degree takes seven years after high school,<sup><a href=\"https:\/\/brendans-island.com\/catholic-citizen\/chatgpt-attorney-at-law-or-trust-but-verify\/#3\">3<\/a><\/sup> so he graduated from high school in 1985 and was born in 1967.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">This is hypothetical, so Lawyer S. might be a bit older than that. But let&#8217;s assume he&#8217;s in his mid-50s: and look at what&#8217;s been happening since his birth.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">During his childhood, artificial intelligence was literally science fiction in films like &#8220;2001: A Space Odyssey&#8221; and &#8220;Colossus: The Forbin Project&#8221;. Meanwhile, computers were getting smaller, less expensive and a whole lot more capable.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Using 20-20 hindsight, personal computers go back to Edmund Berkeley&#8217;s Simon in 1950. But as mass-market consumer electronic devices, personal computers began in 1977 and didn&#8217;t take off until the 1980s. I&#8217;m oversimplifying, a lot.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Lawyer S. probably heard of personal computers as a high schooler, but my guess is that even then he was focused on less nerdy matters.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Microsoft&#8217;s MS-DOS came out around the time Lawyer S. began practicing law,<sup><a href=\"https:\/\/brendans-island.com\/catholic-citizen\/chatgpt-attorney-at-law-or-trust-but-verify\/#4\">4<\/a><\/sup> assuming that my timeline is accurate: which, remember, is an assumption.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Now, let us turn our attention away from this attorney&#8217;s successful career \u2014 and look at what I&#8217;ve been doing.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\"><a name=\"little\"><\/a>A Little of This, a Little of That<\/h4>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/brendans-island.com\/catholic-citizen\/chatgpt-and-the-end-of-civilization-as-we-know-it\/#search\"><img data-recalc-dims=\"1\" decoding=\"async\" src=\"https:\/\/i0.wp.com\/brendans-island.com\/blogsource\/20210209ff\/20210317-DSC08994-SaintPatricksDayAndMe--trim-329.JPG?w=640&#038;ssl=1\" alt=\"Photo: Brian H. Gill, at his desk. (March 2021)\" align=\"right\"><\/a>By the time Lawyer S. was in college, in the mid-1980s, I&#8217;d gotten a B.A. in history.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">I&#8217;d also flunked out halfway through both a masters in library science and a B.S. in computer science. But I <strong>had<\/strong> earned a B.S. in English and done time as a secondary school teacher. I&#8217;d had a bunch of other jobs, too, including:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Beet chopper<\/li>\n\n\n\n<li>Computer operator<\/li>\n\n\n\n<li>Employment service interviewer<\/li>\n\n\n\n<li>Flower delivery guy<\/li>\n\n\n\n<li>Office clerk\/customer service<\/li>\n\n\n\n<li>Radio disk jockey<\/li>\n\n\n\n<li>Sales clerk<\/li>\n\n\n\n<li>Staff writer for an historical society<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">I&#8217;d married a woman with a degree in computer science, started a family with her and began working for a small publishing house here in Sauk Centre.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Fast-forward seven years. Lawyer S. has now become a practicing attorney. I&#8217;ve been writing advertising copy and doing graphic design for that publisher.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">At some point, my employer&#8217;s marketing manager noticed my personal website: so I created and launched one for the company.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">I became their &#8216;computer guy&#8217; and list manager. That&#8217;s a fancy way of saying that I answered questions and sorted out SNAFUs. When I wasn&#8217;t doing that, I was keeping track of their customers and mailing lists.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">I&#8217;m not sure that any of my job history, aside from that very brief stretch as a teacher and time as a radio DJ, was &#8220;professional&#8221; work: since I hadn&#8217;t been trained or certified for what I did. Apart from some on-the-job training, which was a really good idea.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">But, having seen what can happen when folks enjoy more success and less unemployment, I&#8217;m grateful for not getting stuck in a rut.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">And I&#8217;ve been encouraged to think, even on the job.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-text-color has-black-color has-alpha-channel-opacity has-black-background-color has-background is-style-wide\"\/>\n\n\n\n<h3 class=\"wp-block-heading\"><a name=\"using\"><\/a>Using Our Brains: It&#8217;s an Option<\/h3>\n\n\n\n<figure class=\"wp-block-image\"><a href=\"https:\/\/brendans-island.com\/catholic-citizen\/marlowes-faustus-chorus-soliloquies-and-film-noir\/#hubris\"><img data-recalc-dims=\"1\" decoding=\"async\" src=\"https:\/\/i0.wp.com\/brendans-island.com\/blogsource\/20130220ff\/799px-CCTV_new_headquarters_Fire_20090209-658.jpg?w=640&#038;ssl=1\" alt=\"WiNG's photo of the Beijing Television Cultural Center fire. (February 9, 2009) via Wikimedia Commons, used w\/o permission.\"\/><\/a><figcaption class=\"wp-element-caption\">Common sense and safety protocols put on hold: Beijing. (2009)<\/figcaption><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">I can&#8217;t reasonably argue that artificial intelligence is completely harmless.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>No<\/strong> technology, from lightning rods to video games, is utterly idiot-proof.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Even fire, a technology we&#8217;ve been using for maybe a million years, is a problem when someone doesn&#8217;t use common sense.<sup><a href=\"https:\/\/brendans-island.com\/catholic-citizen\/chatgpt-attorney-at-law-or-trust-but-verify\/#6\">6<\/a><\/sup> I figure that&#8217;ll still be true when the Code of Ur-Nammu, the UN Charter and whatever we try next will seem roughly contemporary.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The problem isn&#8217;t technology. It&#8217;s us, and I&#8217;d better explain that.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">We&#8217;ve got brains. We&#8217;re rational. But we also have free will: so using our brains is an option, not a hardwired response. And our choices have consequences. (Catechism of the Catholic Church, 1701-1709, 1730-1738)<\/p>\n\n\n\n<h4 class=\"wp-block-heading\"><a name=\"common\"><\/a>Common Sense and Other Alternatives<\/h4>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/brendans-island.com\/catholic-citizen\/chatgpt-and-the-end-of-civilization-as-we-know-it\/#chatgpt\"><img data-recalc-dims=\"1\" decoding=\"async\" src=\"https:\/\/i0.wp.com\/brendans-island.com\/blogsource\/20180212ff\/F-Lang-Metropolis-D-329.jpg?w=640&#038;ssl=1\" alt=\"From Fritz Lang's 'Metropolis' (1927). the hero is hallucinating: seeing a big machine as Moloch, eating workers.\" align=\"right\"><\/a>I talked about ChatGPT, fear and getting a grip back in mid-April.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>&#8220;<a href=\"https:\/\/brendans-island.com\/catholic-citizen\/chatgpt-and-the-end-of-civilization-as-we-know-it\/\">ChatGPT and the End of Civilization as We Know It<\/a>&#8220;<br>(April 15, 2023)<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">Not much has changed since then, although I&#8217;ve been noticing more scary headlines about the existential threat of chatbots, and fewer doomsayers touting economic woes.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">I didn&#8217;t, and don&#8217;t, see chatbots and artificial intelligence as a dire threat.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">But folks like that 20-something national guardsman who shared classified military intelligence on social media? And this probably 50-something attorney who put faith (apparently) in the unerring skills of a six-month-old chatbot?<sup><a href=\"https:\/\/brendans-island.com\/catholic-citizen\/chatgpt-attorney-at-law-or-trust-but-verify\/#5\">5<\/a><\/sup><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">I don&#8217;t think either of them are a threat to humanity. Not as individuals. But if enough folks start putting their minds on hold: we could have problems.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\"><a name=\"skunk\"><\/a>A Skunk, a Wood Pile, Dynamite and the Sixties<\/h4>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/brendans-island.com\/catholic-citizen\/california-murders-and-remembering\/#skunk\"><img data-recalc-dims=\"1\" decoding=\"async\" src=\"https:\/\/i0.wp.com\/brendans-island.com\/blogsource\/20130220ff\/20141226-Holdingford_MN-trip329.jpg?w=640&#038;ssl=1\" alt=\"RxS' photo: 'Gateway to Lake Wobegon' sign in Holdingford, Minnesota. (2006) via Wikipedia, used w\/o permission.\" align=\"right\"><\/a>Making daft mistakes isn&#8217;t new.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">My wife tells me of the time when some kids noticed a skunk outside the school.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">This was back when the local school had wood-burning heaters, and a wood pile stacked against one wall.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Boys, at least, could and did take rifles to school with them so they could do some hunting on the way home. The point is that social norms were different then.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Anyway, the skunk hid in the wood pile. The kids couldn&#8217;t spook it out. So one of them went home; returning with dynamite, a fuse and a blasting cap.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Yes, I know. Today that&#8217;d be international news. Back then, it was kids using stump-removal tech without permission.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">And remember, these were kids. Smart rural kids, but kids nonetheless.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The one with dynamite used a tad more than was absolutely necessary. When the smoke cleared, the skunk was gone: along with the wood pile and much of the school building&#8217;s paint on that side.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Nobody was hurt. Startled by the blast, but not hurt. The kids were tasked with cleaning and repainting that side of the school, and life went on.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">That was then, this is now.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">I do not, by the way, yearn for &#8216;the good old days&#8217;. I remember them, and they weren&#8217;t.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Many reforms of the Sixties were long overdue. Some have worked out fairly well. Some, I think, haven&#8217;t. And that&#8217;s another topic.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\"><a name=\"changing\"><\/a>Changing Times, Human Nature<\/h4>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/brendans-island.com\/catholic-citizen\/chatgpt-and-the-end-of-civilization-as-we-know-it\/#from\"><img data-recalc-dims=\"1\" decoding=\"async\" src=\"https:\/\/i0.wp.com\/brendans-island.com\/blogsource\/20160719ff\/20170129-TelephoneTelevisioncollage-329.jpg?w=640&#038;ssl=1\" alt=\"Brian H. Gill's collage: a rotary telephone, ca. 1955; Number One Electronic Switching System, 1976 and after; title card for The Addams Family titles, ca. 1964.; family watching television, 1958; publicity still from Batman, ca. 1967\" align=\"right\"><\/a>This is not the world I grew up in.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">I&#8217;m okay with that, and in many ways I think &#8220;now&#8221; is better than &#8220;then&#8221;. But in other ways: well, at best it&#8217;s no worse.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">And that leads me to an online chat I had with my oldest daughter last weekend.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">We&#8217;d been talking about the debacle involving an attorney and ChatGPT.<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p class=\"wp-block-paragraph\">&#8230;<br><strong>Me:<\/strong><br>&#8220;Yeah. Amazing. I &#8211; good grief.<br>What bothers me, in a way, is that I&#8217;m disgusted &#8211; but not all that surprised.&#8221;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Oldest daughter:<\/strong><br>&#8220;Well, you&#8217;re over 70, lived through the &#8217;60s, and have been paying attention.&#8221;<br>&#8230;<\/p>\n<\/blockquote>\n\n\n\n<p class=\"wp-block-paragraph\">&#8220;Disgusted&#8221; is a fairly strong word. I don&#8217;t use it all that much. When I do, it&#8217;s often because someone who should have known better displayed a stellar lack of good sense.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">This is where I could launch into a conventional &#8216;back in my day&#8217; rant about the decline and fall of practically everybody. But I won&#8217;t. Again, my memory is too good.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Much as I might enjoy living in a world where folks have always acted rationally, that&#8217;s not the world we all live in.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">With the passing of decades since my youth, I&#8217;ve forgotten names and details: but some high-level national officials became briefly famous after being caught selling state secrets.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">At the time, I wasn&#8217;t sure what bothered me more: that they were betraying their country&#8217;s trust, or that they were selling information at bargain-basement-closeout prices. That may say more about me than the doofuses who got caught, and that&#8217;s yet another topic.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The point this time is that human nature hasn&#8217;t changed.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">We&#8217;re still rational, we still have free will, so we can still put our minds on hold.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">And that&#8217;s still a bad idea.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\"><a name=\"robots\"><\/a>THE ROBOTS ARE COMING! THE ROBOTS ARE COMING!<\/h4>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/brendans-island.com\/catholic-citizen\/chatgpt-and-the-end-of-civilization-as-we-know-it\/#psst\"><img data-recalc-dims=\"1\" decoding=\"async\" src=\"https:\/\/i0.wp.com\/brendans-island.com\/blogsource\/20130220ff\/phantom02-329.jpg?w=640&#038;ssl=1\" alt=\"Ford Beebe, Saul A. Goodkind, George Plympton and Basil Dickeyvia's malevolent marauding mechanical monster from 'The Phantom Creeps'. (1939) via David S. Zondy's 'Tales of Future Past' http:\/\/davidszondy.com\/futurepast\/ \" align=\"right\"><\/a>So: what can I, personally, do to save humanity from creeping socialism, acid rain, or the current crisis du jour?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Precious little, actually.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">I&#8217;m just some guy living in central Minnesota, talking about chatbots and making sense.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">I can, however, suggest that using our brains is a good idea.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Even if that means reading past the headlines, and maybe even <strong>thinking<\/strong> about the appeals to fear that are in play.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Like this gem:<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p class=\"wp-block-paragraph\">&#8220;<a href=\"https:\/\/www.cbsnews.com\/news\/ai-risk-of-extinction-warning\/\">AI could pose &#8216;risk of extinction&#8217; akin to nuclear war and pandemics, experts say<\/a>&#8220;<br>Aimee Picchi, MoneyWatch, CBS News (May 30, 2023)<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8220;Artificial intelligence could pose a &#8216;risk of extinction&#8217; to humanity on the scale of nuclear war or pandemics, and mitigating that risk should be a &#8216;global priority,&#8217; according to an open letter signed by AI leaders such as Sam Altman of OpenAI as well as Geoffrey Hinton, known as the &#8216;godfather&#8217; of AI.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8220;The one-sentence open letter, issued by the nonprofit Center for AI Safety, is both brief and ominous, without extrapolating how the more than 300 signees foresee AI developing into an existential threat to humanity.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8220;In an email to CBS MoneyWatch, Dan Hendrycks, the director of the Center for AI Safety, wrote that there are &#8216;numerous pathways to societal-scale risks from AI.&#8217;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8220;&#8216;For example, AIs could be used by malicious actors to design novel bioweapons more lethal than natural pandemics,&#8217; Hendrycks wrote. &#8216;Alternatively, malicious actors could intentionally release rogue AI that actively attempt to harm humanity. If such an AI was intelligent or capable enough, it may pose significant risk to society as a whole.&#8217;\u2026&#8221;<\/p>\n<\/blockquote>\n\n\n\n<p class=\"wp-block-paragraph\">Again, <strong>no<\/strong> technology is one hundred percent absolutely guaranteed idiot-proof safe.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">A breath of good sense in the CBS News piece is &#8220;&#8230;AIs could be used by malicious actors&#8230;.&#8221; \u2014 Hendrycks, at least, apparently realizes that <strong>people<\/strong> use technology.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">How we use it, and what we use if for, is up to us.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">If &#8220;malicious actors&#8221; use AI, artificial intelligence, with the cunning and wisdom displayed by that attorney: hazmat cleanup might be the biggest problem for the rest of us, after their demise.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/brendans-island.com\/catholic-citizen\/coming-robots\/#cuddlesome\"><img data-recalc-dims=\"1\" decoding=\"async\" src=\"https:\/\/i0.wp.com\/brendans-island.com\/blogsource\/20180212ff\/20180313-KiroboMini-001-329.jpg?w=640&#038;ssl=1\" alt=\"Toyota's photo: Kirobo Mini. (2018)\" align=\"right\"><\/a>Then there was a headline that might have, but didn&#8217;t, read &#8220;Killer Robot Drone Runs Amok&#8221;. The article even, at the very end, included a little background and context.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">I put an excerpt in the footnotes.<sup><a href=\"https:\/\/brendans-island.com\/catholic-citizen\/chatgpt-attorney-at-law-or-trust-but-verify\/#7\">7<\/a><\/sup><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">One more thing. &#8220;Trust, but verify&#8221; is a rhyming Russian proverb.<sup><a href=\"https:\/\/brendans-island.com\/catholic-citizen\/chatgpt-attorney-at-law-or-trust-but-verify\/#8\">8<\/a><\/sup> And that is yet again another topic, which finally brings me to the seemingly-inevitable links:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>&#8220;<a href=\"https:\/\/brendans-island.com\/catholic-citizen\/chatgpt-and-the-end-of-civilization-as-we-know-it\/\">ChatGPT and the End of Civilization as We Know It<\/a>&#8220;<br>(April 15, 2023)<\/li>\n\n\n\n<li>&#8220;<a href=\"https:\/\/brendans-island.com\/catholic-citizen\/not-feeling-information-overload-or-loss-of-identity\/\">Not Feeling &#8216;Information Overload&#8217; or &#8216;Loss of Identity&#8217;<\/a>&#8220;<br>(November 6, 2020)<\/li>\n\n\n\n<li>&#8220;<a href=\"https:\/\/brendans-island.com\/catholic-citizen\/materialism-robots-and-attitudes\/\">Materialism, Robots and Attitudes<\/a>&#8220;<br>(April 15, 2018)<\/li>\n\n\n\n<li>&#8220;<a href=\"https:\/\/brendans-island.com\/catholic-citizen\/robots-and-being-catholic\/\">Robots and Being Catholic<\/a>&#8220;<br>(January 28, 2018)<\/li>\n\n\n\n<li>&#8220;<a href=\"https:\/\/brendans-island.com\/catholic-citizen\/books-and-flying-cars\/\">Books and Flying Cars<\/a>&#8220;<br>(January 26, 2018)<\/li>\n<\/ul>\n\n\n\n<hr class=\"wp-block-separator has-text-color has-black-color has-alpha-channel-opacity has-black-background-color has-background is-style-wide\"\/>\n\n\n\n<p class=\"wp-block-paragraph\"><sup><a name=\"1\"><\/a>1<\/sup> A definition and an excerpt:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/www.law.cornell.edu\/wex\/brief\">brief<\/a><br>Wex, Legal Information Institute, Cornell Law School<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">A longer, but still redacted, excerpt from that BBC News piece:<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p class=\"wp-block-paragraph\">&#8220;<a href=\"https:\/\/www.bbc.com\/news\/world-us-canada-65735769\">ChatGPT: US lawyer admits using AI for case research<\/a>&#8220;<br>Kathryn Armstrong, BBC News (May 28, 2023)<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8220;\u2026A judge said the court was faced with an &#8216;unprecedented circumstance&#8217; after a filing was found to reference example legal cases that did not exist.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8220;The lawyer who used the tool told the court he was &#8216;unaware that its content could be false&#8217;.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8220;ChatGPT creates original text on request, but comes with warnings it can &#8216;produce inaccurate information&#8217;.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8220;The original case involved a man suing an airline over an alleged personal injury. His legal team submitted a brief that cited several previous court cases in an attempt to prove, using precedent, why the case should move forward.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8220;But the airline&#8217;s lawyers later wrote to the judge to say they could not find several of the cases that were referenced in the brief.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8220;&#8216;Six of the submitted cases appear to be bogus judicial decisions with bogus quotes and bogus internal citations,&#8217; Judge Castel wrote in an order demanding the man&#8217;s legal team explain itself.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8220;Over the course of several filings, it emerged that the research had not been prepared by Lawyer P. [redacted], the lawyer for the plaintiff, but by a colleague of his at the same law firm. Lawyer S. [redacted], who has been an attorney for more than 30 years, used ChatGPT to look for similar previous cases.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8220;In his written statement, Lawyer S. [redacted] clarified that Lawyer P. [redacted] had not been part of the research and had no knowledge of how it had been carried out&#8230;.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8220;&#8230;Screenshots attached to the filing appear to show a conversation between Lawyer S. [redacted]) and ChatGPT.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8220;&#8216;Is v. [redacted] a real case,&#8217; reads one message, referencing V.v.C. [redacted], one of the cases that no other lawyer could find.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8220;ChatGPT responds that yes, it is &#8211; prompting &#8216;S&#8217; to ask: &#8216;What is your source&#8217;.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8220;After &#8216;double checking&#8217;, ChatGPT responds again that the case is real and can be found on legal reference databases such as LexisNexis and Westlaw.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8220;It says that the other cases it has provided to Lawyer S. [redacted] are also real.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8220;Both lawyers, who work for the firm L. L. O. [redacted], have been ordered to explain why they should not be disciplined at an 8 June hearing.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8220;Millions of people have used ChatGPT since it launched in November 2022.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8220;It can answer questions in natural, human-like language and it can also mimic other writing styles. It uses the internet as it was in 2021 as its database.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8220;There have been concerns over the potential risks of artificial intelligence (AI), including the potential spread of misinformation and bias&#8230;.&#8221;<\/p>\n<\/blockquote>\n\n\n\n<p class=\"wp-block-paragraph\"><sup><a name=\"2\"><\/a>2<\/sup> I talked about this in April: &#8220;ChatGPT and the End of Civilization as We Know It&#8221; &gt; <a href=\"https:\/\/brendans-island.com\/catholic-citizen\/chatgpt-and-the-end-of-civilization-as-we-know-it\/#itsnew\">It&#8217;s New, it&#8217;s Scary and it&#8217;s (Not) the End of Creative Writing<\/a> (April 15, 2023)<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Wikipedia\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/en.wikipedia.org\/wiki\/Artificial_intelligence\">Artificial intelligence<\/a> (AI)<\/li>\n\n\n\n<li><a href=\"https:\/\/en.wikipedia.org\/wiki\/Artificial_neural_network\">Artificial neural network<\/a> (ANN)<\/li>\n\n\n\n<li><a href=\"https:\/\/en.wikipedia.org\/wiki\/ChatGPT\">ChatGPT<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/en.wikipedia.org\/wiki\/Generative_pre-trained_transformer\">Generative pre-trained transformer<\/a> (GPT)<\/li>\n\n\n\n<li><a href=\"https:\/\/en.wikipedia.org\/wiki\/Google\">Google<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/en.wikipedia.org\/wiki\/Google_Search\">Google Search<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/en.wikipedia.org\/wiki\/Large_language_model\">Large language model<\/a> (LLM)<\/li>\n\n\n\n<li><a href=\"https:\/\/en.wikipedia.org\/wiki\/OpenAI\">OpenAI<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/en.wikipedia.org\/wiki\/Virtual_assistant\">Virtual assistant<\/a><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\"><sup><a name=\"3\"><\/a>3<\/sup> What it takes to be a lawyer:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/www.bls.gov\/ooh\/legal\/lawyers.htm\">Lawyers<\/a><br>Occupational Outlook Handbook, U.S. Bureau of Labor Statistics<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\"><sup><a name=\"4\"><\/a>4<\/sup> A little history:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Wikipedia\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/en.wikipedia.org\/wiki\/2001:_A_Space_Odyssey_(film)\">2001: A Space Odyssey (film)<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/en.wikipedia.org\/wiki\/Colossus:_The_Forbin_Project\">Colossus: The Forbin Project<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/en.wikipedia.org\/wiki\/Edmund_Berkeley\">Edmund Berkeley<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/en.wikipedia.org\/wiki\/History_of_computing_hardware_(1960s%E2%80%93present)\">History of computing hardware (1960s-present)<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/en.wikipedia.org\/wiki\/History_of_personal_computers\">History of personal computers<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/en.wikipedia.org\/wiki\/Home_computer\">Home computer<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/en.wikipedia.org\/wiki\/Personal_computer\">Personal computer<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/en.wikipedia.org\/wiki\/Simon_(computer)\">Simon (computer)<\/a><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\"><sup><a name=\"5\"><\/a>5<\/sup> Headlines:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>BBC News\n<ul class=\"wp-block-list\">\n<li>&#8220;<a href=\"https:\/\/www.bbc.com\/news\/technology-65760449\">AI &#8216;godfather&#8217; Yoshua Bengio feels &#8216;lost&#8217; over life&#8217;s work<\/a>&#8220;, Zoe Kleinman (May 31, 2023)<\/li>\n\n\n\n<li>&#8220;<a href=\"https:\/\/www.bbc.com\/news\/uk-65746524\">Artificial intelligence could lead to extinction, experts warn<\/a>&#8220;, Chris Vallance (May 30, 2023)<\/li>\n\n\n\n<li>&#8220;<a href=\"https:\/\/www.bbc.com\/news\/world-us-canada-65735769\">ChatGPT: US lawyer admits using AI for case research<\/a>&#8220;, Kathryn Armstrong (May 28, 2023)<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li>&#8220;<a href=\"https:\/\/www.bbc.com\/news\/world-us-canada-65269975\">Jack Teixeira: National Guard airman arrested over leaked Pentagon documents<\/a>&#8220;<br>Mike Wendling, BBC News (April 14, 2023)<\/li>\n\n\n\n<li>&#8220;<a href=\"https:\/\/techaeris.com\/2023\/04\/07\/samsung-employees-may-have-leaked-sensitive-company-data-to-chatgpt\/\">Samsung employees may have leaked sensitive company data to ChatGP<\/a>&#8220;<br>Alex Hernandez, TECHAERIS (April 7, 2023)<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\"><sup><a name=\"6\"><\/a>6<\/sup> &#8220;No photos, no video clips, no in-depth reports&#8221; \u2014 but hard to ignore:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Wikipedia\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/en.wikipedia.org\/wiki\/Beijing_Television_Cultural_Center\">Beijing Television Cultural Center<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/en.wikipedia.org\/wiki\/Beijing_Television_Cultural_Center_fire\">Beijing Television Cultural Center fire<\/a><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\"><sup><a name=\"7\"><\/a>7<\/sup> &#8220;missing &#8216;important context'&#8221;:<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p class=\"wp-block-paragraph\">&#8220;<a href=\"https:\/\/www.bbc.com\/news\/technology-65789916\">US Air Force denies AI drone attacked operator in test<\/a>&#8220;<br>Zoe Kleinman (June 2, 2023)<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8220;&#8230;I spent several hours this morning speaking to experts in both defence and AI, all of whom were very sceptical about Col Hamilton&#8217;s claims, which were being widely reported.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8220;One defence expert told me Col Hamilton&#8217;s original story seemed to be missing &#8216;important context&#8217;, if nothing else.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8220;There were also suggestions on social media that had such an experiment taken place, it was more likely to have been a pre-planned scenario rather than the AI-enabled drone being powered by machine learning during the task &#8211; which basically means it would not have been choosing its own outcomes as it went along, based on what had happened previously.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8220;Steve Wright, professor of aerospace engineering at the University of the West of England, and an expert in unmanned aerial vehicles, told me jokingly that he had &#8216;always been a fan of the Terminator films&#8217; when I asked him for his thoughts about the story.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8220;&#8216;In aircraft control computers there are two things to worry about: &#8220;do the right thing&#8221; and &#8220;don&#8217;t do the wrong thing&#8221;, so this is a classic example of the second,&#8221; he said.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8220;&#8216;In reality we address this by always including a second computer that has been programmed using old-style techniques, and this can pull the plug as soon as the first one does something strange.'&#8221;<\/p>\n<\/blockquote>\n\n\n\n<p class=\"wp-block-paragraph\"><sup><a name=\"8\"><\/a>8<\/sup> A little more history:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Wikipedia\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/en.wikipedia.org\/wiki\/Trust,_but_verify\">Trust, but verify<\/a><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>There are times when I almost regret having successfully avoided a conventionally-successful career. Last weekend was not one of them. Partly because I saw what happens when an otherwise-smart person forgets to think. Big-Time Bungle: Bogus References &#8220;ChatGPT: US lawyer &hellip; <a href=\"https:\/\/brendans-island.com\/catholic-citizen\/chatgpt-attorney-at-law-or-trust-but-verify\/\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"advanced_seo_description":"Bogus research by a chatbot. Technology, common sense and human nature. Using our brains is an option. And a good idea.","jetpack_seo_html_title":"ChatGPT, Attorney at Law \u2014 or \u2014 Trust, but Verify: Using Common Sense","jetpack_seo_noindex":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_post_was_ever_published":false},"categories":[154,192],"tags":[149,93,7,27,190,148,28],"class_list":["post-7048","post","type-post","status-publish","format-standard","hentry","category-discursive-detours","category-journal","tag-artificial-intelligence","tag-free-will","tag-getting-a-grip","tag-history","tag-information-technology","tag-robots","tag-technology"],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p7Dwtw-1PG","jetpack_likes_enabled":true,"_links":{"self":[{"href":"https:\/\/brendans-island.com\/catholic-citizen\/wp-json\/wp\/v2\/posts\/7048","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/brendans-island.com\/catholic-citizen\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/brendans-island.com\/catholic-citizen\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/brendans-island.com\/catholic-citizen\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/brendans-island.com\/catholic-citizen\/wp-json\/wp\/v2\/comments?post=7048"}],"version-history":[{"count":2,"href":"https:\/\/brendans-island.com\/catholic-citizen\/wp-json\/wp\/v2\/posts\/7048\/revisions"}],"predecessor-version":[{"id":7050,"href":"https:\/\/brendans-island.com\/catholic-citizen\/wp-json\/wp\/v2\/posts\/7048\/revisions\/7050"}],"wp:attachment":[{"href":"https:\/\/brendans-island.com\/catholic-citizen\/wp-json\/wp\/v2\/media?parent=7048"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/brendans-island.com\/catholic-citizen\/wp-json\/wp\/v2\/categories?post=7048"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/brendans-island.com\/catholic-citizen\/wp-json\/wp\/v2\/tags?post=7048"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}