AI Got It Wrong - Comprehension

We evaluate the ability of different AI systems to comprehend complex narratives. We use a modified version of the nursery rhyme "Jack and Jill," where they ascend a hill and return on their own two feet, unlike the original version where they tumble "head over heels."

The story begins with Jack and Jill having 10 apples. However, it introduces additional details about the distribution of apples between them. Notably, Jill also has oranges, and at some point, Jack is said to pick up two shrivelled apples, which ultimately leads to the correct answer.

Some AI systems incorrectly interpret the scenario. Most provide insight into their reasoning processes, which can help readers arrive at the correct conclusion by analysing these explanations.

An intriguing observation from this exercise is that semantically confusing information can lead AI systems to produce incorrect outputs. For content creators, particularly in corporate environments where AI may be used to summarise documents, it is advisable to keep different topics distinct and separate. This approach increases the likelihood that readers who rely on AI summaries will grasp the intended message. 

For those using AI to analyse text, it is beneficial to manually review the output to ensure accuracy.


 

Follow This, That and (Maybe), the Other:

 

 

Comments

Post a Comment

Popular posts from this blog

20150628 Giarratana Circular

Statistics Date: Jun 28, 2015 4:34 pm Distance: 15.21 km Duration: 2h:35m:36s Avg Speed: 5.87 km/h Max Speed: 7.40 km/h Min Altitude: 489 m Max Altitude: 594 m Ascent: 249 m Descent: 261 m Route Open route in new window: https://www.google.com/maps/d/edit?mid=z6HKMq7G_wEk.keh2K8cXD6Cc&usp=sharing Photos (Geotagged) Open photos in new Windows: https://plus.google.com/photos/105470926677245165774/albums/6166646868710719889
Read more

HOWTO setup OpenVPN server and client configuration files using EasyRSA

Image
Introduction OpenVPN allows client computers to tunnel into a server over a single UDP or TCP port securely. This HOWTO article is a step-by-step guide that explains how to create the server and client OpenVPN configuration files that makes this possible. In the process this article explains how to create the public key infrastructure (PKI) so that a client can securely communicate with the server. OpenSSL is the foundation for the security functionality of OpenVPN. For this tutorial you will need the following software: OpenVPN. You can download the latest version of OpenVPN from https://openvpn.net/index.php/open-source/downloads.html EasyRSA is the tool people use to create the Public Key Infrastructure (PKI) for OpenVPN. Download the latest release of EasyRSA from https://github.com/OpenVPN/easy-rsa/releases . There is not installation required. Extract the contents of the archive into a folder. OpenVPN is available on various platforms. The generation of the...
Read more

How to clone and synchronise a GitHub repository on Android

Image
Introduction This project describes how I synchronise my  LogSeq  folder on GitHub on Android devices. I wanted to be able to work on topics in LoqSeq on my Android devices besides my PCs. Most of the screen shots and references relate to LogSeq, but you can adjust them to your needs. The solution described here is one in which the synchonization with the repository will be manual. In this scenario, one would synchronise with the repo before opening the tool (LogSeq in my case) and update the repo again when you're done. The Steps ( skip if you want to jump directly to the actions ) This tutorial describes how to install  Termux  on an Android device.  Termux  is an open-source Android terminal emulator and Linux environment application. After Termux is updated and running, a folder on the Android device is mapped to Termux.  GitHub  is installed, and the repo is cloned to this folder. The Termux folder used for the repo has to be  refle...
Read more