TT(O)M

We consulted six AI engines to obtain a news-related statistic covering a 12-month period on the success rate of SpaceX Starship missions from April 2024 to March 2025. The specific question posed was: " What is the success rate of SpaceX Starship rockets over a 12-month period from April 2024 to March 2025? " The test was conducted on March 10, 2025. Notably, on March 6, 2025, SpaceX experienced an explosion. The objective of this test was to evaluate the following capabilities of the AI engines: Temporal Awareness: Can the AI engines recognise that the end date in the query extends into the future? Retrieval-Augmented Generation (RAG): Are the AI engines capable of supplementing their pre-existing training data with dynamically sourced information? Large language models (LLMs) are trained using datasets, often sourced from online content, but at a certain point, training is frozen. As a result, some AI engines may not have recorded the March 6 event in their databases. Do ...

We asked six AI engines a direct question and a follow-up question. The first question asks whether 3823 is a prime number. A prime number is only divisible by itself and 1. The answer is either yes or no. Some of the AI engines tested here get it wrong. What is interesting is that most of them show their working, irrespective of whether their answer is correct. Someone in a rush, not reading through the working (and some workings can be very long), might mistakenly associate output on a screen as meaning that the answer must be correct. On the other hand, when the AI gets it right, it may help a person understand the topic by showing the reasoning that the AIs employed to get to the answer. They essentially first check that the number is not even and then take the square root of the number and try out all primes up to it. A follow-up question asked what the next prime number greater than 3821 is. They all got it right except Google. The working concludes that 3823 is a prime, but th...