Leo fails the Sybok test. Again

As a trivia question for the Leo Premium models, I ask about Sybok, Spock’s brother. Claude Instant fails the “Who was his mother” question at Leo launch and I go down a thumbs up/thumbs down retraining rabbit hole. Now here’s Mixtral adding any female family member of Spock’s that it can guess at.

Brave Summariser on the other hand goes deep and pulls up a reference to the published Star Trek V movie novel and a name that I didn’t know about.

If we could close the gap between Leo and Summariser that would be great.

hmm, which model is summarizer using? (it probably has a custom prompt directing it to give more concise answers.)

Claude was just upgraded, BtW