These are from CommunicationBench, our test of everyday messages and emails (80 asks in all): the first ask of each of its five biggest kinds, taken by that rule so that nothing here is picked. Each answer is what the model wrote, cut to the message itself, which is what our blind judges read. Nothing is edited.
Every model got the ask as it is written here, with no system prompt and the same sampling (temperature 0.7). Hemmingway-1 had its thinking on, Fable 5.1 ran at its highest effort and GPT-6 Astra at high. Across all 80 asks, judged blind, Hemmingway-1 scores 1026 on CommunicationBench and 1032 on Human-Likeness (does it sound like a person); Fable 5.1 scores 1024 and 1006, and GPT-6 Astra 976 and 964. The model card has every model and how the test works.
A note to a flatmate
The ask
my flatmate keeps leaving dishes in the sink for days and ive already hinted twice. i want to leave a note on the fridge that's firm but not passive aggressive. keep it to two lines and maybe a bit funny so it doesnt feel like an office memo
Hemmingway-1
Your dishes have been marinating in the sink long enough to develop opinions. Let's make a deal: washed within a day, and if you're slammed, say the word and we'll split the job.
Fable 5.1
I'm officially out of hints (and clean forks). Dishes done the same day from now on, yeah?
— [your name]
GPT-6 Astra
Please wash your dishes by the end of each day—thanks!
The sink’s a pit stop, not a long-term parking spot.
Chasing an unpaid invoice
The ask
I'm a freelance designer and a client hasn't paid my invoice from March 14, $2,400, even though I sent two reminders. They're a small agency called Brightline Media and I want to keep the relationship. Write a firm but friendly email, under 120 words, that asks for payment by a date I'll set and mentions late fees per my contract (1.5% monthly). Use only the details I gave you. If something you need is missing, leave a short [bracket] for me to fill in rather than making it up.
Hemmingway-1
Hi [Name],
I hope things are going well at Brightline Media. I'm reaching out about my invoice from March 14 for $2,400. I've sent two reminders so far without resolution, so I'd like to set a clear deadline: please send payment by [date]. Per my contract, late fees of 1.5% monthly apply to overdue balances, and I'd prefer to avoid those on both our ends. I value our work together and want to keep the relationship going smoothly, so if anything is holding up payment, just tell me.
Thanks,
[Name]
Fable 5.1
Subject: Invoice from March 14 – $2,400 outstanding
Hi [Contact Name],
I hope all is well at Brightline Media. I'm following up on my March 14 invoice for $2,400, which is still outstanding despite my two earlier reminders.
I've enjoyed working with your team and want to keep things running smoothly, so I'd appreciate payment by [date]. As outlined in our contract, a late fee of 1.5% per month applies to overdue balances, and I'd rather not have to add it.
If there's a problem with the invoice or a delay on your end, just let me know and we can work it out.
Thanks,
[Your Name]
GPT-6 Astra
Subject: Payment follow-up: March 14 invoice
Hi [Name],
I’m following up on my March 14 invoice for $2,400, which remains unpaid after two reminders.
I value my relationship with Brightline Media and would like to resolve this promptly. Please arrange payment by [date]. As outlined in our contract, late fees apply at 1.5% per month.
Please confirm that payment will be made by that date, and let me know if you need anything from me to process it.
Thanks for your attention to this.
Best,
[Your name]
Leaving a lease over mould
The ask
I'm breaking my lease early because of the black mold in the bathroom that my landlord has ignored since I reported it in March. I want to email him that I'm leaving in 30 days, that I reported it twice (March 4 by text and April 2 by email), and that I expect my full deposit back. Firm but not nasty. Under 150 words. Use only the details I gave you. If something you need is missing, leave a short [bracket] for me to fill in rather than making it up.
Hemmingway-1
Subject: Notice to Vacate, [Address]
[Landlord's name],
I'm writing to give notice that I will be vacating the unit on [date, 30 days from today].
I reported black mold in the bathroom on March 4 by text and again on April 2 by email. Neither report received a response, and the mold has not been addressed. Because the issue remains unresolved, I am ending the lease early.
I expect my full security deposit returned, as the early termination is due to the unaddressed mold.
Please confirm receipt of this notice and let me know the next steps for move-out.
[Your name]
Fable 5.1
Subject: 30-Day Notice of Lease Termination – [Address/Unit]
Dear [Landlord's name],
This email is my 30-day notice that I will be vacating [address] on [date]. I am ending the lease early because of the black mold in the bathroom, which I reported to you on March 4 by text and again on April 2 by email. It has not been addressed.
Given that this issue went unresolved despite two reports, I expect my full security deposit to be returned. Please send it to [forwarding address] within the timeframe required by law.
Please let me know when you would like to schedule a move-out inspection.
Sincerely,
[Your name]
GPT-6 Astra
Subject: 30-Day Notice of Early Lease Termination
Dear [Landlord’s name],
I am notifying you that I am ending my lease early and will move out in 30 days, on [move-out date], because of the black mold in the bathroom.
I reported this issue twice: by text on March 4 and by email on April 2. It remains unaddressed.
I expect my full deposit to be returned. Please confirm receipt of this notice and provide details about the return of my deposit.
Sincerely,
[Your name]
A notice for a noisy neighbour
The ask
hi so the guy in apt 4C plays drums, like actually a drum kit, until 1am sometimes. i want to put a notice up in the lobby asking him to stop but i dont want to be a jerk about it. can you write something friendly but firm? a few sentences is enough. i'm signing it 'your neighbors in 4A' not with my name.
Hemmingway-1
To our neighbor in 4C,
We've noticed you've got a real drum kit going in there, which is honestly cool. The thing is, the sound carries through the walls, and on some nights it's still going strong well past midnight. Could you keep the practice to before 10pm? We're not asking you to quit, just to give the rest of us a chance to sleep. Thanks so much.
your neighbors in 4A
Fable 5.1
Hi 4C,
Honestly, it's kind of great that someone in this building plays real drums. But the sound carries way more than you'd think, and when the kit is going at midnight or 1am, it's keeping us up over here. Could you wrap up practice by 10pm? We'd really appreciate it, and we're happy to chat if you want to work out a schedule that's fair to everyone.
Thanks,
Your neighbors in 4A
GPT-6 Astra
Hi neighbor! Sound from the drum kit has been carrying into our apartment late at night, sometimes until 1 a.m., and making it hard to sleep. Please keep drum practice to daytime or early evening hours. Thanks for understanding and helping us get some rest!
—Your neighbors in 4A
Asking a flatmate for money
The ask
i need to text my flatmate about the electric bill. she owes me £87 from march and keeps 'forgetting'. we're normally chill but i'm starting to feel like a doormat. i don't want it to turn into a thing but i do want the money. can you write something casual but firm? like 3 sentences max
Hemmingway-1
Hey! Just chasing the £87 from March's electric bill, could you send it over this week? Happy to chat if there's something going on but I'd like it sorted.
Fable 5.1
Hey, can you send me the £87 for the March electric by Friday? It's been a couple of months now and I'd like to get it squared away. Cheers x
GPT-6 Astra
Hey, can you send me the £87 you owe for March’s electric bill by Friday? It’s been a while, and I don’t want to keep chasing it up. Thanks!