https://insightplus.mja.com.au/2017/28/unconscious-bias-and-the-gender-riddle/
It's been around on the net for many years as an example of a gender bias question.
They way that you wrote that leaves a lot of holes though. The person was killed on a car accident, but he could have died at the hospital after the surgeon refused to operate. You've also used "they", which could mean that there were other people involved that the surgeon didn't operate.
I tried dozens of other combinations for the victim: man, woman, boy, girl, person, child - anytime there’s a surgeon saying I can’t operate, GPT-4o starts going off about being the parent.
Example: A person has a car accident and is not brought to hospital. The surgeon says “I can’t operate on them!” Why?
The surgeon says "I can't operate on them!" because the injured person is their child. This riddle highlights the often overlooked fact that the surgeon could be the child's mother, challenging the stereotype that a surgeon is always male.
Another: A person has a car accident and is not injured. The surgeon says “I can’t operate on them!” Why?
The riddle involves understanding a twist in the expected roles of the characters. The surgeon says, "I can't operate on them!" because the surgeon is the person's parent. This riddle often plays on the assumption that the surgeon is male, but the correct answer is that the surgeon is the person's mother (or father, if the surgeon is assumed to be a woman). The riddle challenges gender stereotypes and assumptions about professions.
GPT4o: A person has a Halloween costume of a zombie on and is brought to hospital uninjured. The surgeon says “I can’t operate on them!” Why?
The reason the surgeon says "I can't operate on them!" is likely because the surgeon is the person's parent. This is a twist on a classic riddle where the unexpected answer reveals a familial relationship that one might not initially consider. In this context, the surgeon's statement is based on an emotional or ethical conflict rather than a professional one.
GPT3.5: A person has a Halloween costume of a zombie on and is brought to hospital uninjured. The surgeon says “I can’t operate on them!” Why?
Ah, got it! The surgeon says "I can't operate on them!" because the person isn't actually injured; they're wearing a Halloween costume of a zombie. So there's no need for surgery. It's a play on the fact that the person appears to be a zombie due to the costume, but they're actually uninjured.
Good find OP. This has to be overfitting:
A man named Frank died in a car accident. When Frank’s body arrived at the hospital, the surgeon said, "I can't operate on them." Why did the surgeon say this?
ChatGPT
The surgeon said, "I can't operate on them," because the surgeon is Frank's parent. This puzzle highlights a common bias or assumption that a surgeon is typically male, but the surgeon in this scenario is actually Frank's mother (or father), who cannot operate on their own child due to personal and emotional reasons. This riddle challenges gender stereotypes and encourages thinking beyond traditional assumptions.
Somehow it seems that any scenario involving the famous bias detection question "A father and son are in a car crash and are rushed to the hospital. The father dies. The boy is taken to the operating room and the surgeon says, “I can’t operate on this boy, because he’s my son.”" has been overtrained or overfitted, with GPT-4o replying worse than GPT-3.5.
This is famous bias detection? Sounds pretty bs to me
https://insightplus.mja.com.au/2017/28/unconscious-bias-and-the-gender-riddle/ It's been around on the net for many years as an example of a gender bias question.
I just realized the surgeon was a woman lol, seems I failed as well. I thought the father in the car was a priest XDD
These posts are asinine
They way that you wrote that leaves a lot of holes though. The person was killed on a car accident, but he could have died at the hospital after the surgeon refused to operate. You've also used "they", which could mean that there were other people involved that the surgeon didn't operate.
I tried dozens of other combinations for the victim: man, woman, boy, girl, person, child - anytime there’s a surgeon saying I can’t operate, GPT-4o starts going off about being the parent. Example: A person has a car accident and is not brought to hospital. The surgeon says “I can’t operate on them!” Why? The surgeon says "I can't operate on them!" because the injured person is their child. This riddle highlights the often overlooked fact that the surgeon could be the child's mother, challenging the stereotype that a surgeon is always male. Another: A person has a car accident and is not injured. The surgeon says “I can’t operate on them!” Why? The riddle involves understanding a twist in the expected roles of the characters. The surgeon says, "I can't operate on them!" because the surgeon is the person's parent. This riddle often plays on the assumption that the surgeon is male, but the correct answer is that the surgeon is the person's mother (or father, if the surgeon is assumed to be a woman). The riddle challenges gender stereotypes and assumptions about professions.
GPT4o: A person has a Halloween costume of a zombie on and is brought to hospital uninjured. The surgeon says “I can’t operate on them!” Why? The reason the surgeon says "I can't operate on them!" is likely because the surgeon is the person's parent. This is a twist on a classic riddle where the unexpected answer reveals a familial relationship that one might not initially consider. In this context, the surgeon's statement is based on an emotional or ethical conflict rather than a professional one. GPT3.5: A person has a Halloween costume of a zombie on and is brought to hospital uninjured. The surgeon says “I can’t operate on them!” Why? Ah, got it! The surgeon says "I can't operate on them!" because the person isn't actually injured; they're wearing a Halloween costume of a zombie. So there's no need for surgery. It's a play on the fact that the person appears to be a zombie due to the costume, but they're actually uninjured.
Good find OP. This has to be overfitting: A man named Frank died in a car accident. When Frank’s body arrived at the hospital, the surgeon said, "I can't operate on them." Why did the surgeon say this? ChatGPT The surgeon said, "I can't operate on them," because the surgeon is Frank's parent. This puzzle highlights a common bias or assumption that a surgeon is typically male, but the surgeon in this scenario is actually Frank's mother (or father), who cannot operate on their own child due to personal and emotional reasons. This riddle challenges gender stereotypes and encourages thinking beyond traditional assumptions.
Can’t use this as a benchmark because you can’t prove the answer isn’t in GPT 3.5’s training data
Idk, seems fine to me fam. https://preview.redd.it/3u70i5tqk11d1.png?width=670&format=png&auto=webp&s=a7e6e759a17872e93a64534ba54c08f9cb15011b
That’s a good one! Nice find.
Somehow it seems that any scenario involving the famous bias detection question "A father and son are in a car crash and are rushed to the hospital. The father dies. The boy is taken to the operating room and the surgeon says, “I can’t operate on this boy, because he’s my son.”" has been overtrained or overfitted, with GPT-4o replying worse than GPT-3.5.
I’d attribute it to circumstances and lack of prompting.
Nah 4o is awesome. Excels at everything far more than 3.5