An excellent example of why this straightforward bias paradigm fails, and is kind of obvious nonsense reflecting deep and embarrassing thinking errors on the part of the perpetrators, is to look at something like the "pound of feathers" trick. Many people treated it as a great advance suggestive of really profound progress when the model…
An excellent example of why this straightforward bias paradigm fails, and is kind of obvious nonsense reflecting deep and embarrassing thinking errors on the part of the perpetrators, is to look at something like the "pound of feathers" trick. Many people treated it as a great advance suggestive of really profound progress when the models stopped answering "A pound of lead is heavier than a pound of feathers" and started answering like an A student. But they never thought to ask the machine whether a pound of lead is heavier than a *kilogram* of feathers. Quite simply, the machine has been trained on both American and European examples of the paradox and has basically no concept of what words mean, so it babbles absurdly about how kilograms and pounds are different units of weight and therefore the same. And yet they never thought to test it because they don't understand simple confirmation bias.
An excellent example of why this straightforward bias paradigm fails, and is kind of obvious nonsense reflecting deep and embarrassing thinking errors on the part of the perpetrators, is to look at something like the "pound of feathers" trick. Many people treated it as a great advance suggestive of really profound progress when the models stopped answering "A pound of lead is heavier than a pound of feathers" and started answering like an A student. But they never thought to ask the machine whether a pound of lead is heavier than a *kilogram* of feathers. Quite simply, the machine has been trained on both American and European examples of the paradox and has basically no concept of what words mean, so it babbles absurdly about how kilograms and pounds are different units of weight and therefore the same. And yet they never thought to test it because they don't understand simple confirmation bias.