Measuring results to motivate desired outcomes can generate
unintended consequences and perverse incentives.
This is the basic idea behind Goodhart’s Law:
“When a measure becomes a target,
it is no longer a good measure.”
The idea here is that once we make a measurable goal to
evaluate a more complicated process, people try to optimize for the specific
goal, which often undermines the actual larger objective. So schools end up “teaching to the test,”
scientists start “p-hacking,”
academics form citation cartels to bolster their citation scores,
and effective altruists end up choosing projects based not-so-much on
maximizing good, but maximizing measurable benefit.
It should not surprise us that tying performance to
extrinsic motivators, attracts extrinsic motivation.
But much of the most-difficult value added to the world is intrinsically
motivated. And intrinsic motivation, is
cultivated in human-scale, character-forming communities.
I think a lot about Goodhart’s law.
I simultaneously try to utilize it and resist it. I try to produce units of value for people
who fund my work
that are easily measured. But I also
actively resist the tyranny of measurement and try to carefully add unmeasurable value to my organizations and communities, because those intrinsic
investments keep institutions and communities healthy. And frankly, the former gives me capital for
the latter.
But I was recently on a podcast
about the Christological themes of the Hebrew Scriptures, and suddenly found
myself citing Goodart’s Law in that conversation. I was probably as surprised as my
conversation partners. It was a new idea
for me and I was working it out in real time. So I wanted to give it a little more careful
treatment here.
So here’s the question I was responding to:
Why do Christological prophecies sometimes seem a little
vague?
This is a common and legitimate knock against any sort of
prediction.
If you keep it vague, multiple futures can fulfill it.
This was the objection I raised with my friends in Junior
High School when they told me that Nostradamus had predicted the immanent end
of the world and had a great track record of predicting historical events. And I join my 8th grade self in
acknowledging this liability of ancient and even Biblical prophecy.
The specificity of the Messianic themes in the Hebrew
Scriptures are one of their defining qualities.
The Messiah will be a prophet-king-priest
that comes from David’s family who will somehow suffer redemptively for God’s
people
but also transcend that suffering as a cosmic figure who receives worship
and everlasting dominion. This is a
paradoxical character that is both defeated and victorious, terrestrial and
transcendent, primate and deity.
The degree of difficulty here is outrageous. The messianic themes are so diverse and impose
so many, seemingly contradictory constraints on this future servant-sovereign,
that it would be very difficult to imagine one individual embodying them
all.
The degree of difficulty to qualify as messiah is really
high here…which is really important.
You see, these themes were so clear in the Hebrew tradition
that there were a bunch of dudes claiming to be the Messiah. And this is where Goodhard’s Law comes
in.
Prophetic detail can be surprisingly unhelpful in validating
prophecy.
Or to restate Goodhart’s Law for ancient prophecy:
“Attainable detail in a prophecy
makes a poor metric for evaluating that prophecy’s fulfillment.”
If the ancient poems laid out a lot of situational details
identifying the Messiah, you can believe that aspiring Messiah’s would craft
their personal narratives and ret-con their biographies to check those boxes.
So the mundane technical detail that we think we want from
ancient prophecy to make it more evidential
are not as valuable as they seem. What
makes ancient prophecy more convincing is a paradoxical degree of
difficulty.
A prophetic tradition with an outrageous degree of
difficulty, that places its validating criteria on the level of big paradoxical
claims, rather than a checklist of specific claims that become vulnerable to
Goodhart’s Law.
In light of the Goodhart-ian failure mode, the level of
specificity of the Christological prophetic tradition might be closer to optimal
than it might seem.
This post was written to the Run
River North channel on Pandora.