What Is Goodhart’s Law?

Goodhart’s Law states that individuals can anticipate the effects of a given policy when evaluating the outcome of its actions and then manipulate the policy.

When the focus is set in only a single measure, people will optimize that single measure.

A good example is the so-called “Cobra Effect”. In India, the government offered money in exchange for each dead Cobra that was turned in, to reduce the abundance of loose cobra snakes on the Indian streets. At first, the policy seemed to be successful: people killed loose cobra snakes for the reward.

But after some successful time, people began to house breed cobras and hand them to the government to receive the bounty.

After the government became aware of this strategy, they decided to scrap the cobra bounty program. Guess what happened: people released cobras free. Suddenly, the number of loose cobras on the street increased: the government policy failed!

What does this teach us?: When an optimization measure is set, people can manipulate it to meet the target.

Goodhart’s Law declares that when a measure becomes the target, it ceases to be a good measure.

Charles Goodhart was a British economist born in 1936. He was a member of the Bank of England’s Monetary Policy Committee and professor at the London School of Economics. The idea of Goodhart’s Law was first advanced in a 1975 paper. That paper was later used to criticize the monetary policy of the government of Margaret Thatcher.

The original formulation of Goodhart, made in 1975, was: Any observed statistical regularity will tend to collapse once pressure is placed upon it for control purposes.

Goodhart’s Law and related ideas are used in many areas of economics. The Law it’s implied by the idea of rational expectations: people are aware of the implications of its actions and act according to them.

Goodhart’s Law has been beautifully formulated by Jón Danı́elsson (an economist teaching at the London School of Economics): Any statistical relationship will break down when used for policy purposes.

Examples of Goodhart’s Law

  • Search Engine Optimization: For many years, Google used a system called PageRank to sort its search results. PageRank used the number of backlinks each webpage had as a strong proxy of its quality. Webmasters started to implement several tactics to increase the number of backlinks, instead of increasing the quality of the content. For example, they exchanged backlinks with each other or built (Backlinks Farms). Google modified its search results sorting algorithm to overcome Goodhart’s Law. Many aspects of the current system are not made public, to avoid Goodhart’s Law.
  • Sales targets: Many businesses set sales targets to increase the productivity of salespeople. For example, a car salesman needs to sell 20 cars per month to receive a bonus payment. At the end of the month, they will make a lot of phone calls and usually offer discounts or perks to reach the 20 cars target. This strategy may be detrimental to the business if the discounts reduce profits.
  • Coupons strategy: When companies regularly offer discount coupons, people can delay purchases to get future discounts.
  • Company perks: many startups offer nice perks to attract star employees. But maybe perks attract only employees interested in perks and not necessarily the best employees.
  • Call centers: Many call centers set average call time targets, like three minutes per call. This policy can be detrimental to the quality of services: many customer support specialists can be unhelpful to people to reduce the average time per call.
  • School and university notes: As a proxy for quality learning, students memorize for test grades instead of actually deep learning the content.
  • Research papers in the academic world: Researchers are eager to get their papers published because the quantity of published research is usually used as a proxy for academic productivity. But this has lead to many scientists manipulating the data to achieve statistical significance, for example, by using data subsets. This has lead to the bias of the publication to provide only impressive results, while many papers on the same subject that didn’t achieve statistical significance were not published.

Implications in Data Analysis

When a model based on past data is deployed to the real world, people may start altering their behavior. This could invalidate the model. In Data Science, Goodhart’s Law can also be expressed as follows: “the behavior may change because of the models’ presence”.

We can test for the presence of Goodhart’s Law using time series and comparing the model fit before and after the implementation of the model.

How to Overcome the Goodhart’s Law?

The first option is to use better measurements. Measurements that take multiple factors into consideration.

In cases where the rewards do not need to be explicitly communicated, agents will not have the proxy to optimize. They will use human discretion and try to optimize the overall outcome based on their common sense.

Avoiding large groups and hierarchies can also avoid the need for the introduction of targets or KPIs. Small groups will naturally take into account many indicators as a measure of success.

Breaking Down the Goodhart’s Law

Goodhart’s Law is present in many scientific and business fields. Scientists, policymakers, and business managers need to be aware of the Law and avoid falling into the trap of using a single KPI (Key Performance Indicator) as a measure for success.

About the Author: Federico Anzil is an economist and analyst.

Source: https://economicpoint.com/goodharts-law

Recent Studies Fundamentally Change The COVID Narrative

Professor Sucharit Bhakdi has trained over 12,000 Doctors in microbiology and epidemiology in Germany and has won many awards. He explains the immune system and the recent peer-reviewed study results that fundamentally change the Covid narrative. Once you see how they work, you’ll want to share his warnings against taking the SARS-CoV-2 injections.

This not only makes vaccination unnecessary but re-vaccination potentially life-threatening.

Links to papers summarized in the video:

Fixing California – A Nine-Part Series In American Greatness

On June 30, 2021, Edward Ring published his first of nine articles on “Fixing California” on the Conservative American Greatness website, titled “The Themes That Make America Great.

Edward Ring is a contributing editor and senior fellow with the California Policy Center, which he co-founded in 2013 and served as its first president. He is also a senior fellow with the Center for American Greatness, and a regular contributor to the California Globe. His work has also appeared in the Los Angeles Times, the Wall Street Journal, the Economist, Forbes, and other media outlets. Ring’s undergraduate degree is in Political Science from UC Davis, and he has an MBA in Finance from USC.

I urge you to read them as time permits. Links to these very informative articles are provided below:

  1. The Themes That Make Anything Possible – Optimism, which the Golden State’s ruling class has abandoned, is nonetheless in California’s cultural DNA.
  2. The Electric AgeAffordable, abundant, sustainable energy is a realistic, moral choice. It is an example California can set that the aspiring nations of the world will emulate instead of resist.
  3. Achieving Water Abundance –  Environmental considerations should not preclude the state from launching new projects that increase the Golden State’s annual supply of water. Conservation is simply not enough.
  4. The Transportation Revolution – Spending precious government funds on light rail that nobody wants to ride is a fool’s errand. Declaring war on the car is shortsighted cruelty. We can do so much more.
  5. How to Make Housing Affordable AgainIt is possible for ordinary Californians to be able to realize the dream of homeownership in upgraded, modern, glorious, sprawling, glittering cities, and suburbs.
  6. Finding Homes for the Homeless and Cleaning Up the StreetsCompassion, properly tempered with common sense, and properly balanced with the other fundamental moral values, may seem harsh, but the results are what matter, not the rhetoric.
  7. Seeing the Forests for the TreesThe Golden State’s ruling elites may prove they care about the environment by sitting down with representatives from California’s timber, biomass energy, and cattle industries.
  8. Restoring Quality Education  – Government unions, government contractors, powerful nonprofits, monopolistic corporations, and Big Tech companies rely on a thoroughly indoctrinated electorate to support their dysfunction.
  9. The Prosperity EconomyTo change hearts, facts are useless without the power of optimism, the belief that abundance is possible, and the suggestion that ideology matters, but sometimes practical solutions matter more.