The Promise of Open Risk Data

There is a legend that every time a data set is released into the open, somewhere dies a black swan

The Promise of Open Risk Data

Well, it is not a true legend. Legends take centuries of oral storytelling to form. In our frantic age, dominated by the daily news cycle and viral twitter storms, legends have been replaced by the rather more short-lived “memes” and #hashtags.

Black Swans need no introductions

The whole informal theory of black swans concerns improbable events (low likelihood events) that come as a nasty surprise and have large impact. The concept took the world by storm after the financial crisis and there are certainly more than a few nuggets of truth in it. Yet in terms of capturing the factors behind recurrent risk management disasters, black swan theory might be less relevant for many of the most typical financial / economy related events.

There are always “irreducible”, unknown-unknowns that can hit the financial system with a-priory unknown probabilities and impact. But a much more actionable issue is, much more often than not, the knowable-but-unknown unknowns.

Knowable but not known

When a risk factor is knowable but not actually known, it means the risk was potentially preventable with the right information. For example:

  • The Enron style collapse of a blue chip company was not a black swan, it was accounting fraud (false information)
  • The Lehman Brothers style collapse of financial services intermediary was not a black swan, it was excessive and under-reported risk taking (missing and/or ignored information)
  • The collapse of liquidity in securitisation markets was not a black swan, it was investors realizing they actually had very limited information about their positions (missing and/or false information)
  • The Greek style sudden default of a sovereign was not a black swan, it followed creative obfuscation of public finances (false information)
  • The bursting of a speculative real estate bubble is not a black swan. It is the re-assertion of housing market fundamentals that are usually available for all to see (ignored information)

In all these examples (and the list can go on and on…) the risk factor is not a mystery at all. Or rather, it is a manufactured mystery, namely

People, intentionally or unintentionally, hide, falsify or ignore, information produced by other people

Understandably it is more comforting to invoke mysterious black swans to explain information management failure and this has been part of the allure of the black swan meme. But the more appropriate label for these recurring financial “accidents” would be

“black swans of our own design”

Yet just as easily as the creation of black boxes increases the possibility of manufactured black swans, so does the production and/or dissemination (opening up) of relevant information reduce the likelihood of painful, self-inflicted, surprises. You can almost picture information as a potent solvent that turns black swans into white:


Now obviously not all information can be open! But between the extreme boundaries of “full transparency and disclosure” on the one hand and information trickling out only on a “need-to-know basis” on the other, lies a Goldilocks regime of fewer manufactured black swans.

It is entirely our collective choice where to balance the closed versus open information scale, and thus how many black swans to nurture

In practice the mitigating action is to ensure the widespread availability of good information that is relevant for risk management. There is a global movement for creating good data sets, in particular from the official sector, called Open Data. We need similarly a sub-category of data relevant for risk management, namely Open Risk Data.

Interested in the Open Risk Data concept? Check out the latest collection of relevant data sets in the Risk Manual