This fabulous simple graphic from Jessica Hagy, courtesy of http://flowingdata.com, has initiated some very interesting discussion, both serious and humorous.
First, yours truly attempted some further illustration and logical discussion. This led to what follows.
As we collect information we quickly think we understand a thing and confusion goes to a minimum. After we get to a certain point, additional information tends to:
(1) Create overload;
(2) Start to accumulate contradictions;
(3) Suffer from loss of memory of information obtained early on.
This situation can be improved by keeping records and organizing the information. This results in a lessening of the rate at which confusion drops due to the distraction of the organization process. Because all the information remains more visible through organization, we never reach the low level of confusion of the first graph because selective filtering does not occur. This filtering allows the illusion of understanding by the selective use of information. But again this process reaches a minimum point in confusion, but not as low a level. When confusion starts to turn up due to information overload, organization keeps it from rising as quickly.
If we add analysis to the organized data, the drop in confusion is even slower as early on the data is too meager to give confidence to analytical results. The minimum in confusion comes later in this case, and at a higher level, because analysis tends to highlight what is not known quite effectively. As time and amount of information increase, more things become defined but never to the extent that they can completely overcome the increase in the unknowns discovered.
A summary of what I am saying would be that the more we know, in general, the more we discover we don’t know. Organization and analysis can reduce the confusion resulting from information overload, but will add to the identification of what is not known. Confusion with increasing information may go through a minimum, but the infinity of the unknown will never allow confusion to go below some preliminary low level and will force it to go higher.
The one exception comes with what we call breakthroughs. When Newton formulates the laws of motion or Schrodinger defines the wave equation or Crick and Watson discover the DNA helix, discontinuities occur where confusion drops spectacularly. But that drop is temporary and all the new frontiers opened up quickly expand the unknown. Confusion returns.
Next, when this was posted on my Seeking Alpha Instablog (link provided at end of this article) some very good comments were written. One is particularly humorous, and, at the same time, very insightful. It is written by a commenter known only to me as “Albertarocks”, a pseudonym. Here is what “Alberta…” had to say:
Ok, here’s a take from a guy who’s studied technical analysis for decades.
These charts are clearly a mirror into the human psyche. Although these masterpieces aren’t necessarily stunning in their complexity, they are indeed mind boggling in their revelations. At this point in time, there are more than 345 conclusions that can drawn, but I’ll try to narrow them down as much as possible in the short time allotted.
Ok, let’s get to work:
First of all, with no organization added to the available information, it is apparent that a person who has absolutely no information, known in most circles as “the dolt”, will perform exactly as well as the individual who has all the information. This type of personality is commonly referred to as the “know it all”. This phenomenon has been proven to be factual time after time, in various and numerous occupations throughout the lands and millennia.
A prime example of where this phenomenon is commonly encountered in the modern era is in the realm of stock market investing. It has been proven over many decades, and indisputably so, that a pairing of two individuals, the common “know it all” and the average every day “dolt”, will invariably result is a nearly identical financial performance through the course of a solitary calendar year. In most cases this has been proven to be a negative number for both individuals, although not necessarily so.
Strangely enough, in some pairings, their success can be measured in the hundreds of thousands of dollars to the plus side. However, with the given data, when we encounter an individual who boisterously reports that he has earned $250,000 in the past 10 months, we can not yet conclude whether he is a “know it all” or a common “dolt”, but we can assume he is one or the other. How do we come to that conclusion? By observing that he has dollar bills hanging out of his pockets and that his shoelace is untied, we know that he has not yet discovered organization.
By the process of elimination, and having surmised that the individual has not yet discovered organization, we can surmise conclusively that whichever category this individual would best fit into, we do know that he is totally confused.
Now, it is entirely possible, using the data gleaned from the charts, to discern whether or not an individual could possibly be a somewhat organized dolt or a completely disorganized know it all. However in order to gather that information, we would need to apply a MACD to the “confusion/information’ trendline. For that we would need the necessary numerical data inputs. However at the time of this writing, that data is unavailable.
It has also been shown that without any organization, many individuals show characteristics of both persona… somewhat akin to a hermaphroditic plant. This persona type is more commonly referred to as a “know it all fuckin’ dolt”. This type is found more often than would be expected in the profession of business journalism.
These charts also show, remarkably, that there is a point of optimum performance in the “confusion” aspect. That optimum invariably occurs when the individual has little or no information. A type of mindless nirvana, a form of complete bliss where the individual knows nothing and is not confused in any manner. They know nothing, yet have all the answers because they are not confused. These are what we call “teenagers”.
Due to limitations beyond my control, this analysis will now come to a conclusion. Given more time and space, it would indeed be fun to share with you the more incredible assumptions that can be drawn from these graphic presentations. Next time, we’ll go into the methods of discerning an individual’s place of birth and mother’s maiden name.
Oct 24 02:17 AM
Link to Instablog post and all comments: Information Overload