Transforming Big Data Information into Deep Data Insights
Yesterday I posted a question to several of the groups I belong to on LinkedIn. It was related to several of the things I’m interested and involved in: Systems Thinking, Knowledge Management, and Decision Modeling. It was somewhat informed, as well, by an article appearing in the Huffington Post, where Otto Scharmer, a Senior Lecturer at MIT and founder of the Presencing Institute, talks about the need to make sense of the huge and growing amounts of data we have available to us. He argues the importance of turning from “Big” data, where we mainly look outward in our attempt to understand what it is telling us about markets and our external influence, to “Deep” data, where we begin looking inward to understand what it’s telling us about ourselves and our organizations and how we get things done.
The question I asked was designed to seek out capabilities and functionality that people would like to have, but that is currently unavailable. My interests include working with others to understand and provide for those needs, if possible. I thought I would present the question here as well, where it will remain a part of my online presence and, hopefully, might elicit some useful responses. Here it is:
With the growing proliferation and importance of data — a development at least one author and MIT Lecturer has suggested is moving us from the information technology era to the data technology era — what tools would you like to see become available for handling, understanding, and sharing the new types of information and knowledge this development will bring?
In other words, what would you need that you don’t have today? What types of technology do you think would offer you, your colleagues, and your organizations a greater ability to make use of data to bring about a transformation from primarily siloed, outward looking data to collaborative, inward looking data as well?
I would love to hear of any ideas you might have regarding the kinds of tools or apps you could use to better deal with data by turning it into useful information and knowledge . . . perhaps even a smidgen of understanding and wisdom.
Making Sense of it All
My original intent for this blog was something far different than it’s become. I don’t think it’s a problem, as I seem to be morphing my approach into something that can easily accommodate that original intent. In case you aren’t aware of what I wanted to do when I began this little journey, I have described it somewhat here. I intend on updating that page periodically to keep up with the developments and changes as they occur (or, hopefully, shortly thereafter). This continues to be a work-in-process and I think that’s how I want it.
I have had a deep love and respect for the concept of Systems Thinking a good part of my adult life. As a young man I didn’t even know it was something people studied or wrote about; just that it seemed to be a useful way to look at the world and try to make sense of it. Recognizing the systemic nature of things and seeing the interrelationship (no matter how distant or tenuous) between them can, in my opinion, make them far more intelligible while increasing the odds of understanding consequences and why certain things happen.
Today I came across a wonderful article on Facebook from The Atlantic, through a post by John Hagel of the Deloitte Center for the Edge. I’m not “friends” with John, though I have sent him a request. In the meantime (and I assume he will likely ignore me) I do “subscribe” to his public updates. He shares some truly fascinating and interesting information.
The article is entitled “To Know, but Not Understand: David Weinberger on Science and Big Data” and he discusses and explains how the prolific growth of data, information, storage capabilities, and computing power is facilitating the understanding of large-scale or highly complex systems, despite their being beyond our ken as mere human beings. He points out that, despite our limitations as individuals to understand why some things work as they do, the growth of networked science is providing us with a capacity for making use of this data, information, and knowledge. I found it truly fascinating and want to share it here. If you have 10 – 15 minutes, I highly recommend you take the time to read it. Here’s the link.