Transforming Big Data Information into Deep Data Insights
Yesterday I posted a question to several of the groups I belong to on LinkedIn. It was related to several of the things I’m interested and involved in: Systems Thinking, Knowledge Management, and Decision Modeling. It was somewhat informed, as well, by an article appearing in the Huffington Post, where Otto Scharmer, a Senior Lecturer at MIT and founder of the Presencing Institute, talks about the need to make sense of the huge and growing amounts of data we have available to us. He argues the importance of turning from “Big” data, where we mainly look outward in our attempt to understand what it is telling us about markets and our external influence, to “Deep” data, where we begin looking inward to understand what it’s telling us about ourselves and our organizations and how we get things done.
The question I asked was designed to seek out capabilities and functionality that people would like to have, but that is currently unavailable. My interests include working with others to understand and provide for those needs, if possible. I thought I would present the question here as well, where it will remain a part of my online presence and, hopefully, might elicit some useful responses. Here it is:
With the growing proliferation and importance of data — a development at least one author and MIT Lecturer has suggested is moving us from the information technology era to the data technology era — what tools would you like to see become available for handling, understanding, and sharing the new types of information and knowledge this development will bring?
In other words, what would you need that you don’t have today? What types of technology do you think would offer you, your colleagues, and your organizations a greater ability to make use of data to bring about a transformation from primarily siloed, outward looking data to collaborative, inward looking data as well?
I would love to hear of any ideas you might have regarding the kinds of tools or apps you could use to better deal with data by turning it into useful information and knowledge . . . perhaps even a smidgen of understanding and wisdom.
I’m not in the habit of reviewing books, but I have a special interest in this one, not merely because I played a role in its production, but because of what the book means to us culturally and economically. What follows is the review I posted on Amazon.
I have long been enamored of the concept of Systems Thinking, which holds (among other things) that systems cannot be understood absent their context, the interrelationships of components within each system and with other systems of which they are a part (or are a part of them). In my career I have often heard it said “context is king.” I am predisposed to look for the contextual interrelationships in all things I attempt to understand.
It was nearly a year ago when Shel Israel posted a request for help on Facebook. He was looking for people who could serve as fact-checkers for his and Robert Scoble‘s new book. At the time, I responded and suggested I could serve as his proofreader. He accepted. Thus began a wonderful adventure. Soon I was proofing Shel’s columns in Forbes (q.v.) under the general title “The Social Beat”. Most of them were portions of what would become the chapters of this book “Age of Context”.
Since that time, I have proofed nearly every column he’s written related to the book, as well as each chapter that ultimately became this wonderful book. I also outlined at least six of the chapters for the authors to use in interviews and at speaking engagements and, toward the end, ended up checking each hyperlink and compiling them into a single document.
I bring all this up in part to reveal what surely has the appearance of a conflict of interest in my recommending you purchase and read this book. However, the greater part of what I’m revealing is how thoroughly it moved and excited me. I will admit to being a techno-geek, and I am naturally drawn to shiny new things. I am somewhat prejudiced. However, Robert and Shel have carefully scoured the tech world and now present their findings and conclusions, and many of them should fairly knock your socks off. I can’t tell you how many times I practically came out of my seat as I was reading about their discoveries. It made it hard at times to do my job. Frequently, I wanted to add my own comments to what they were explaining. I somehow managed to contain my excitement. It’s their book, after all.
In “Age of Context” you will find dozens and dozens of applications and approaches that seek to more completely understand, and integrate into, various aspects of our lives. Whether in the home, at work, or at play; whether in their approach to health, recreation, designing and building cities, or marketing product intelligently, Robert and Shel bring together (put into context, if you will) what these developments mean and how they can — and most likely will — improve our lives. They also recognize, and in no way gloss over, the important issues of privacy and safety many of these developments raise.
Yes, I am somewhat prejudiced. However, I feel quite safe in saying this is an important book. I don’t care for the term “futurist”, but I’d like to think I can recognize some of the next big things. There are a lot of them in this book. You owe it to yourself to understand the coming storm of innovation and change the authors so presciently offer.
Below is a Slideshare presentation posted by a friend who is in the process of authoring a new book entitled “The Age of Context”. He’s presenting it today at the Big 3 Conference in San Francisco, where he is one of the keynote speakers. It’s quite high level and somewhat simplistic at this point, but you should be able to get an idea of the direction the book will be taking.
I have long believed we humans are on the road to becoming a race of cyborgs. Nothing that’s happened in the last quarter century has served to dissuade me from this belief, either. At the rate we’re developing and making use of prostheses, and with continuing advancements in Fetal surgery and in utero cardiac procedures, it’s only a matter of time (100 years? 1000 years?) before most humans will have some sort of inorganic component attached or implanted.
I haven’t thought much about this lately, being content to watch as we meandered down this path. However, recently I was made aware that a couple of social media “friends” of mine were writing a book discussing another aspect of this inevitable evolutionary route we’re on. Their current working title is The Age of Context and I am really glad they’re writing it.
What they’re talking about is the newest developments in the fields of mobile technologies, wearable computers, sensing and mapping capabilities, big data residing in “the cloud”, and the apps and services that bring them together. I believe they’re truly on to something.
The book likely won’t be available until sometime next year. However, one of the authors (they are Shel Israel and Robert Scoble) has put together a simple Slideshare presentation that gives some hints of the direction they’re heading in. Since the presentation is available, I thought I would share it to give you a taste of what they’re seeing and thinking. I am hopeful I’ll have a lot more to say about the subject as time goes on. Suffice it to say I’m very excited about their thoughts, including how they mesh with and supplement those I’ve had for several decades now.
Disclosure: At the request for assistance by the authors, I offered to proofread the manuscript for them and they agreed. Here is how Shel tweeted about it a couple of weeks ago.
@RickLadd has just volunteered to be the world's most overqualified proofreader for Age of Context. Thanks Rick.
My original intent for this blog was something far different than it’s become. I don’t think it’s a problem, as I seem to be morphing my approach into something that can easily accommodate that original intent. In case you aren’t aware of what I wanted to do when I began this little journey, I have described it somewhat here. I intend on updating that page periodically to keep up with the developments and changes as they occur (or, hopefully, shortly thereafter). This continues to be a work-in-process and I think that’s how I want it.
I have had a deep love and respect for the concept of Systems Thinking a good part of my adult life. As a young man I didn’t even know it was something people studied or wrote about; just that it seemed to be a useful way to look at the world and try to make sense of it. Recognizing the systemic nature of things and seeing the interrelationship (no matter how distant or tenuous) between them can, in my opinion, make them far more intelligible while increasing the odds of understanding consequences and why certain things happen.
Today I came across a wonderful article on Facebook from The Atlantic, through a post by John Hagel of the Deloitte Center for the Edge. I’m not “friends” with John, though I have sent him a request. In the meantime (and I assume he will likely ignore me) I do “subscribe” to his public updates. He shares some truly fascinating and interesting information.
The article is entitled “To Know, but Not Understand: David Weinberger on Science and Big Data” and he discusses and explains how the prolific growth of data, information, storage capabilities, and computing power is facilitating the understanding of large-scale or highly complex systems, despite their being beyond our ken as mere human beings. He points out that, despite our limitations as individuals to understand why some things work as they do, the growth of networked science is providing us with a capacity for making use of this data, information, and knowledge. I found it truly fascinating and want to share it here. If you have 10 – 15 minutes, I highly recommend you take the time to read it. Here’s the link.
Since my retirement from Pratt & Whitney Rocketdyne in 2010, I have spent quite a bit of energy on developing work as a social media marketer for small business, a business manager for an AI software development firm, and as an editor/proofreader for a number of business books and a couple of novels, as well as a two-year return engagement at Rocketdyne from 2015 to 2017.
I have decided to stop actively pursuing business in these fields and am now positioning myself to be a writer. I have done quite a bit of writing over the years, but I’ve never really attempted to make any money at it; at least not specifically. I’m starting out with a couple of memoirs and, currently, I’m studying the craft, creating a detailed outline and timeline, and honing my skills as a storyteller. Pretty sure I’ll be writing some fiction as well.
The views expressed herein are those of the author. Any opinions regarding the value or worth of particular business processes, tools, or procedures, whether at his former place of employment, at a current client's enterprise, or in general, are his responsibility alone.