“Moving data to the cloud can help you optimize your infrastructure, but the bigger value is in leveraging the compute power and data services in the cloud,” remarked Komprise co-founder and COO Krishna Subramanian in our second Cloud Field Day 14 presentation.
Subramanian defines unstructured data as any data we can access as a file or as an object that does not fit neatly into database rows and columns. These data sets are piling up in the data centre, at the edge and in the cloud. An unstructured data management solution that can look across all your sources of unstructured data, provide an analytical view of this data, mobilize data and allow users to index, search and deliver only what is needed to data consumers is a smart strategy to modernize your data storage practice.
In this session, Subramanian briefly introduces the Komprise SaaS platform and introduces our latest product update: Smart Data Workflows. Here’s an overview of what her session covered.
With Smart Data Workflows, IT users can create automated workflows for all the steps required to find the right unstructured data across storage assets, tag and enrich the data and send it to external tools for analysis. This eliminates manual effort in unstructured data management and helps organizations speed time to value from new cloud-native tools.
With Smart Data Workflows, you can deliver only the right file and object data into a data lake: preventing the dreaded data swamp.
Does Komprise alter the data? No. Data remains in native format. When a file is moved to an object store, Komprise does not “munge it up.” We call it file-object duality. Read about it in this post: Why Cloud Native Data Access Matters.
The Power of Global Unstructured Data Visibility
Krishna introduced the Global File Index, which is a unified view of your data without moving the data. Today enterprise IT organizations are flying blind. They don’t know what data is sitting where, who is using the data, how the data is growing and what the data is costing them. End users can’t find the data they need when they need it. With today’s data volumes, organizations must have full visibility to make good decisions. Once you have this data visibility, Komprise makes it actionable. This is where the magic happens.
With billions of files and objects, analytics plus continuous mobilization is essential because data has a lifecycle and data management is not a one-time thing.
Smart Data Workflow Use Cases
Before the demonstration, Krishna reviewed a series of Smart Data Workflow use cases, including:
Smart Data Workflow Demonstration
Komprise CTO Mike Peercy delivered a demo related to autonomous vehicle data–because let’s face it, none of us will be driving in 10 years. The topic was also discussed in this recent webinar with AWS: A Modern Data Strategy for the Automotive Industry.
Here is the flow:
- ENABLE SHARES with autonomous vehicles data for processing
- Show Deep Analytics (which is the UI for the GFI – Global File Index)
- Show query for crash reports in 2019
- Show query with TAG : Stopped in traffic – there will be NONE
- Create Plan to analyze contents of 2019 files using LOCAL FUNCTION to tag matching files
- Activate the Plan to analyze and tag files
- Show query with TAG: Stopped in traffic – there will be MANY
Image source: Shutterstock (1493123198)