Managing unstructured data is a challenge for enterprise organizations. They are struggling with the proliferation of this data, which includes most of the files people use every day. According to research firm IDC, unstructured data is growing at an annual rate of 55-65%. Last year alone, the world generated over 73,000 exabytes of it.
It’s a problem Mike Harvey understands as a senior vice president at data management company Panzura. He told TechBullion that spiraling business and IT complexity is making unstructured data management enormously difficult.
“Soaring data volumes are leading to uncontrolled sprawl and bloat, and that makes data more susceptible to security and compliance risk, not to mention expensive,” said Harvey.
IDC says most unstructured data is simply created, used once, and then forgotten as scattered and siloed files. They hold value if it can be extracted. While AI is deft at processing data and uncovering hidden insights, it also contributes to data growth.
“Streamlined business, enhanced productivity, and security above all else – it all starts with gaining insights, then simplifying how data is handled,” said Harvey.
Enter Panzura Symphony. The data services platform was made available this week. Panzura says it is designed to help technologists and leaders align their data with business priorities and outcomes.
Since earlier this year, industry watchers have been waiting to see how the company’s acquisition of Moonwalk Universal would play out. Panzura describes Symphony as the “next generation” of the Moonwalk solution. It’s becoming even more comprehensive under Panzura with automated, exabyte-scale data discovery, compliance, and movement capabilities.
The company is also focused on its global file system Panzura CloudFS which supports large-scale multi-site workflows for the most active, most used data. Panzura says Symphony extends its hybrid cloud portfolio to what it calls the “next ring” of unstructured data which is the other 90% over which they need visibility and control.
The Symphony platform supports most file system deployments and protocols, as well as on-premises, private, public, and hybrid cloud object storage including major providers like AWS S3 and compatibles, Microsoft Azure, Google Cloud Platform, IBM Cloud Object Storage, and Wasabi Hot Cloud Storage.
Automated Data Discovery and Compliance
“Our job is to help our customers solve their data challenges because it’s getting harder for them every day,” said Harvey. One way Symphony does that is by helping teams get compliant and stay compliant with regulatory schemes like GDPR.
The platform lets Data Governance Officers, Risk and Compliance Managers, Business Analysts, and other data stewards create and enforce finely tuned policies to handle data visibility, movement and management from creation, storage, and usage through to archiving and deletion.
This is reinforced with meticulous data analysis and evidence-based reporting capabilities. “Visibility into data structure and content means you can avoid blind spots,” said Harvey.
Risk and compliance capabilities in Symphony can be extended with integrations like IBM Fusion, a technology that makes managing data and applications easier, especially in complex environments that use both on-premises and cloud resources. This integration is important because it allows for better handling of data that can be used to identify a person, also called Personally Identifiable Information (PII), along with other sensitive types of data.
Symphony stands out from other solutions for its exceptional interoperability and vendor certifications. These ensure it can handle diverse and complex data environments. Both ITOps teams and compliance managers can orchestrate data across different platforms without compatibility issues.
“Whether it’s in a precise way or at massive scale across an entire enterprise, teams can align data with business objectives,” Harvey explained.
More efficient data storage and centralized policy control reduces costs. By optimizing data placement, usage and access, Symphony minimizes costs and sidesteps vendor lock and legacy product dependence.
“It replaces multiple tools and interfaces by putting everything under a single pane of glass,” Harvey explained. He said Symphony can orchestrate data regardless of its location or storage network configuration which also makes it easier to leverage new and emerging technologies.
Unified Data Management for the Future
According to IDC, nearly 80% of new data pipelines are for ingesting, processing, and storing unstructured data. Powerful tools like artificial intelligence are now available to analyze data and extract insights, but storage infrastructure hasn’t kept up.
“File and object storage is a bottleneck in AI,” Harvey said. Instead of shuffling files around, Panzura Symphony ensures interoperability between different file and storage systems. “That makes automated placement of complex datasets possible so they’re always where they need to be. And that also simplifies analysis and insight,” Harvey added.
This capability includes ensuring data can be efficiently processed through DevOps workflows and AI pipelines. Webhooks, APIs, post-run actions, and relational database integration further enhance DevOps interoperability.
“Unlike other methods that introduce security risks, Symphony ensures smooth file migration and de-migration while keeping data secure,” he explained. It supports systems like NetApp Data ONTAP and Windows Server without the need for extra network or storage infrastructure.
Panzura says these and other distinctive capabilities of Symphony make it possible for teams to get more value from their data. They can achieve cost savings across their entire data storage landscape and will have more time to focus on other problems.
“It’s all about data excellence. Symphony moves our entire industry toward a future where data is not just managed, but mastered,” said Harvey.