www.sdmmag.com/articles/102498-secure-smart-and-scalable-the-future-of-video-storage
Video Control Room

AI-enabled algorithms can intelligently analyze video feeds and compress the data without compromising video quality. This results in reduced storage requirements and lower costs, as well as faster retrieval times for video analysis. // IMAGE COURTESY OF IDIS

Secure, Smart & Scalable: The Future of Video Storage

Emerging trends are shaping how vast amounts of surveillance data are managed, including innovations like edge computing, cloud integration, AI-enabled analytics and more.

October 16, 2023

In recent years, the video surveillance ecosystem has undergone intense transformation, driven by a convergence of technological advancements and evolving security needs. These changes have had a significant impact on video surveillance storage solutions, prompting a shift toward more sophisticated and efficient approaches to handling vast amounts of video data.

Each type of video surveillance storage solution (See Various Flavors of Video Storage Alternatives below) has its own advantages and considerations. The choice depends on factors such as the scale of the surveillance deployment, data retention requirements, performance needs, budget constraints and the desired level of accessibility. Ahead, we consult with members of the vendor community to delve into these topics, including emerging storage trends, the influence of artificial intelligence (AI), best practices for security integrators and more.


Developing Trends to Track

From harnessing the power of edge computing to unlocking the potential of AI-driven analytics, emerging trends are propelling the video surveillance industry toward more efficient, scalable and secure storage solutions.

Rapidly changing technology is a main thrust fueling the industry’s evolution, says David Boland, vice president of cloud strategy for Boston-based Wasabi.

High-resolution cameras, multi-camera systems and the use of analytics are increasing the size and amount of surveillance data needed to be stored. At the same time, stricter compliance regulations are increasing the length of time that data must be retained.


data security and privacy
Integrators should consider data security and privacy when recommending storage and provide guidance for end users on developing sound policies and best practices to mitigate privacy risks. // SEAN ANTHONY EDDY/ISTOCK / GETTY IMAGES PLUS VIA GETTY IMAGES


“While this has placed massive burdens on surveillance storage systems, ironically, storage is the one area where innovation has been lacking,” Boland says. “Until now.”

Boland says although it’s still early in the transition, market research from Omdia estimates that the overall cloud usage in the market is about 30 percent and is expected to surpass 50 percent by 2026.

“In the world of video surveillance, the utilization of cloud storage will continue to rapidly gain momentum, largely attributable to its scalability and adaptability,” Boland says. “The traditional methods of storage worked well for years, when the need for new cameras was rare, resolutions were low and overall file sizes were relatively small. However, that’s all changed. Cloud object storage, with its ability to cost-effectively scale as you grow, is ideally suited to solve the surveillance industry’s storage capacity problem.”

Direct-to-cloud storage is going to become more common as bandwidth becomes more available and prices — specifically with regards to upstream bandwidth — come down, explains Chris Garner, senior software product manager, Salient Systems, Austin, Texas. Still, he says, on-premise storage solutions will still be the norm for large (200+ cameras) video deployments.

“Also, the resolution war among camera manufacturers shows no sign of abating as ever-higher resolution cameras are introduced and lower resolution cameras become scarce,” Garner adds. “Resolution has a direct impact on storage requirements and increasingly 4MP, 6MP and 4K cameras are becoming common, replacing SD, 720p and 1080p cameras.”

Michael Brewer, regional marketing manager, video systems – North America for Bosch Security and Safety Systems, Fairport, N.Y., says connection of traditional on-premise systems to cloud environments is an emerging request. Historically, many customers who utilize large on-premise storage systems have been unable to use online services outside of their networks; but now that seems to be changing for many, he says.

“This year, Bosch launched Remote System Management,” Brewer continues. “This new service permits remote management of our DIVAR IP (NVR) products via cloud connection. With advanced warnings of potential hard drive, power or other component failures, integrators can now provide proactive insight into the health of remote storage devices.”

“Storage often makes up the bulk of upfront costs but can also result in significantly higher ongoing costs that increase the lifecycle costs and the total cost of ownership of a surveillance system.”Jason Burrows, IDIS America

IDIS America Sales Director Jason Burrows, located in Coppell, Texas, cites an increasing demand for high-capacity storage technologies among emerging trends in the video storage sector. These include solid-state drives (SSDs) to accommodate the growing need for high-capacity storage solutions.

“The 2018 NDAA swiftly followed by the FCC ruling, has also made manufacturing origin a top priority as even smaller enterprises can’t be certain of a futureproof surveillance solution unless they opt for NDAA-compliant storage options,” he says.

Burrows also notes that as video surveillance data becomes more sensitive and valuable, there is a growing focus on ensuring its security. “Encryption and other security measures must be implemented to protect stored data from unauthorized access and cyber threats,” he adds.


Rising Role for AI

According to Boland, there are two simultaneous technology shifts currently happening in the video surveillance space. The first is the shift from a primarily on-premises environment to cloud infrastructure. The second is the shift of concepts: physical security to physical security technology.

“The traditional model of physical security, which is currently still being used today, relies on video surveillance cameras specifically for public safety and protection of assets,” he explains. “As new artificial intelligence and machine learning technologies continue to be introduced and improved throughout this space, users can now rely on automation to extract valuable insights from the video captured. This is where we are seeing the shift to physical security technology.”

Even if an end-user organization is only using security cameras for physical security today, that doesn’t mean they won’t be utilizing them for other aspects of the business in the future, Boland says. Having a flexible storage infrastructure in place now will address the needs end users currently face, while positioning the organization to easily scale as needed when taking advantage of different AI/ML technologies.

“When it comes to other data heavy use cases and providing insights back to the business, organizations will want to analyze multiple recordings over a given, often long, time period without the need of a human to watch every second of that video,” he continues. “It’s important that organizations start planning their infrastructure today with tomorrow in mind, which will require that every aspect of their infrastructure is focused on enabling video use cases.”

AI and machine learning analytics are increasing storage requirements due to the fact that users must now not only store the video data, Garner explains, but also the metadata generated by AI and machine learning-powered cameras or by server-based AI analytic applications.


Why Cybersecurity Matters in Video Surveillance Storage

A compromised video storage solution could allow attackers to alter or delete recorded footage, potentially erasing evidence of criminal activity or altering events. Strong cybersecurity measures can ensure the integrity of the recorded data as well as prevent unauthorized distribution or other misuse.

Accordingly, integrators should consider data security and privacy when recommending storage and provide guidance for end users on developing sound policies and best practices to mitigate privacy risks, says Jason Burrows of IDIS Americas.

“Depending on the nature and location of the organization, together with its risk factors to ensure continuous operation and data protection, a redundant storage solution and backup strategy are crucial,” he explains. “Gaps in footage might be less of an issue in a small store or office that doesn’t handle sensitive data, while in others loss of video data can lead to significant repercussions if a crime occurs or if government or regulatory fines are levied.”

High-profile cyberattacks continue to put cybersecurity on top of the risk register for video storage, while there’s also increasing awareness of the threat of spoofing and deepfakes. The most efficient weapon is to ensure that storage solutions come with cybersecurity designed in. Integrators should look for specialized, multi-layered cybersecurity that minimizes performance impact on data storage and processing, while preventing malicious attacks, spoofing, alteration and destruction. For example, Burrows says, techniques such as mutual authentication between NVRs and cameras will help to harden devices against hacking threats.

“Integrators also need to be sure they are guaranteeing the integrity of customers’ video evidence,” he says. “Rapid advances in video manipulation techniques have increased deepfakes and spoofing, putting an increased onus on the robustness and quality of storage solutions as well as additional pressure on prosecutors to demonstrate the integrity of footage.”

It’s important that video sources be authenticated with a server or NVR before anything is recorded. One method is to utilize end-to-end systems that use certificate-based mutual authentication and proprietary protocols.

“This will guarantee that the video feed is coming from a network camera paired with the NVR rather than from anywhere else, taking the human factor out of the cybersecurity equation,” Burrows says.

“Metadata isn’t just created on the fly and then discarded,” he continues. “To be useful it too must be retained for the same amount of time as the video data — and sometimes even longer depending on how it is used.”

As a use case example, the Bosch Video Management System (BVMS) can search AI metadata stored along with standard camera footage. Speed, item classification, color, acceleration, object removed and object left behind are all examples of analytic metadata that can be utilized in a forensic search.

“If users need to find specific video, such as that of a yellow car that sped through a parking lot, they can enter qualifiers to narrow down the search to minutes or even seconds instead of searching frame by frame,” Brewer says.

With the increasing amount of data generated by surveillance cameras, it has become increasingly important that the data is stored efficiently and effectively, making intelligent codecs and increased processing power evermore critical, Burrows explains.

“We’re also seeing AI increasingly deployed at the edge in cameras to process video data locally, particularly in small to medium applications, or in larger systems that are plagued by false alarms from specific cameras or that need to cover high risk areas with AI-powered analytics to rapidly and accurately alert to threats,” he says. “This reduces the amount of data that needs to be transmitted and stored centrally, saving bandwidth and storage resources while facilitating faster alerts and response times to threats and incidents.”


facets of cloud technology
Because there are so many different facets of cloud technology within the security space it can be quite daunting figuring out where to begin. Users can dip their toes into the water by utilizing the hybrid-cloud storage approach. // JUST_SUPER/E+ VIA GETTY IMAGES


Thanks to AI, Burrows says, what was previously the domain of corporate organizations — enterprise-class VMS with federated architecture and deep learning capabilities — has also become more feasible and affordable for smaller businesses to benefit from analytics and remote access to video data.

However, it’s important to remember the industry is only at the start of the AI revolution. “AI is playing a crucial role in the evolution of video storage solutions by improving efficiency, scalability and analytical capabilities,” Burrows says. “As these technologies continue to advance, we can expect even more sophisticated and powerful solutions that will further enhance video analysis and insights for better security and safety management as well as video being increasingly used for business intelligence and to tackle other operational challenges.”


Best Practices for Security Integrators

The effectiveness of a video surveillance system hinges not only on the quality of cameras and analytics but also on the implementation of storage solutions. Security integrators play a pivotal role in shaping the success of video surveillance projects, and adhering to best practices during storage installations is paramount.

“It must start by listening to user requirements and understanding each customer application site by site and getting the system design right the first time,” Burrows of IDIS says. “Storage often makes up the bulk of upfront costs but can also result in significantly higher ongoing costs that increase the lifecycle costs and the total cost of ownership of a surveillance system.”

The number of cameras needed to provide complete domain awareness of internal areas, perimeters and coverage of high risk areas such as entrances and exits will help determine the amount of storage needed. At the same time, it’s important to understand the specific needs and pain points of each user, from heads of security, facilities and loss prevention to control room operators and non-security staff to assess camera resolution, frame rate, and retention time.

“Combining this information will help determine the overall storage capacity required to offer the best storage method, rather than simply basing retention on camera counts,” Burrows says. “It’s important to consider that users’ needs change over time so it’s best to specify a storage solution that can easily scale.”

Traditionally, video surveillance data storage was primarily located on the end user’s premises. But as the concept of video surveillance expands beyond common use cases due to rapid technology innovation, the video surveillance space has morphed into a complex data management process, explains Boland of Wasabi. As data generation continues to increase, coupled with longer required retention times, an inverse relationship between the need for more data management and the roles of end-user IT/security personnel is emerging.


Various Flavors of Video Storage Alternatives

Where DVRs once reigned as a primary storage option for legacy systems, today’s solutions encompass a range of choices designed to address the diverse needs of modern video surveillance. These solutions vary in terms of their architecture, scalability, accessibility and cost-effectiveness. The main types of storage solutions include:

Cloud-Based Storage: Cloud storage solutions involve storing video data on remote servers managed by third-party providers. This approach offers scalability, accessibility from anywhere, and reduced on-site infrastructure maintenance. Cloud storage can be particularly useful for organizations with multiple locations or limited IT resources.

Direct-Attached storage (DAS): DAS is employed in smaller installations or for specific use cases where a limited number of cameras generate manageable amounts of data. For instance, a small business or a residential property might use DAS to store surveillance footage from a few cameras. DAS is also common in setups where real-time access to video data is critical, such as live monitoring environments.

Edge Storage: Edge storage involves storing video data directly on the cameras or at the edge of the network. This approach reduces bandwidth usage and central storage requirements by performing initial processing and storage onsite. Edge storage is valuable for bandwidth-constrained environments or applications that require immediate access to critical footage.

Hybrid Solutions: Hybrid solutions combine on-premises storage with cloud storage. This approach leverages the benefits of both local storage for quick access and cloud storage for scalability and redundancy. It’s a popular choice for organizations seeking a balance between cost, performance and flexibility.

Network-Attached Storage (NAS): NAS devices are network-connected storage units that offer file-level storage for video data. They are often used as auxiliary storage solutions, providing scalability and ease of management. NAS devices can be a cost-effective way to expand storage capacity without replacing existing infrastructure.

Network Video Recorders (NVRs): NVRs are dedicated hardware devices designed to store and manage video data from IP cameras and networked sources. They offer a centralized storage solution with built-in software for video management, playback and remote access. NVRs are suitable for small to medium-sized installations and provide a straightforward approach to managing video footage.

Storage Area Networks (SANs): SANs are specialized high-performance storage systems that offer block-level storage, making them suitable for large-scale surveillance environments. SANs provide exceptional data throughput and low latency, making them ideal for scenarios that demand real-time access to high-definition video streams.

Video Management Software (VMS) with Storage Servers: VMS platforms offer software-based video management and often include options for connecting to storage servers or network-attached storage (NAS) devices. These solutions provide greater flexibility in hardware selection, allowing organizations to tailor storage capacities to their specific requirements.


“End users are constantly looking for new solutions to relieve the complexity of day-to-day storage management, while lowering their total cost of ownership,” he says.

The easiest way for integrators to deliver a relief in storage management, while keeping costs low, is by implementing a hybrid-cloud storage solution for customers, Boland suggests. Through this model, customers can keep a specific amount of video locally, while pushing the remainder offsite to a cloud environment, meeting total retention periods.

“Not only does this model let the end user utilize the same infrastructure that they’re used to using, but they are also now incorporating an additional safety measure — keeping video offsite in case of onsite failures or malicious activity,” he continues. “Offering an alternative storage solution to customers positions your organization as knowledgeable leaders in the earlier stages of a technology shift.”

“With advanced warnings of potential hard drive, power, or other component failures, integrators can now provide proactive insight into the health of remote storage devices.”Michael Brewer, Bosch Security and Safety Systems

Integrators should be proficient with using storage calculators and should consult with the end user to determine what type of recording is expected or required, advises Garner of Salient Systems.

Choices in resolution, frame rate, lighting conditions and traffic patterns have immense impacts on storage utilization, Garner says. For example, a camera looking down a seldom used, interior hallway is going to produce much less data than an exterior camera looking at a busy entrance.

“Additionally, to make better use of available storage, integrators should consider leveraging multi-streaming configurations to reduce the recording bitrate during times of no activity and higher bitrate when events occur,” he adds.

Brewer at Bosch also emphasizes the need for storage calculator proficiency for integrators.

“There are many important factors to understand when working to identify storage needs such as frames per second (FPS), resolution, length of individual recordings and even compression mode,” he explains. “Consider only recording when the camera senses movement. Motion-based recording can assist customers in getting the most out of their storage systems.”