Companies to present joint capabilities at NVIDIA GTC Session # SS33029
Pavilion Data Systems, the universally unmatched leader in data storage, announced today its partnership with Graphistry to support large-scale, multi-GPU, and NVIDIA Magnum IO GPUDirect technologies to supercharge how data analysts investigate event and entity data.
Pavilion and Graphistry will showcase their joint capabilities at NVIDIA GTC in session # SS33029- Visually Investigating Patterns in Logs at Scale with Graphistry, RAPIDS, and Pavilion – using the most performant, dense, scalable, and flexible data storage platform in the universe.
Attendees will learn how to make big log volumes (including multi-petabytes) easily explorable by simple low-coding of GPU and graph interfaces. The session will walk attendees through how Graphistry has integrated friendly data UI tools like Jupyter notebooks, Streamlit dashboards, and Graphistry visual analytics with the NVIDIA RAPIDS GPU ecosystem (Dask_cuDF, GPU Direct storage, DGX A100) and with the Pavilion HyperParallel Data Platform™. The combined result is attendees will learn how to adapt their existing familiar workflows to a style where they can now see and explore their entire dataset.
The presenters will also provide recommendations to optimize log collection and GPU storage optimization while guiding attendees regarding how they can run and fork the open-source reference architecture providing attendees with new insights that will be shared with the RAPIDS accelerated data science community.
There are just a few visualization tools that take full advantage of NVIDIA GPUs with Magnum IO GPUDirect to deliver real-time graph analytics across petabytes of incoming and stored data. Graphistry’s breakthrough software and pipeline technology, combined with NVIDIA GPUs and Magnum IO GPUDirect along with Pavilion’s universally unmatched storage, enable the next generation of interactive visualization for incident response, SIEM optimization, and threat hunting across market segments, including financial services, federal agencies, and data science.
“Historically, teams have been excited to analyze logs at speed-of-thought by trying GPU acceleration, but bigger-than-memory datasets have always been difficult to connect to,” said Leo Meyerovich, CEO and founder of Graphistry. “Now that we can connect GPUs to Pavilion’s HyperParallel Data Platform, we can automatically keep the GPUs running at high rates on large data sets without waiting on the storage tier, so analysts can focus more on investigating and less on massaging queries.”
“Just about every enterprise has a vast ocean of data at its fingertips, and most companies need a way to process those volumes of data into insights more quickly so that they take action,” said Rob Davis, Vice President of Storage Technology at NVIDIA. “Running data science workloads on analytics solutions like Graphistry with multiple NVIDIA GPUs powered by NVIDIA MagnumIO GPUDirect storage enables enterprises to effectively leverage high-performance storage and process massive amounts of data at scale.”
“The Pavilion HyperParallel Data Platform can hold over 2 petabytes of usable capacity in 4 rack units, making it an ideal fit for data-intensive applications like Graphistry,” said Costa Hasapopoulos, Field Chief Technology Officer of Pavilion. “With Graphistry bringing automated queries across Splunk, Elasticsearch, Apache Spark, and CSVs, delivering the highest fidelity at scale requires NVIDIA GPUs and Magnum IO GPUDirect to enable analysts to visualize key relationships, patterns, and anomalies in real-time.”
To learn more about the solution with Graphistry and Pavilion, see the latest blog.
Pavilion is also presenting three other sessions at GTC21, including with partner OmniSci, as the two companies jointly showcase the power of Accelerated Analytics within a Data Science Platform. It is GTC # SS33294. You can also read the blog – How to respond to rapidly scaling Geospatial-Intelligence with OmniSci and Pavilion.
Attendees looking to understand how to virtualize, share and aggregate GPUs will find this session of particular interest: GTC # SS33026 and associated blog – How High-Performance NVMe-oF Storage Accelerates CPU & GPU-Powered Virtualized Environments Demonstrated by Pavilion.
Attendees wanting to understand the competitive advantage of a multi-controller, parallel architecture will find this session quite informative: GTC # SS33030 and associated blog – How a multi-controller storage architecture shatters expectations for modern applications.
