Peak Files generating way slower when working from NAS (in comparison to SSD)

[beobardo]

When working from my NAS (1,2GB/s - 1,8GB/s connected via Thunderbold and SMB) Peak File generation takes way longer, compared to working off of the internal- or an external SSD.

Why is that and does somebody have a solution to that? Playback, render times and scrubbing performance are similar to the internal/extrenal SSD - only peak files take forever.  

(Macbook Pro M1 Max, 64gb RAM, QNAP TVS-872XT)

[Toxos]

Hi there,

Is your NAS storage using SSD or HDD?

[beobardo]

Hi Toxos,

it's 8 HDD's in RAID 5 configuration (Additionally we installed 2tb SSD-Cache).

[Toxos]

Hello @beobardo, So when a RAID controller supports SSD caching, it means that the controller can utilize an SSD (Solid State Drive) as a high-speed cache to accelerate data access and improve overall performance, especially for frequently accessed data. Here's a more detailed explanation of how this works and what settings you might find in the controller software:

SSD Caching Overview:

• SSD caching involves using a portion of an SSD as a cache for data stored on traditional HDDs (Hard Disk Drives) within a RAID array.
• The RAID controller intelligently manages this cache, storing frequently accessed data on the SSD to speed up read operations and improve overall system responsiveness.

Types of SSD Caching:

• Read-Only Cache: Some RAID controllers support read-only caching, where frequently accessed data is cached on the SSD for faster read operations.
• Read/Write Cache: More advanced controllers may support read/write caching, allowing the SSD to accelerate both read and write operations.

Controller Software Settings:

• Cache Size: You may be able to allocate a specific portion of the SSD for caching purposes. This setting determines how much of the SSD's capacity is used for caching.
• Caching Policies: RAID controllers often offer different caching policies to control how data is cached. Common policies include:
  • Write-Through: Data is written simultaneously to both the SSD cache and the HDDs, ensuring data integrity but potentially limiting write performance.
  • Write-Back: Data is initially written to the SSD cache and then asynchronously destaged to the HDDs, improving write performance at the risk of data loss in case of a power failure (requires backup power or battery-backed cache).
• Cache Priority: Some controllers allow you to prioritize certain types of data for caching based on access patterns or specific data characteristics. This can optimize cache usage for maximum performance benefits.

Monitoring and Management:

• The RAID controller software typically provides monitoring tools to view SSD cache usage, hit rates (effectiveness of caching), and other performance metrics.
• You can usually configure alerts and notifications to track cache performance and detect potential issues such as cache saturation or SSD wear.

Compatibility and Limitations:

• Ensure that your RAID controller and SSDs are compatible with caching features. Not all controllers and SSD models support caching, and compatibility may vary depending on the manufacturer and model.

Note! Thunderbolt offers significantly higher data transfer speeds (up to 40 Gbps in Th 3&4) compared to the maximum speeds of USB Type-C (10 Gbps or 20 Gbps with USB 4).

[beobardo]

Hi Toxos,

thank you for taking the time to explain SSD caching! However, the speeds I get with the NAS are perfect, usually about 1500MB/s. So transferring data, scrubbing the timeline, etc. all works fine! It's just the peak file generation which is really slow and where I scratch my head, why this is!
Beo

[Toxos]

What kind of  internal/extrenal SSD are you using?

[beobardo]

The internal MacBook Pro SSD and externaly: SanDisk Extreme PRO

Beo

[Toxos]

Yes, the SanDisk Extreme PRO Portable SSD is known for its fast read and write speeds, up to 2000MB/s, and the MacBook Pro SSD is PCI I guess thats why