System Performance: UL and BAPCo Benchmarks

Our 2022 Q4 update to the test suite for Windows 11-based systems carries over some of the standard benchmarks we have been using over the last several years, including UL's PCMark. New additions include BAPCo's CrossMark multi-platform benchmarking tool, as well as UL's Procyon benchmark suite. BPACo recently updated their SYSmark benchmark suite - while operational at a basic level, it is missing key features such as energy consumption measurement. We will start including SYSmark 30 once the open issues are resolved.

UL PCMark 10

UL's PCMark 10 evaluates computing systems for various usage scenarios (generic / essential tasks such as web browsing and starting up applications, productivity tasks such as editing spreadsheets and documents, gaming, and digital content creation). We benchmarked select PCs with the PCMark 10 Extended profile and recorded the scores for various scenarios. These scores are heavily influenced by the CPU and GPU in the system, though the RAM and storage device also play a part. The power plan was set to Balanced for all the PCs while processing the PCMark 10 benchmark. The scores for each contributing component / use-case environment are also graphed below.

UL PCMark 10 - Performance Scores

The Productivity workload benefits from the 8 high-performance Zen 3 cores in the 4X4 BOX-5800U, but the Intel systems wrest the lead in other components. Overall, the RPL-P system at default comes out on top. However, with in-band ECC enabled, the gaming workload suffers greatly. This sees the overall score for the ECC-enabled configuration to be in the middle of the pack.

UL Procyon v2.1.544

PCMark 10 utilizes open-source software such as Libre Office and GIMP to evaluate system performance. However, many of their professional benchmark customers have been requesting evaluation with commonly-used commercial software such as Microsoft Office and Adobe applications. In order to serve their needs, UL introduced the Procyon benchmark in late 2020. There are five benchmark categories currently - Office Productivity, AI Inference, Battery Life, Photo Editing, and Video Editing. AI Inference benchmarks are available only for Android devices, while the battery life benchmark is applicable to Windows devices such as notebooks and tablets. We presents results from our processing of the other three benchmarks.

UL Procyon - Office Productivity Scores

Enabling in-band ECC results in some penalty, but the scores across all MS Office workloads for both NUCS BOX-1360P/D4 configurations handily surpass the other systems.

The NUC 12 Pro Wall Street Canyon and the 4x4 BOX-5800U come out as the best bet for energy efficiency with respect to the MS Office workloads. The NUCS BOX-1360P/D4 gets a much higher score, but is let down on the energy consumption side. While not an entirely scientific metric, the Wall Street Canyon configuration delivers 733 pts / Wh, while the NUCS BOX does only 699 pts / Wh in this workload. However, we have historically seen that ASRock Industrial's BIOS for the NUC BOX lineup is rarely optimized for power consumption.

Moving on to the evaluation of Adobe Photoshop and Adobe Lightroom, we find the same pattern. Despite the 40W PL1 of the NUC 12 Pro, the 28W PL1 Core i7-1360P in the NUCS BOX is able to match it and also consume lesser energy for the workload. Enabling ECC pushes down the system towards the middle of the pack in both metrics.

UL Procyon - Photo Editing

UL Procyon evaluates performance for video editing using Adobe Premier Pro.

UL Procyon - Photo Editing

The workload takes advantage of the iGPU, which is problematic for the ECC-enabled configuration. However, the default configuration is able to come out on top by a huge margin. Being able to complete the workload faster also keeps the energy consumption low.

BAPCo CrossMark 1.0.1.86

BAPCo's CrossMark aims to simplify benchmark processing while still delivering scores that roughly tally with SYSmark. The main advantage is the cross-platform nature of the tool - allowing it to be run on smartphones and tablets as well.

BAPCo CrossMark 1.0.1.86 - Sub-Category Scores

CrossMark shows the NUCS BOX-1360P/D4 emerging on top, with the ECC-enabled configuration performing roughly on par with the NUC BOX-1260P.

Setup Notes: The In-Band ECC Option System Performance: Miscellaneous Workloads
Comments Locked

30 Comments

View All Comments

  • mode_13h - Tuesday, February 14, 2023 - link

    I also don't agree that W680 boards are scarce. At least Supermicro boards seemed to be easy enough to find since the end of last year. Now DDR5 ECC UDIMMs have been a much bigger challenge, but they're thankfully now readily available too.
  • mode_13h - Tuesday, February 7, 2023 - link

    Thanks for the review, but my ideal microserver would be fanless and support a 2.5" SATA SSD. Does anyone know if any of their fanless boxes support in-band ECC? I couldn't find any indication that they do.

    https://www.asrockind.com/en-gb/fanless-embedded-b...
  • ganeshts - Wednesday, February 8, 2023 - link

    ASRock Industrial took notice of your comment and requested that this be posted in response.


    ASRock Industrial technical support team appreciate your attention on our product.

    ASRock Industrial will use Intel 13Gen. IoTG SKUs CPU on the iBOX-series products.
    It will design as a fanless system with 2.5" SATA SSD support.
    For In-Band ECC feature, please note that Intel support it on select Industrial SKUs according to Intel’s official documents.
    We suggest to keep following ASRock Industrial’s website for more and latest news.

    https://www.asrockind.com/en-gb/fanless-embedded-b...
  • mode_13h - Thursday, February 9, 2023 - link

    Thanks for the follow-up!

    Now, if I could just find an ASRock Rack X570D4U-2L2T Mini-ATX board in stock somewhere in the US. I can never seem to find it or the newer /BCM version.
  • mode_13h - Monday, February 27, 2023 - link

    Just wanted to follow up on the ASRock Rack X570D4U-2L2T. It's finally back in stock @ newegg! Shipped & sold by newegg, too (i.e. not just some scalper).

    For those not familiar with this product, it's a micro-ATX AM4 server board with dual 10G Ethernet, ECC RAM support, and remote management via BMC. I'm excited, because there are no other products like it, to my knowledge. ASRock Rack has validated ECC memory on it, which you tend to see on other AM4 boards. You can find professional reviews of it, on other sites.

    I'm about to order mine, now.
  • mode_13h - Monday, February 27, 2023 - link

    Sorry, I meant to say that I _haven't_ seen ECC memory fully validated and supported, on other AM4 boards. This is one of the preferred boards of the homebrew NAS community.
  • sjkpublic@gmail.com - Monday, February 13, 2023 - link

    Nice NUC. But I am waiting on the 7735U.
  • sjkpublic@gmail.com - Monday, February 13, 2023 - link

    $690 barebones.
  • sjkpublic@gmail.com - Monday, February 13, 2023 - link

    Silly people posting on ECC for a end user desktop/kiosk device - trying to put a square peg in a round hole. I like the idealistic attitude. But the realistic says otherwise.
  • sjkpublic@gmail.com - Tuesday, February 14, 2023 - link

    Silly me! I retract. ECC support is a great idea.

Log in

Don't have an account? Sign up now