Test Bed and Setup: Moving Towards 2024

As per our processor testing policy, we take a premium category motherboard suitable for the socket, and equip the system with a suitable amount of memory running at the manufacturer's highest officially-supported frequency. This is also typically run at JEDEC subtimings where possible. It is noted that some users are not keen on this policy, stating that sometimes the highest official frequency is quite low, or faster memory is available at a similar price, or that the JEDEC speeds can be prohibitive for performance.

While these comments make sense, ultimately very few users apply memory profiles (either XMP or other) as they require interaction with the BIOS, and most users will fall back on JEDEC-supported speeds - this includes home users as well as industry who might want to shave off a cent or two from the cost or stay within the margins set by the manufacturer. Where possible, we will extend out testing to include faster memory modules either at the same time as the review or a later date.

The Current CPU Test Suite

For our Intel Core i9-14900K, Core i7-14700K, and Core i5-14600K testing, we are using the following test system:

Intel 14th Gen Core System (DDR5)
CPU Core i9-14900K ($589)
24 Cores, 32 Threads
125 W TDP

Core i7-14700K ($409)
20 Cores, 28 Threads
125 W TDP

Core i5-14600K ($319)
14 Cores, 20 Threads
125 W TDP
Motherboard MSI MEG Z790 Ace Max (BIOS 7D86vA0)
Memory SK Hynix
2x16 GB
DDR5-5600B CL46
Cooling MSI MAG Coreliquid E360 360mm AIO
Storage SK Hynix Platinum P41 2TB PCIe 4.0 x4
Power Supply MSI A1000G 1000W
GPUs AMD Radeon RX 6950 XT, 31.0.12019
Operating Systems Windows 11 22H2

Our CPU 2024 Suite: What to Expect

We recently updated the CPU test suite to our 2023, but we've decided to update it again as we head into 2024. Our new suite has a more diverse selection of tests and benchmarks, focusing on real-world instruction sets and newer encoding and decoding libraries such as AV1, VP9, and HVEC. We have also included a range of AI-focused workloads and benchmarks, as we're seeing a direct shift from manufacturers to incorporate some form of on-chip AI processing, such as Ryzen AI and Intel's Meteor Lake AI NPU.

While we've kept some of the more popular ones, such as CineBench R23, we've added Maxon's latest CineBench 2024 benchmark to our test suite. We have also updated to the latest versions (at the time of incorporating the suite) in benchmarks such as Blender, V-Ray, and y-Cruncher.

With our processor reviews, especially on a new generational product such as Intel's Core i9-13900K/14900K, we also include SPEC2017 data to account for any increases (or decreases) to generational single-threaded and multi-threaded performance. It should be noted that per the terms of the SPEC license because our benchmark results are not vetted directly by the SPEC consortium, it is officially classified as an ‘estimated’ score.

We've also carried over some older (but still relevant/enlightening) benchmarks from our CPU 2023 suite. This includes benchmarks such as Dwarf Fortress, Factorio, Dr. Ian Cutress's 3DPMv2 benchmark, Blender 3.3, C-Ray 1.1 rendering, SciMark 2.0, and Primesieve 1.9.0. We've also kept UL's Procyon suite as a more holisitc system-wide test.

As for gaming, we're currently still revamping our CPU 2024 games suite, and as a result, we've tested gaming against our CPU 2023 suite. You can rest assured that our CPU 2024 games suite will be uploaded to the latest titles and will include even more technical aspects in play, such as Ray-Tracing, as this directly impacts CPU performance and frame rates. We will also include a similar methodology in terms of resolutions, including 720p/lower, 1080p, 1440p, and 4K.

The CPU-focused tests featured specifically in this review are as follows:

SPEC (Estimated)

  • SPEC2017 rate-1T
  • SPEC2017 rate-nT

Power

  • Peak Power (y-Cruncher using AVX)
  • Power analysis with y-Cruncher and CineBench R23

Office & Web

  • UL Procyon Office: Various office-based tasks using various Microsoft Office applications
  • UL Procyon Video Editing: Scores video editing performance on various parameters using Adobe Premiere software
  • LibreOffice: Time taken to convert 20 documents to PDF
  • JetStream 2.1 Benchmark: Measures various levels of web performance within a browser (we use the latest available Chrome)
  • Timed Linux Kernel Compilation: How long it takes to compile a Linux build with the standard settings
  • Timed PHP Compilation: How long does it take to compile PHP
  • Timed Node.js Compilation: Same as above, but with Node.js
  • MariaDB: A MySQL database benchmark using mysqlslap

Encoding

  • WebP2 Image Encode: Encoding benchmark using the WebP2 format
  • SVT AV1 Encoding: Encoding using AV1 at both 1080p and 4K, at different settings
  • Dav1D AV1 Benchmark: A simple AV1 based benchmark
  • SVT-HEVC Encoding: Same as SVT AV1, but with HEVC, at both 1080p and 4K
  • SVT-VP9 Encoding: Same as other SVT benchmarks, but using VP9, both at 1080p and 4K
  • FFmpeg 6.0 Benchmark: Benchmarking with x264 and x265 using a live scenario
  • FLAC Audio Encoding: Benchmarking audio encoding from WAV to FLAC
  • 7-Zip: A fabled benchmark we've used before, but updated to the latest version

Rendering

  • Blender 3.6: Popular rendering program
  • CineBench R23: The fabled Cinema4D Rendering engine
  • CineBench 2024: The latest Cinema4D Rendering engine
  • C-Ray: A popular render
  • V-Ray: Another popular renderer
  • POV-Ray: A persistence of ray-tracing benchmark

Science & Simulation

  • y-Cruncher 0.8.2.9523: Calculating Pi to 5M digits, both ST and MT
  • 3D Particle Movement v2.1 (Non-AVX + AVX2/AVX512)
  • Primesieve 1.9.0: This test generates prime numbers using an optimized sieve of Eratosthenes implementation
  • Montage Astro Image Mosaic Engine: Benchmarking of an open-sourced mosaic engine via California Institute of Technology
  • OpenFOAM: A Computational Fluid Dynamics (CFD) benchmark using drivaerFastback test case to analyze automotive aerodynamics.
  • Dwarf Fortress 0.44.12: Fantasy world creation and time passage
  • Factorio v1.1.26 Test: A game-based benchmark that is largely consistent for measuring overall CPU and memory performance
  • 3D Mark CPU Profile: Benchmark testing just the CPU with multiple levels of thread usage

AI and Inferencing

  • ONNX Runtime: A Microsoft developed open source machine learning and inferencing accelarator
  • DeepSpeech: A Mozilla based speech-to-text engine benchmark powered by TensorFlow
  • TensorFlow 2.12: A TensorFlow benchmark using the deep learning framework
  • UL Procyon WIndows AI Inference: A benchmark by UL measuring total inference counts across multiple libaries

We are currently using our games from our CPU 2023 suite. Our current games in our CPU testing and those featured in this review are as follows:

  • Civilization VI: 480p, 1080p, 1440p and 4K (both avg and 95% percentile)
  • World of Tanks: 768p, 1080p, and 4K (both avg and 95% percentile)
  • Borderlands 3: 360p, 1080p, 1440p, and 4K (both avg and 95th percentile)
  • Grand Theft Auto V: 720p, 1080p, 1440p, and 4K (both avg and 95th percentile)
  • Red Dead Redemption 2: 384p, 1080p, 1440p, and 4K (both avg and 95th percentile)
  • F1 2022: 720p, 1080p, 1440p, and 4K (both avg and 95th percentile)
  • Hitman 3: 720p, 1080p, 1440p, and 4K (both avg and 95th percentile)
  • Total War Warhammer 3: 720p, 1080p, 1440p and 4K (only avg fps measured)

As we have mentioned, we are updating our CPU 2024 suite with new games and the latest titles, and this will come before the next CPU review we publish.

While we normally analyze Core-to-Core latency on new CPUs, the fact that Intel's 14th and 13th Gen are identical architecturally, we opted to omit this from our testing.

Intel AI Assist: A Better Guess At Auto Overclocking SPEC2017 Single-Threaded Results
Comments Locked

57 Comments

View All Comments

  • Gastec - Friday, October 20, 2023 - link

    Maybe they do it through a proxy app, part of the overall package of Windows' Telemetry?
  • pookguy88 - Tuesday, October 17, 2023 - link

    you didn't have a 13700k to test against?
  • shabby - Tuesday, October 17, 2023 - link

    Yup pity, that would show us what those 4 e-cores can actually do.
  • TheinsanegamerN - Tuesday, October 17, 2023 - link

    I mean they still dont have a GPU test bed going on 3 years post fire. I wouldnt expect much.
  • nandnandnand - Wednesday, October 18, 2023 - link

    I recommend everyone go to Tom's Hardware if they are missing something here. They'll have the reviews, decent ones IMO, and are owned by the same company as AnandKek.
  • TheinsanegamerN - Thursday, October 19, 2023 - link

    Tom's Hardware was caught shilling for Nvidia eons ago. They're another dinosaur of the tech space.

    Techspot, Techpowerup, and reviewers like gamers nexus are the new hotness.
  • wrosecrans - Tuesday, October 17, 2023 - link

    Some motherboards will let you just set a power limit. I'd like to see a benchmark where the power limit is set to only the advertising number (125 W) and see what it can do with that constraint. 400+ watts just seems insane. My laptop is currently suffering terrible battery life because the CPU throttles up and gets hot and cooks the laptop because of exactly this Power Be Damned philosophy. I want a quiet desktop that isn't going to cook me if I'm sitting next to it, and isn't going to just cook the motherboard components and fail after a few years.

    I was expecting the new chip to be slightly more power efficient with a year of design tweaks and improvements. (And you'll note Intel wants you to think this because they kept the 125W marketing power usage on the box.) I am kinda baffled how Intel is executing so poorly. Nobody had a gun to their head forcing them to release this product. There's some deeply broken structural inertia in the organization to just keep pumping out products and not disrupting the flow of new model numbers. Somebody in Intel should have been screaming and said the plan wasn't working, rather than just keeping their head down to deliver a new model number for no reason.
  • TheinsanegamerN - Tuesday, October 17, 2023 - link

    If you want low power, get a ryzen. The 7800x3d tops out at just 50 watt.

    Performance loss, if anything like raptor lake (which this is) will be 15%+ down at 125 watt, more if they make heavy use of P cores.
  • schujj07 - Tuesday, October 17, 2023 - link

    Andandtech did this with the 13900k vs 7950X at different TDP/PPT. Basically the Ryzen at 65W TDP or 88W PPT was faster than Intel at 125W TDP. Once the Ryzen was set to 105W TDP or 142W PPT the Intel needed 253W TDP to be faster. In fact the scaling on the Ryzem dropped off quite quickly over 105W TDP.
  • mode_13h - Wednesday, October 18, 2023 - link

    This: https://www.anandtech.com/show/17641/lighter-touch...

Log in

Don't have an account? Sign up now