Gaming Workloads

Our revamped gaming test suite from mid-2018 involves six different games:

  • Civlization VI (DX12)
  • Dota 2
  • F1 2017
  • Grand Theft Auto V
  • Middle Earth: Shadow of War
  • Far Cry 5

Most system reviews take a handful of games and process them at one resolution / quality settings for comparison purposes. Recently, we have seen many pre-built systems coming out with varying gaming capabilities. Hence, it has become imperative to give consumers an idea of how a given system performs over a range of resolutions and quality settings for each game. With our latest suite, we are able to address this aspect.

Civilization VI (DX12)

The Civilization series of turn-based strategy games is very popular. For such games, the frame rate is not necessarily an important factor in the gaming experience. However, with Civilization VI, Firaxis has cranked up the visual fidelity to make the game more attractive. As a result, the game can be taxing on the GPU as well as the CPU, particularly in the DirectX 12 mode.

Civilization VI (DirectX 12) Performance

We processed the built-in benchmark at two different resolutions (1080p and 2160p), and with two different quality settings (medium and ultra, with the exact differences detailed here). The results strongly hint that even with "just" a Vega 56 Nano, Civilization VI is CPU-limited much of the time. That means that all of our eGPU-capable hosts, which as is typical for their form factors all use lower-wattage CPUs, end up with a lot less CPU performance to spend on Civilization VI. Which in turn leaves the Vega 56 Nano with less to do.

This first game on the whole is a prime example of the tradeoffs involved in gaming on laptops, mini-PCs, and other small form factor devices with an eGFX chassis. Intel's CPUs can turbo very high in these devices for short periods of time, but long-term gameplay is going to highlight the sustained performance differences between sub-50W mobile and today's 90W+ high-end desktop processors. Which is to say that adding a fast external GPU alone won't capture all of the performance of a complete high-end system.

Along those lines, among the eGPU solutions the Bean Canyon NUC fares the best. While it will doggedly stick to Intel's 28W TDP guidelines, it none the less sports the best turbo features and latest manufacturing benefits of Intel's newer processors, allowing it to sustain the best performance.

Dota 2

Dota 2 has been featuring in our mini-PC and notebook reviews for a few years now, but, it still continues to be a very relevant game. Our evaluation was limited to a custom replay file at 1080p resolution with enthusiast settings ('best-looking' preset). We have now revamped our testing to include multiple resolutions - This brings out the fact that the game is CPU-limited in many configurations.

Dota 2 allows for multiple renderers - we use the DirectX 11 mode. The rendering settings are set to 'enthusiast level' (best-looking, which has all options turned on, and at Ultra level, except for the Shadow Quality set to 'High'). We cycle through different resolutions after setting the monitor resolution to match the desired resolution. The core scripts and replay files are sourced from Jonathan Liebig's original Dota 2 benchmarking instructions which used a sequence of frames from Match 3061101068.

Dota 2 - Enthusiast Quality Performance

At 4K, the internal GPU solutions come out on top. However, at lower resolutions, it looks like the performance is CPU-limited. The Bean Canyon NUC comes just behind the Kaby Lake desktop solution in such cases.

F1 2017

Our gaming system reviews have always had a representative racing game in it. While our previous benchmark suite for PCs featured Dirt 2, we have moved on to the more recent F1 2017 from Codemasters for our revamp.

F1 2017 - Ultra Quality Performance

The supplied example benchmark (with some minor tweaks) is processed at four different resolutions while maintaining the graphics settings at the built-in 'Ultra' level. Across all resolutions, the internal GPU solutions are easily on top, as this is another game that favors fast CPUs when not held back by a GPU. However, at 4K, the gap between the eGPU and internal solutions is much narrower as GPU bottlenecks finally come into play.

Grand Theft Auto V

GTA doesn’t provide graphical presets, but opens up the options to users and extends the boundaries by pushing even the hardest systems to the limit using Rockstar’s Advanced Game Engine under DirectX 11. Whether the user is flying high in the mountains with long draw distances or dealing with assorted trash in the city, when cranked up to maximum it creates stunning visuals but hard work for both the CPU and the GPU. For our test we have scripted a version of the in-game benchmark. The in-game benchmark consists of five scenarios: four short panning shots with varying lighting and weather effects, and a fifth action sequence that lasts around 90 seconds. We use only the final part of the benchmark, which combines a flight scene in a jet followed by an inner city drive-by through several intersections followed by ramming a tanker that explodes, causing other cars to explode as well. This is a mix of distance rendering followed by a detailed near-rendering action sequence.

Grand Theft Auto V Performance

We processed the benchmark across various resolutions and quality settings (detailed here). The results are presented above. In general, the internal GPU solutions provide much better performance. The gap narrows at higher resolutions and quality settings.

Middle Earth: Shadow of War

Middle Earth: Shadow of War is an action RPG. In our previous gaming benchmarks suite, we used its prequel - Shadow of Mordor. Produced by Monolith and using the new LithTech Firebird engine and numerous detail add-ons, Shadow of War goes for detail and complexity. The graphics settings include standard options such as Graphical Quality, Lighting, Mesh, Motion Blur, Shadow Quality, Textures, Vegetation Range, Depth of Field, Transparency and Tessellation. There are standard presets as well. The game also includes a 'Dynamic Resolution' option that automatically alters graphics quality to hit a pre-set frame rate. We benchmarked the game at four different resolutions - 4K, 1440p, 1080p, and 720p. Two standard presets - Ultra and Medium - were used at each resolution after turning off the dynamic resolution option.

Middle Earth: Shadow of War Performance

At lower resolutions and quality settings, the internal GPU solutions are far ahead of the rest of the pack. However, at higher resolutions, the eGPU solutions almost catch up with the internal solutions.

Far Cry 5

Ubisoft's Far Cry 5 is an action-adventure first-person shooter game released in March 2018. The game comes with an in-built benchmark and has standard pre-sets for quality settings. We benchmarked the game at four different resolutions - 720p, 1080p, 1440p, and 2160p. Two preset quality settings were processed at each resolution - normal and ultra.

Far Cry 5 Performance

At lower resolutions, the Bean Canyon NUC eGPU solution comes second to the Shuttle internal GPU solution. However, at higher resolutions, the Haswell configuration edges it, pointing to the host-GPU bandwidth becoming important under those conditions.

UL 3DMark and VRMark Workstation Workloads - SPECviewperf 13
Comments Locked

25 Comments

View All Comments

  • OolonCaluphid - Wednesday, February 13, 2019 - link

    As a Dan A4 owner, I'm absolutely crying at the size and emptyness of that box!! What an utter waste of space. You can get a whole PC in there, negating the need for an external GPU in the first place.

    (yeah yeah, I get it, it's for laptops... just build an SFF PC)
  • Reflex - Wednesday, February 13, 2019 - link

    I also have a Dan A4-SFX and that was exactly my first thought! And for about the same price no less!
  • hansmuff - Wednesday, February 13, 2019 - link

    I wonder if you could hook up a laptop to a gaming PC. Then, use Laptop keyboard, mouse and display as peripherals. I suppose the laptop would have to accept HDMI or DP as input, and I also suppose few if any do that?
  • DanNeely - Wednesday, February 13, 2019 - link

    You're making it too complicated. No need for special hardware functions, when you could remote desktop/etc into a desktop from your laptop.
  • PeachNCream - Thursday, February 14, 2019 - link

    Remote Desktop has a bit of trouble with DirectX and though the latency is a lot lower than something like VNC, it isn't intended as a solution for pushing a game's graphics over a network. Steam in-home streaming is a much better option for a local situation like that and you can use it rather effectively with non-Steam games by just adding them to Steam manually. You can also toss in programs like Windows Explorer or the components of an office suite to do something productive via Steam as well. In the end though, I do agree that remote access to a gaming PC from another PC is a layer of complexity that isn't typically necessary although you can, at least in theory, run a headless gaming desktop that way.
  • WinterCharm - Wednesday, February 20, 2019 - link

    Steam has a built in game streaming solution that works perfectly for this. You don't need Windows Remote Desktop. You just use Steam's game streaming.
  • 29a - Thursday, February 14, 2019 - link

    Steam does what you want.
  • JoeTheDestroyr - Thursday, February 14, 2019 - link

    I wanted such a thing and couldn't find it. I enjoy the laptop form-factor for playing games in my comfy chair in my living room (and no, for the last time, I don't want to use my tv, I use that for other things).

    In the end, I had to make it myself. Grabbed a dead laptop off ebay, ripped out the guts, and replaced it w/ a Chinese board off ebay that could drive laptop lcd panels from a DP connection. Made my own usb keyboard controller using a Teensy. Even added a class D amp + USB audio to drive the laptop speakers (which sounded like garbage until I used a calibration mic + Equalizer APO to clean it up).
  • JoeTheDestroyr - Thursday, February 14, 2019 - link

    Stupid no edit:

    ...enjoy the laptop form-factor for playing games in my comfy chair in my living room, but got tired of the ridiculous markup (and simultaneous lack of performance) on gaming laptops. And I don't care about portability, just "lap-ability" (moving it from a table to my lap, and back).
  • watersb - Friday, February 15, 2019 - link

    Dang. That sounds like my kind of game. :-)

Log in

Don't have an account? Sign up now