Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
wiki:benchmarking_for_batocera [2021/10/12 01:45] – clarified mangohud instructions atariwiki:benchmarking_for_batocera [2023/05/10 00:51] (current) – [Games to test] added examples for Xbox 360 atari
Line 4: Line 4:
  
 Requirements for benchmarking (so as to create a fair and reproducible result): Requirements for benchmarking (so as to create a fair and reproducible result):
-  * This is running on a machine connected to a 1920x1080 60 Hz display. +  * This is running on a machine connected to a 1920x1080 60 Hz display. Lower resolution displays are acceptable, but try to get as close to the full-HD standard as possible. Going above can result in unfair poor performance, which is not representative of the hardware's capabilities
-  * When creating benchmarks for Batocera, leave all the settings at their default "AUTO" mode. +  * Leave all the settings at their default "AUTO" mode. In a way, Batocera's defaults can be considered as differences in development between versions of Batocera
-  * Running the game off the internal drive.+  * Running the game off the internal drive. Network shares or external drives may have unrelated storage speed access issues that negatively affect games.
  
 For Batocera's benchmarking purposes, it's really only necessary to see whether a game is running at full-speed or not. There is no ambiguity with this sort of system and is easy to understand by all. For Batocera's benchmarking purposes, it's really only necessary to see whether a game is running at full-speed or not. There is no ambiguity with this sort of system and is easy to understand by all.
 +
 +You can enable the FPS counter by going to **SYSTEM SETTINGS** -> **FRONTEND DEVELOPER OPTIONS** -> **SHOW FPS COUNTER** and turning it on.
  
 ===== What is considered "full-speed"? ===== ===== What is considered "full-speed"? =====
  
-For a 60 FPS game, anything between 57 to 60 FPS without noticeable stutters (more than half a second) would be considered full-speed. Micro-stutters (less than a 60th of a second) can usually be explained by hardware configuration and slightly less-than-optimal default settings, and should be ignored. +  * For a 60 FPS game, anything between 57 to 60 FPS (95%) without noticeable stutters (more than half a second) would be considered full-speed. Micro-stutters (less than a 60th of a second) can usually be explained by hardware configuration and slightly less-than-optimal default settings, and should be ignored. 
- +  For 50 FPS games (like PAL region games), the same but anything between 47 to 50 FPS (95%) instead. 
-For 50 FPS games (like PAL region games), the same but anything between 47 to 50 FPS instead. +  For games that run easily at full-speed, try increasing the rendering scale by an integer multiplication. Things like 2x resolution, 3x4x, etc. until you reach the setting where emulation is no longer full-speed. For systems where upscaling the rendering resolution is not possible, just write down "Full-speed" instead. For systems where the highest rendering resolution still runs at full-speed, write down "Max" (consider removing such systems from the benchmark if the high-end game runs at full-speed with "Max" rendering). 
- +  * Consider the speed of the game running during its regular gameplay, not during menus or transition screens. On that note, sometimes the "first area" of a game is significantly easier to render than other parts, be sure to move into other areas to make sure. 
-For games that run easily at full-speed, try increasing the rendering scale by an integer multiplication. Things like x2 resolution, x3x4, etc. until you reach the setting where emulation is no longer full-speed. For systems where upscaling the rendering resolution is not possible, just write down "Full-speed" instead.+  * For games that don't run at full-speed, note down the **average speed in percentage** for that system including the FPS in parenthesis (this is very subjective, but do what you feel is the best representation of the performance, some users may still find a "mostly full-speed" game acceptable to play). 
 +  * For games that are otherwise fine on other systems but crash/fail to render anything/other major issue, put down N/A and add a [[wiki:syntax#footnotes|footnote]] indicating the issue.
  
-For games that don't run at full-speed, note down the **average FPS** for that system (this is very subjective, but do what you feel is the best representation of the performance). Some users may still find a "mostly full-speed" game acceptable to play. +If you'd like a video example to compare to, watch this excellent one by ETA Prime: https://youtu.be/fQ2H842vnMw
- +
-If you'd like a video example to compare to, watch this excellent one by ETA Prime: +
- +
-{{youtube>fQ2H842vnMw}}+
  
   * 02:50 - **Dreamcast** This would be considered full-speed.   * 02:50 - **Dreamcast** This would be considered full-speed.
Line 28: Line 27:
   * 03:38 - **Atomiswave** This would be considered full-speed, despite the graphical issues. Theoretically, this could be fixed by using the proper drivers/settings in the emulator.   * 03:38 - **Atomiswave** This would be considered full-speed, despite the graphical issues. Theoretically, this could be fixed by using the proper drivers/settings in the emulator.
   * 04:03 - **N64** This would be considered full-speed (he did not test upscaling in this example).   * 04:03 - **N64** This would be considered full-speed (he did not test upscaling in this example).
-  * 04:54 - **PSP** This would be considered "x3". +  * 04:54 - **PSP** This would be considered "3x". 
-  * 06:22 - **Gamecube** For low-end games, this would be considered "x1". For high-end games, due to the drop down to 50 FPS, this would not be full-speed.+  * 06:22 - **Gamecube** For low-end games, this would be considered "1x". For high-end games, due to the drop down to 83% (50 FPS), this would not be full-speed.
   * 07:38 - **PS2** This would not be full-speed, as hacks/alternative regions needed to be utilized to achieve such a speed. Benchmarking should only consider performance at default settings.   * 07:38 - **PS2** This would not be full-speed, as hacks/alternative regions needed to be utilized to achieve such a speed. Benchmarking should only consider performance at default settings.
  
-For older systems that might be running a Nvidia card, do try to get the official Nvidia drivers working. If it's really old, you may have to use the [[https://wiki.batocera.org/supported_pc_hardware#legacy_nvidia_drivers|legacy build]]. If the CPU/motherboard is too old for even that, you may have to use an even older version of Batocera (such as **5.26**).+If running a version of Batocera before **v35**, for systems that might be running a Nvidia card, do try to get the official Nvidia drivers working. If it's really old, you may have to use the [[https://wiki.batocera.org/supported_pc_hardware#legacy_nvidia_drivers|legacy build]]. If the CPU/motherboard is too old for even that, you may have to use an even older version of Batocera (such as **5.26**).
  
 ===== Games to test ===== ===== Games to test =====
  
-The point of this list isn't to be exhaustive, but to be representative of the rough lower and upper bounds of an emulated system's capabilities. For this, games that are both low/high-end while still being relatively well-known have been selected. Systems below SNES are considered to be low-requirement enough that pretty much all x86_64 machines can run them at full-speed.+The point of this list isn't to be exhaustive, but to be representative of the rough lower and upper bounds of an emulated system's capabilities. For this, games that are both low/high-end while still being relatively well-known have been selected. Systems less demanding than **SNES** are considered to be low-requirement enough that pretty much all x86_64 machines can run them at full-speed. It is suitable to notate just the system variation you benchmarked (with exception to **GameCube/Wii** as they are nearly the same underlying system).
  
-  * **SNES** +Take this list as all the available suggested titles for benchmarking. It'recommended to take one or two titles from each tier of "DEMANDING" level, resulting in a benchmarking table that contains five to eight games totalFeel free to exclude systems/titles that don't offer much information. For instance, if a system runs full-speed for both the low-end and high-end titles, only the high-end title needs to be mentioned. Additional titles/systems not mentioned here can be included if you feel they are relevant to the performance of the hardware (or you just happen to have already installed instead). Roughly in order of performance required:
-    * Low-end SNES (Super Mario World) +
-    * High-end SNES (Super Mario World 2: Yoshi'Island) +
-  * **PSX** +
-    * Low-end PSX (Metal Slug X) +
-    * High-end PSX (Bloody Roar) +
-  * **N64** +
-    * Low-end N64 (Super Mario 64) +
-    * High-end N64 (Goldeneye 007) +
-  * **PSP** +
-    * Low-end PSP (Mega Man Maverick Hunter X) +
-    * High-end PSP (God of War: Chains of Olympus) +
-  * **Dreamcast** +
-    * Low-end Dreamcast (Marvel vsCapcom 2) +
-    * High-end Dreamcast (Sega Rally 2) +
-  * **GameCube** +
-    * Low-end GameCube (Mario Kart Double Dash) +
-    * High-end GameCube (Auto Modellista) +
-  * **Wii U** +
-    * Low-end Wii U (Super Mario Maker) +
-    * High-end Wii U (Breath of the Wild) +
-  * **PS2** +
-    * Low-end PS2 (Kingdom Hearts) +
-    * High-end PS2 (God of War)+
  
-Here'an example of such benchmark:+  * **LESS DEMANDING SYSTEMS** 
 +    * **SNES** 
 +      * Low-end SNES (Super Mario World) 
 +      * High-end SNES (Super Mario World 2: Yoshi'Island) 
 +    * **MAME2003** 
 +      * Low-end MAME2003 (Asteroids Deluxe/Pacman/Space Invaders) 
 +      * High-end MAME2003 (Puzzle Bobble 2) 
 +    * **PSX** 
 +      * Low-end PSX (Metal Slug X) 
 +      * High-end PSX (Bloody Roar/Bloody Roar 2: The New Breed) 
 +    * **N64** 
 +      * Low-end N64 (Super Mario 64) 
 +      * High-end N64 (Goldeneye 007/Perfect Dark) 
 +    * **NDS** 
 +      * Low-end NDS (Tetris DS) 
 +      * High-end (Pokemon Diamond/Pokemon Pearl/Solatorobo The Red Hunter) 
 +  * **DEMANDING SYSTEMS** 
 +    * **MAME** 
 +      * Low-end MAME (Asteroids Deluxe/Pacman/Space Invaders) 
 +      * High-end MAME (Gauntlet Legends) 
 +    * **PSP** 
 +      * Low-end PSP (Mega Man Maverick Hunter X/Hatsune Miki - Project DIVA) 
 +      * High-end PSP (God of War: Chains of Olympus/Midnight Club: L.A. Remix/Tekken 6) 
 +    * **Dreamcast/Naomi** 
 +      * Low-end Dreamcast/Naomi (Marvel vs. Capcom 2: New Age of Heroes) 
 +      * High-end Dreamcast/Naomi (Sega Rally 2/NBA 2K2) 
 +    * **GameCube/Triforce/Wii**((Special exception here, you should always notate this as GameCube/Wii as their system requirements are similar if not identical; there are lot of GameCube games which are tougher to emulate than Wii games.)) 
 +      * Low-end GameCube/Triforce/Wii (Mario Kart Double Dash) 
 +      * High-end GameCube/Triforce/Wii (Metroid Prime 2Echoes/Super Smash Bros. Melee/Auto Modellista/F-Zero GX)((Notably, Star Wars Rogue Squadron III: Rebel Strike is not here as it performs so poorly as to be misrepresentative of how the emulator performs in other demanding titles.)) 
 +    * **3DS**((Indicate whether you are testing with or without shaders already being compiled in a footnote. Results can vary greatly if the emulator is processing shaders for the first time.)) 
 +      * Low-end 3DS (Super Mario 3D Land) 
 +      * High-end 3DS (Pokémon Sun and Moon/Kid Icarus: Uprising) 
 +  * **VERY DEMANDING SYSTEMS** 
 +    * **Saturn** 
 +      * Low-end Saturn (Saturn Bomberman) 
 +      * High-end Saturn (Panzer Dragoon/Sega Rally Championship) 
 +    * **Wii U**((Indicate whether you are testing with or without shaders already being compiled in a footnote. Results can vary greatly if the emulator is processing shaders for the first time.)) 
 +      * Low-end Wii U (Super Mario Maker/Super Mario Bros. U) 
 +      * High-end Wii U (Breath of the Wild) 
 +    * **PS2** 
 +      * Low-end PS2 (Monster Hunter/Tekken 5/Sonic Riders/Sonic Riders: Zero Gravity/Beatmania/Marvel vs Capcom 2: New Age of Heroes) 
 +      * High-end PS2 (God of War/Gran Turismo 4/Shadow of the Colossus) 
 +    * **Xbox** 
 +      * Low-end Xbox (Jet Set Radio Future) 
 +      * High-end Xbox (Halo: Combat Evolved, Burnout 3: Takedown) 
 +    * **PS3** 
 +      * Low-end PS3 (Hatsune Miku Project DIVA F) 
 +      * High-end PS3 (Red Dead Redemption/GTA V/Sonic Unleashed/God of War 3) 
 +    * **Xbox 360** 
 +      * Low-end Xbox 360 (Hexic) 
 +      * High-end Xbox 360 (FIXME)
  
-FIXME+Here's an example benchmark for reference: 
 + 
 +==== Batocera v33 ==== 
 + 
 +^ CPU ^ GPU ^ High-end N64 (Goldeneye 007) ^ High-end PSP (Midnight Club: L.A. Remix) ^ Low-end Dreamcast (MvC2) ^ High-end Dreamcast (Sega Rally 2)  ^ High-end GameCube/Wii (Auto Modellista) ^ Low-end PS2 (Sonic Riders: Zero Gravity) ^ High-end PS2 (God of War) ^ Low-end Xbox (Jet Set Radio Future) ^ High-end Xbox (Burnout 3: Takedown) ^ 
 +| Intel Core i3-4350 | Nvidia GTX 750Ti | Full-speed | Max | Full-speed | 67% (40 FPS) | 5x | 2x | 1x | 4x | N/A((The game runs, but only renders a black screen.)) |
  
 You can also view the already existing benchmark tables at [[:choose_a_desktop_computer#benchmarks|the "Choose a Desktop/Benchmarks" page]]. Some of the older benchmarks use a different format, but contributions for older versions of Batocera are still accepted. You can also view the already existing benchmark tables at [[:choose_a_desktop_computer#benchmarks|the "Choose a Desktop/Benchmarks" page]]. Some of the older benchmarks use a different format, but contributions for older versions of Batocera are still accepted.
Line 71: Line 102:
 Once you have such a file, just throw the file (''.csv'' is fine) onto the Discord or edit it in yourself if you've been granted a Batocera Wiki account. Once you have such a file, just throw the file (''.csv'' is fine) onto the Discord or edit it in yourself if you've been granted a Batocera Wiki account.
  
-===== In case you'd like to get more technical =====+===== MangoHUD ===== 
 + 
 +Batocera's benchmarking is relatively simple, intentionally so. However, if you'd like to do further benchmarking just for the sake of seeing how your hardware is doing you can utilize the MangoHUD program (Batocera **v33** and higher). 
 + 
 +{{:wiki:screenshot-2021.10.09-20h53.32.jpg?640|}} 
 + 
 +In order to activate it, simply change the **HEADS UP DISPLAY** (in the **DECORATIONS** submenu) to "PERFORMANCE" in either the **MAIN MENU** -> **GAME SETTINGS** or that system's specific **ADVANCED SYSTEM SETTINGS**. 
 + 
 +{{:wiki:heads_up_display_option.png?640|}} 
 + 
 +MangoHUD has the following keyboard shortcuts: 
 + 
 +  * Right ''[Shift]'' + ''[F12]'': Toggle HUD 
 +  * Left ''[Shift]'' + ''[F2]'': Toggle [[https://github.com/flightlessmango/MangoHud#mangohud-fps-logging|Logging]] 
 +  * Left ''[Shift]'' + ''[F4]'': Reload Config 
 + 
 +==== Advanced MangoHUD configuration ==== 
 + 
 +[[https://github.com/flightlessmango/MangoHud#mangohud_config-and-mangohud_configfile-environment-variables|Environment values]] can be added to the ''global.hud_custom'' key in ''batocera.conf'', each value separated by a ''%%\n%%''. For example: 
 + 
 +<code> 
 +## HUD (x86 only) 
 +# game / perf / custom (in that case, configuration is read from hud_custom) 
 +#global.hud=perf 
 +#global.hud_custom=position=bottom-left\nbackground_alpha=0\nlegacy_layout=false\nfont_size=64\nimage_max_width=200\nimage=%THUMBNAIL%\ncustom_text=%GAMENAME%\ncustom_text=%SYSTEMNAME%\ncustom_text=%EMULATORCORE% 
 +# for example, the value for perf is position=bottom-left\nbackground_alpha=0.9\nlegacy_layout=false\ncustom_text=%GAMENAME%\ncustom_text=%SYSTEMNAME%\ncustom_text=%EMULATORCORE%\nfps\ngpu_name\nengine_version\nvulkan_driver\nresolution\nram\ngpu_stats\ngpu_temp\ncpu_stats\ncpu_temp\ncore_load 
 +</code> 
 + 
 +--> Notes for older Batocera versions (v32 and v31)#
  
 Batocera's benchmarking is relatively simple, intentionally so. However, if you'd like to do further benchmarking just for the sake of seeing how your hardware is doing you can utilize the MangoHUD program (Batocera **v31** and higher). Batocera's benchmarking is relatively simple, intentionally so. However, if you'd like to do further benchmarking just for the sake of seeing how your hardware is doing you can utilize the MangoHUD program (Batocera **v31** and higher).
Line 90: Line 149:
 {{ :wiki:screenshot-2021.10.09-20h53.32.jpg?640 |}} {{ :wiki:screenshot-2021.10.09-20h53.32.jpg?640 |}}
  
-In order to quit the game, you can just hit ''[Alt]'' + ''[F4]'' or run ''batocera-es-swissknife --emukill''. If you'd like to restart ES, run ''batocera-es-swissknife –restart''.+In order to quit the game, you can just hit ''[Alt]'' + ''[F4]'' or run ''%%batocera-es-swissknife --emukill%%''. If you'd like to restart ES, run ''%%batocera-es-swissknife –-restart%%''. 
 + 
 +<--
  
  • wiki/benchmarking_for_batocera.1633995953.txt.gz
  • Last modified: 2 years ago
  • by atari