Console Emulators: Our Newest Benchmark
by Derek Wilson on March 3, 2004 11:33 PM EST- Posted in
- GPUs
The Testing Setup
| Performance Test Configuration | |
| Processor(s): | AMD Athlon 64 3000+ AMD Athlon 64 3400+ Intel Pentium 4 3.4GHz EE Intel Pentium 4 3.2GHz Intel Pentium 4 3.2EGHz |
| RAM: | 2 x 512Mb OCZ 3500 Platinum Ltd |
| Hard Drive(s): | Seagate 120GB 7200 RPM (8MB Buffer) |
| Video AGP & IDE Bus Master Drivers: | VIA Hyperion 4.51 (12/02/03) Intel Chipset Drivers |
| Video Card(s): | Sapphire ATI Radeon 9800 PRO 128MB ATI Radeon 9800 XT ATI Radeon 9600 XT NVIDIA GeForce FX 5950 NVIDIA GeForce FX 5700 |
| Video Drivers: | ATI Catalyst 4.2 NVIDIA ForceWare 56.56 (WHQL) |
| Operating System(s): | Windows XP Professional SP1 |
| Motherboards: | Intel D875PBZ (Intel 875P Chipset) FIC K8-800T (VIA K8T800 Chipset) |
The games that we tested are Final Fantasy IX and Gran Turismo 2 (along with a preview of things to come in The Legend of Zelda: The Windwaker).
The only important issue to note when looking at the performance data is that FRAPS reports sometimes framerates that are between 50% and 25% of what the plugin reports. From what we understand, the game sees between two and four vblank interrupts before it draws one screen (meaning the game doesn't update the screen on every vblank). For Final Fantasy IX, we generally see a 25% framerate during MDEC playback, 30% while traveling the world map, 50% when walking around off the world map, and 100% when in a battle scene or menu system. Please keep this in mind as FRAPS might be reporting 30fps at points, but the game could still be running at full speed. We will point out these differences again on the test pages.
Facebook
Twitter
RSS
37 Comments
View All Comments
TrogdorJW - Thursday, March 4, 2004 - link
Pretty interesting read. I highly doubt that emulation of any of the lesser consoles would prove to be a good benchmark, except as a CPU benchmark. Maybe N64 would be okay, but SNES, Genesis, and anything earlier are all so "simple" compared to modern 3D consoles that performance is almost a non-issue. Anyway, good article, even if it is inherently biased towards ATI. Not much that can be done about that, though, unless some skilled programmers with Nvidia hardware want to try and release a better plugin.My one thought is that even with the disclaimer up front stating that Pete owns a 9700 and thus his plugins are written and tested on ATI first and foremost, there are probably going to be some clueless people out there saying, "OMG ATI pwned Nvidia again." Then again, there's not much that can be done to help the clueless. Maybe someone should start up a charity for them? :) Anyway, I was thinking a little disclaimer at the bottom or top of each page of the article might be nice, but it's probably much more effort than it's worth.
DerekWilson - Thursday, March 4, 2004 - link
(#22) KGB:if you own a playstation (or have the legal rights to a playstation BIOS) you could rent a game from blockbuster, download the tools used in the article and play a game on your PC ... The problem with that is that my blockbuster doesn't rent out playstation games anymore :-(
There is another option if you don't own a PS BIOS ... you can use an emulator with an HLE BIOS (at the cost of perfect BIOS support for your games). PCSX has a builtin HLE BIOS.
(#21) Junkman:
I hate to spoil it for everyone, so I hope someone else watched the same cartoons as I did in my formative years ... Adult Swim on the cartoon network has become my favorite stuff now, but this reference is a throwback to one of my favorite cartoon duos of all time ...
KGB - Thursday, March 4, 2004 - link
SO if i rent a game from blockbuster, pop it in my CD-ROM drive, the game works with my pc?Junkman - Thursday, March 4, 2004 - link
Rubber pants and whipped cream????? Interesting article. Thanks DerekSDA - Thursday, March 4, 2004 - link
Depends on what you define as fair, #19. It's a real-world benchmark, so above all else it's useful for determining how video cards perform in that specific application. Whether or not performance in it can be applied to other applications, ePSXe with Pete's OGL plugin is just one of (if not THE) best method of PSX emulation out there, so why not use it for a benchmark?boboy - Thursday, March 4, 2004 - link
It's no insider secret that Pete Bernett uses ATI cards. He programs his plugins with very few outside testers, and he has a SERIOUS lacking of of nvidia testers. So much, he didn't even know his initial version of his OGL2 plugin didn't support Geforce 4 Ti cards on winXP until he signed on NGEmu a day later. He doesn't do anything like that on purpose, which is obvious since his OGL2 plugin is getting better and better with nvidia cards with every release. It's just that the usefullness of this test is next to nil because the plugin runs far better on ATi cards than NVidia cards.Although it should also be noted that OpenGL2 was made for compatibility, not visual quality. A lesser card can make a game look much prettier in full speed on his other plugins, although you'll often come across graphical glitches, and you'll need to be turning on special game fixes (hacks/workaronds) and the such for quite a few of the games. Hell, even my old TNT2 can run alot of psx games with good quality at 60fps.
All in all, this was a very interesting read, as I follow the emulation scene myself. But in the end, I don't think these kind of benchmarks can give anywhere near as fair results than other benchmarks, programs that were designed to use the full extent of both card brands equally.
elty - Thursday, March 4, 2004 - link
ePSXe and Pete's plugin used to work with GeForce better. Pete has some updates, but ePSXe remains about unchanged. So do you have any insider info that it is written based on ATi card only before you flame? Mayber later we don't need any conclusion at all becasue all you will come up with is "Card A perform poorly on Game X becasue Developer M did it on purpose" or "It shows that CPU B pays money to all developers so it will run faster than CPU D"tfranzese - Thursday, March 4, 2004 - link
Fair in my perspective, and interesting even though I don't delve into emulators much - I do find them entertaining from time to time.SDA - Thursday, March 4, 2004 - link
It's a good idea, but if FFIX is any indication it's just barely too late, as the hardware used (even the 5700 Ultra) seems to be able to handle the games being used without much trouble. I know this might sound stupid, but is it possible to force antialiasing in the driver options and have it carry over to the game? Or was something that did this just as well already enabled, or does this not do anything? I was just thinking, because if it works like it does in un-emulated games it would strain the video cards more.. probably some reason this can't be done, though. In that case, what is it?Also, while it's interesting from an academic standpoint when real-world benches such as this favor one manufacturer's products over another, it doesn't change the validity of the benchmarks. After all, in real-world benchmarks you actually want to see how everything performs in that specific benchmark. In other words, yeah, in my opinion it's perfecty fair. That's just me, though.
DerekWilson - Thursday, March 4, 2004 - link
(#11) taleril:We think that's fair enough as well; now we have:
"From our benchmarks, it is obvious that ATI Radeon cards are better suited for emulating the games that we tested under ePSXe and Pete's plugins with the settings we chose."
It is definitely important to be specific about exactly what a part was better at doing than another part. It is not good practice to do otherwise.
We feel that this is a fair comparison of ATI and NVIDIA products performance in the independant software development segment based on our statments on page 4 of the article. This is a different issue than that of corporate development since what we care about most is end user value. We are demonstrating the proper value of the hardware in the emulator space.
I hope this clears things up a bit.