As of 2016-02-26, there will be no more posts for this blog. s/blog/pba/
Showing posts with label Opera. Show all posts

1   Firefox 4 and Opera

Just heard3 about this new benchmark Kraken4, so I tried it with FF4 beta and Opera 10.61. I only have two browsers on my system currently, it’s too bad that I don’t have Chromium to compare because the results are quite interesting…


TEST COMPARISON FROM TO DETAILS
(Opera 10.61) (FF 4.0b7pre 20100914)
====================================================================================

** TOTAL **: 1.50x as fast 19627.2ms +/- 2.3% 13061.5ms +/- 1.1% significant

====================================================================================

ai: 1.41x as fast 3344.5ms +/- 13.0% 2371.8ms +/- 6.4% significant
astar: 1.41x as fast 3344.5ms +/- 13.0% 2371.8ms +/- 6.4% significant

audio: 1.55x as fast 6657.7ms +/- 1.2% 4307.2ms +/- 1.0% significant
beat-detection: 1.071x as fast 1301.8ms +/- 3.7% 1215.3ms +/- 2.0% significant
dft: 2.54x as fast 2844.6ms +/- 2.8% 1119.4ms +/- 2.7% significant
fft: 1.051x as fast 1137.7ms +/- 1.3% 1082.4ms +/- 3.0% significant
oscillator: 1.54x as fast 1373.6ms +/- 1.8% 890.1ms +/- 0.9% significant

imaging: 2.30x as fast 7628.8ms +/- 1.4% 3318.3ms +/- 1.6% significant
gaussian-blur: 3.46x as fast 5256.8ms +/- 1.8% 1517.7ms +/- 0.8% significant
darkroom: 1.67x as fast 989.6ms +/- 1.9% 592.7ms +/- 0.8% significant
desaturate: 1.144x as fast 1382.4ms +/- 1.3% 1207.9ms +/- 3.8% significant

json: *1.32x as slow* 302.4ms +/- 1.4% 399.1ms +/- 0.7% significant
parse-financial: *1.88x as slow* 134.9ms +/- 1.9% 253.9ms +/- 0.8% significant
stringify-tinderbox: 1.154x as fast 167.5ms +/- 2.1% 145.2ms +/- 1.0% significant

stanford: *1.57x as slow* 1693.8ms +/- 2.8% 2665.1ms +/- 0.6% significant
crypto-aes: *1.93x as slow* 377.8ms +/- 9.8% 729.6ms +/- 0.6% significant
crypto-ccm: *1.109x as slow* 473.2ms +/- 10.5% 524.7ms +/- 1.9% significant
crypto-pbkdf2: *1.85x as slow* 634.3ms +/- 4.0% 1176.0ms +/- 0.7% significant
crypto-sha256-iterative: *1.126x as slow* 208.5ms +/- 1.1% 234.8ms +/- 1.6% significant

As you can see FF4 is faster in three categories of tests: ai, audio and imaging; and slower in json and crypto categories. Last month, from results of SunSpider, Opera 10.61 is faster than FF4.0b5pre. Now, with tests above, FF4.0b7pre is faster.

[3]The original link was http://blog.mozilla.com/rob-sayre/2010/09/14/release-the-kraken/, but it returns 410 GONE.
[4]The original link was http://www.krakenbenchmark.com/, the content was gone.

2   Firefox 3.6.9


===============================================
RESULTS (means and 95% confidence intervals)
-----------------------------------------------
Total: 27035.3ms +/- 1.2%
-----------------------------------------------

ai: 4529.0ms +/- 5.3%
astar: 4529.0ms +/- 5.3%

audio: 9842.9ms +/- 1.3%
beat-detection: 2299.4ms +/- 2.2%
dft: 3488.6ms +/- 1.8%
fft: 2212.1ms +/- 3.0%
oscillator: 1842.8ms +/- 4.0%

imaging: 7502.1ms +/- 1.5%
gaussian-blur: 3481.2ms +/- 2.8%
darkroom: 834.8ms +/- 0.8%
desaturate: 3186.1ms +/- 2.5%

json: 520.9ms +/- 1.2%
parse-financial: 350.7ms +/- 1.4%
stringify-tinderbox: 170.2ms +/- 1.9%

stanford: 4640.4ms +/- 1.0%
crypto-aes: 1367.0ms +/- 0.9%
crypto-ccm: 1028.7ms +/- 1.4%
crypto-pbkdf2: 1676.7ms +/- 1.8%
crypto-sha256-iterative: 568.0ms +/- 0.6%

I ran it four times, two of them crashed Firefox and this test used a lot of memory, more than 1 GB. I am also compiling Chromium for this benchmark, result will be added later.

3   Firefox ESR 17.0.2 with Kraken 1.1


===============================================
RESULTS (means and 95% confidence intervals)
-----------------------------------------------
Total: 6688.6ms +/- 1.4%
-----------------------------------------------

ai: 236.7ms +/- 3.7%
astar: 236.7ms +/- 3.7%

audio: 2528.1ms +/- 3.7%
beat-detection: 610.8ms +/- 1.1%
dft: 1047.5ms +/- 6.1%
fft: 444.9ms +/- 0.6%
oscillator: 424.9ms +/- 18.1%

imaging: 2505.4ms +/- 2.4%
gaussian-blur: 1438.1ms +/- 4.1%
darkroom: 550.3ms +/- 0.2%
desaturate: 517.0ms +/- 4.3%

json: 276.8ms +/- 2.7%
parse-financial: 152.6ms +/- 3.6%
stringify-tinderbox: 124.2ms +/- 4.4%

stanford: 1141.6ms +/- 1.4%
crypto-aes: 263.0ms +/- 1.5%
crypto-ccm: 199.5ms +/- 1.5%
crypto-pbkdf2: 509.0ms +/- 1.7%
crypto-sha256-iterative: 170.1ms +/- 3.7%

4   Chromium 7.0.517.5


===============================================
RESULTS (means and 95% confidence intervals)
-----------------------------------------------
Total: 22962.1ms +/- 0.6%
-----------------------------------------------

ai: 1220.5ms +/- 0.5%
astar: 1220.5ms +/- 0.5%

audio: 8739.2ms +/- 0.8%
beat-detection: 2288.9ms +/- 1.1%
dft: 3169.9ms +/- 2.1%
fft: 2370.6ms +/- 0.5%
oscillator: 909.8ms +/- 0.6%

imaging: 11067.4ms +/- 0.9%
gaussian-blur: 5549.8ms +/- 1.9%
darkroom: 2748.7ms +/- 1.7%
desaturate: 2768.9ms +/- 1.1%

json: 890.2ms +/- 0.3%
parse-financial: 507.0ms +/- 0.4%
stringify-tinderbox: 383.2ms +/- 0.4%

stanford: 1044.8ms +/- 0.7%
crypto-aes: 229.3ms +/- 0.9%
crypto-ccm: 190.3ms +/- 0.5%
crypto-pbkdf2: 435.0ms +/- 0.8%
crypto-sha256-iterative: 190.2ms +/- 1.4%

5   Summary

http://chart.apis.google.com/chart?chxr=0,0,30000&chxt=y&chbh=a&chs=628x240&cht=bvg&chco=FF9900,80C65A,76A4FB,FFCC33&chds=0,30000,0,30000,0,30000,0,30000&chd=t:13061.5|19627.2|22962.1|27035.3&chdl=Firefox+4|Opera+10|Chromium+7|Firefox+3.6&chdlp=b&chma=0,0,0,10|0,35

Browser Version Total Time To FF4
Firefox 4.0b7pre 13061.5 ms --------
Opera 10.61 19627.2 ms + 50.27%
Chromium 7.0.517.5 22962.1 ms + 75.80%
Firefox 3.6.9 27035.3 ms +106.98%

See the image by yourself:


I have Opera 10 and Firefox 3.5 to show you how I don't like the select box in Chrome (4.0.275.0, Chromium) on Linux. You can see the dropdown box is shorter than text input and the button. It creates strange visual distraction, quite annoying. The others two browsers have same tall UI elements, I don't know what's wrong with Chrome.

The HTML code is:
<!doctype html>
<html>
<head>
<title>Hello HTML</title>
</head>
<body>
<p>Hello World!</p>
<input type="text" value="Text Input"/>
<input type="button" value="Click on me!"/>
<select>
<option>This is always shorter and I hate that!</option>
<option>Option2</option>
</select>
</body>
</html>

I don't have any other WebKit-based browser installed, therefore I really don't know if this is Chrome's problem or Webkit's. I hope it will have same visual appearance in further releases. I couldn't find an issue on its list about, but I am also lazy to create one. So give me a link, I will star it.
Updated on 2010-01-17 with Chromium 4.0.295.0:

It's still the same story...

chromium-4.0.295.0