PGOBenchmarks

Differences between revisions 1 and 2
Revision 1 as of 2012-06-26 22:03:54
Size: 11838
Comment:
Revision 2 as of 2012-07-04 15:37:24
Size: 12030
Comment:
Deletions are marked like this. Additions are marked like this.
Line 10: Line 10:
|| GCC4.7,PGO (buildd: crested) || 2095 || 2088 ||
|| GCC4.7,PGO (buildd: batsu) || 2064 || 2067 ||
|| GCC4.7,non-PGO || 1912 || 1878 ||
|| GCC4.7,non-PGO,no build hardening || 1919 || 1907 ||
|| GCC4.7,PGO (buildd: crested)* || 2095 || 2088 ||
|| GCC4.7,PGO (buildd: batsu)* || 2064 || 2067 ||
|| GCC4.7,non-PGO* || 1912 || 1878 ||
|| GCC4.7,non-PGO,no build hardening* || 1919 || 1907 ||
Line 16: Line 16:

* Note, that the GCC4.7 tests were performed with https://launchpad.net/bugs/1003733 which broke the webgl part of those tests. These should probably be repeated in order to be useful.

PGO Benchmarks

Peacekeeper

Configuration

Test 1

Test 2

GCC4.7,PGO (buildd: crested)*

2095

2088

GCC4.7,PGO (buildd: batsu)*

2064

2067

GCC4.7,non-PGO*

1912

1878

GCC4.7,non-PGO,no build hardening*

1919

1907

GCC4.6,non-PGO

2017

2008

GCC4.5,PGO,no build hardening (official mozilla.org build)

2054

2060

* Note, that the GCC4.7 tests were performed with https://launchpad.net/bugs/1003733 which broke the webgl part of those tests. These should probably be repeated in order to be useful.

V8

  • V8 version 6

  • All tests with Firefox 13.0b4 x86-64
  • Higher numbers are better
  • Scores are means and 95% CI (10 samples)

Configuration

Richards

DeltaBlue

Crypto

RayTrace

EarleyBoyer

RegExp

Splay

Score

GCC4.7,PGO (buildd: crested)

7712.9 +/-24.3

7085.1 +/-152.6

11828.2 +/-74.3

3221.9 +/-73.7

7596.4 +/-65.1

1587.5 +/-9.6

9333.8 +/- 108.9

5848.6 +/-17.6

GCC4.7,PGO (buildd: batsu)

7669.4 +/-41.9

7224 +/-133.3

11790.7 +/-118

3120.4 +/-36.6

7644.4 +/-55.4

1604.5 +/-9.9

9300.4 +/-138

5842.4 +/-14.7

GCC4.7,non-PGO

7638.8 +/-140.8

6730.8 +/-298.4

11737.8 +/-81.7

3132.1 +/-51.9

7304.2 +/-81.4

1543.8 +/-12.7

9377.2 +/-113.5

5715.8 +/-28.7

GCC4.7,non-PGO,no build hardening

7741 +/-76.3

7278.4 +/-157

11925.5 +/-71.4

3156.2 +/-68.3

7491.4 +/-92.9

1572.1 +/-12.3

9332.8 +/-44.6

5844.1 +/-38

GCC4.6,non-PGO

7630.3 +/-77.5

6847.9 +/-316.9

11749.8 +/-87.2

3183.3 +/-72.8

7145.2 +/-151.5

1589.8 +/-11.3

9256.1 +/-75.9

5738.1 +/-43.6

GCC4.5,PGO,no build hardening (official mozilla.org build)

7700.7 +/-50.2

7260 +/-61.4

11760.4 +/-104.5

2945.8 +/-61.5

6892.7 +/-200.2

1559.1 +/-14

9212.6 +/-149.3

5683.1 +/-42.2

Kraken

  • Kraken 1.1

  • All tests with Firefox 13.0b4 x86-64
  • Lower numbers are better
  • Scores are means and 95% CI

Configuration

ai

audio

imaging

json

stanford

total

GCC4.7,PGO (buildd: crested)

146.6ms +/- 2.2%

1315.3ms +/- 2.5%

1318.8ms +/- 0.5%

195.8ms +/- 12.9%

633.4ms +/- 3.2%

3609.9ms +/- 0.6%

GCC4.7,PGO (buildd: batsu)

145.4ms +/- 1.6%

1300.4ms +/- 2.7%

1316.0ms +/- 0.9%

193.9ms +/- 13.3%

637.3ms +/- 4.2%

3593.0ms +/- 1.0%

GCC4.7,non-PGO

146.9ms +/- 1.3%

1307.8ms +/- 2.3%

1313.3ms +/- 0.7%

185.0ms +/- 12.3%

656.3ms +/- 3.8%

3609.3ms +/- 0.9%

GCC4.7,non-PGO,no build hardening

145.1ms +/- 1.2%

1310.0ms +/- 3.2%

1334.6ms +/- 2.4%

181.3ms +/- 14.1%

642.9ms +/- 3.1%

3613.9ms +/- 0.7%

GCC4.6,non-PGO

146.2ms +/- 1.7%

1316.6ms +/- 2.8%

1328.9ms +/- 0.7%

186.2ms +/- 13.4%

653.6ms +/- 4.3%

3631.5ms +/- 1.2%

GCC4.5,PGO,no build hardening (official mozilla.org build)

148.2ms +/- 2.5%

1311.6ms +/- 2.3%

1313.3ms +/- 0.8%

187.5ms +/- 13.1%

628.8ms +/- 4.7%

3589.4ms +/- 1.1%

Sunspider

  • Sunspider 0.9.1

  • All tests with Firefox 13.0b4 x86-64
  • Lower numbers are better
  • Scores are means and 95% CI

Configuration

3d

access

bitops

controlflow

crypto

date

math

regexp

string

Total

GCC4.7,PGO (buildd: crested)

33.8ms +/- 8.5%

24.9ms +/- 12.4%

19.7ms +/- 13.9%

5.2ms +/- 21.3%

22.7ms +/- 12.0%

25.8ms +/- 7.4%

24.1ms +/- 9.8%

12.8ms +/- 7.4%

58.3ms +/- 4.0%

227.3ms +/- 4.1%

GCC4.7,PGO (buildd: batsu)

35.3ms +/- 11.3%

23.6ms +/- 10.3%

21.4ms +/- 12.5%

5.2ms +/- 25.8%

20.4ms +/- 7.6%

27.8ms +/- 11.0%

22.1ms +/- 11.5%

13.6ms +/- 10.9%

58.5ms +/- 6.4%

227.9ms +/- 2.1%

GCC4.7,non-PGO

34.2ms +/- 2.9%

24.0ms +/- 8.7%

17.0ms +/- 12.8%

3.2ms +/- 25.4%

22.1ms +/- 9.7%

29.7ms +/- 4.7%

20.2ms +/- 9.3%

13.1ms +/- 8.7%

62.0ms +/- 5.6%

225.5ms +/- 2.0%

GCC4.7,non-PGO,no build hardening

32.8ms +/- 3.2%

23.1ms +/- 9.7%

17.9ms +/- 10.9%

3.8ms +/- 26.3%

22.3ms +/- 6.6%

29.4ms +/- 3.3%

21.8ms +/- 8.4%

12.1ms +/- 1.9%

58.6ms +/- 2.6%

221.8ms +/- 2.3%

GCC4.6,non-PGO

34.5ms +/- 7.1%

19.7ms +/- 4.5%

15.8ms +/- 9.5%

3.2ms +/- 25.4%

20.2ms +/- 6.4%

29.4ms +/- 8.0%

20.8ms +/- 10.0%

12.2ms +/- 4.6%

60.2ms +/- 6.1%

216.0ms +/- 2.6%

GCC4.5,PGO,no build hardening (official mozilla.org build)

32.2ms +/- 6.2%

19.4ms +/- 3.1%

14.0ms +/- 4.2%

2.7ms +/- 12.8%

18.9ms +/- 6.0%

27.8ms +/- 2.4%

17.4ms +/- 2.1%

11.9ms +/- 3.4%

56.8ms +/- 4.2%

201.1ms +/- 1.7%

Dromaeo

Configuration

Total

3D mesh transformation

3D raytrace

AES Encryption/Decryption

Arrays

Base 64 Encoding and Decoding

Bitwise And

Code Evaluation

Compute Bits in Byte

Compute Bits in Byte (2)

DNA Sequence Alignment

DNA Sequence Counting

DOM Attributes

DOM Attributes (Prototype)

DOM Attributes (jQuery)

DOM Events (Prototype)

DOM Events (jQuery)

DOM Modification

DOM Modification (Prototype)

DOM Modification (jQuery)

DOM Query

DOM Style (Prototype)

DOM Style (jQuery)

DOM Traversal

DOM Traversal (Prototype)

DOM Traversal (jQuery)

Date Formatting

Date Formatting (2)

DeltaBlue Constraint Solving

Fannkuch

MD5 Hashing

N-Body Rotation and Gravity

Partial Sum Calculation

Prime Number Computation

Prime Number Computation (2)

RSA Encryption/Decryption

RayTracer

Recursive Number Calculation

Regular Expressions

Richards Benchmarks

Rotating 3D Cube

SHA1 Hashing

Script Unpacking

Spectral Norm of a Matrix

String Parsing and Searching

Strings

Tag Cloud Creation

Traversing Binary Trees

Trigonometric Calculation

Validate User Input

GCC4.7,PGO (buildd: crested)

523.48runs/s

1628.00runs/s

582.72runs/s

505.53runs/s

2479.89runs/s

1091.80runs/s

2889.00runs/s

808.77runs/s

3666.40runs/s

696.80runs/s

2550.91runs/s

278.38runs/s

605.72runs/s

598.95runs/s

782.66runs/s

174.98runs/s

26.96runs/s

269.35runs/s

170.89runs/s

425.78runs/s

9290.08runs/s

177.88runs/s

273.13runs/s

311.82runs/s

396.06runs/s

109.63runs/s

885.80runs/s

697.52runs/s

1025.79runs/s

1437.60runs/s

5240.20runs/s

1594.00runs/s

1779.20runs/s

575.57runs/s

1244.80runs/s

439.26runs/s

42.23runs/s

1560.78runs/s

203.96runs/s

2067.80runs/s

1038.28runs/s

5346.80runs/s

106.57runs/s

2734.20runs/s

92.02runs/s

1846.32runs/s

561.98runs/s

960.98runs/s

3237.20runs/s

661.61runs/s

GCC4.7,PGO (buildd: batsu)

512.90runs/s

1672.00runs/s

567.71runs/s

507.26runs/s

2558.82runs/s

1064.81runs/s

2865.20runs/s

811.54runs/s

3425.20runs/s

684.53runs/s

2521.87runs/s

277.46runs/s

594.71runs/s

572.39runs/s

725.77runs/s

169.35runs/s

26.91runs/s

254.03runs/s

168.55runs/s

412.31runs/s

8078.66runs/s

173.05runs/s

262.27runs/s

300.14runs/s

378.47runs/s

102.00runs/s

832.40runs/s

700.00runs/s

1001.80runs/s

1450.60runs/s

5351.20runs/s

1555.40runs/s

1759.40runs/s

571.97runs/s

1218.40runs/s

434.03runs/s

42.68runs/s

1549.20runs/s

202.33runs/s

2194.40runs/s

1057.26runs/s

5503.20runs/s

105.82runs/s

2762.00runs/s

97.17runs/s

1915.43runs/s

589.73runs/s

947.37runs/s

3176.40runs/s

655.41runs/s

GCC4.7,non-PGO

467.97runs/s

1563.00runs/s

541.09runs/s

430.65runs/s

2446.38runs/s

1048.95runs/s

2848.80runs/s

767.48runs/s

3373.00runs/s

663.07runs/s

2323.49runs/s

276.26runs/s

448.17runs/s

495.20runs/s

641.65runs/s

144.73runs/s

24.50runs/s

209.80runs/s

148.35runs/s

374.64runs/s

7408.06runs/s

134.68runs/s

213.00runs/s

257.23runs/s

326.17runs/s

97.19runs/s

817.64runs/s

594.92runs/s

983.00runs/s

1436.20runs/s

5202.20runs/s

1599.80runs/s

1633.60runs/s

521.68runs/s

1237.40runs/s

425.28runs/s

39.01runs/s

1504.61runs/s

199.20runs/s

2149.40runs/s

988.99runs/s

5197.40runs/s

104.53runs/s

2758.00runs/s

90.94runs/s

1747.56runs/s

558.67runs/s

914.12runs/s

3256.60runs/s

608.96runs/s

GCC4.7,non-PGO,no build hardening

475.37runs/s

1604.40runs/s

561.17runs/s

490.64runs/s

2482.50runs/s

1053.79runs/s

2872.60runs/s

767.14runs/s

3299.60runs/s

673.40runs/s

2442.78runs/s

281.02runs/s

458.17runs/s

501.99runs/s

633.50runs/s

151.55runs/s

24.97runs/s

212.08runs/s

148.58runs/s

376.20runs/s

7323.64runs/s

138.68runs/s

207.31runs/s

254.70runs/s

317.53runs/s

96.09runs/s

825.20runs/s

604.76runs/s

922.79runs/s

1436.60runs/s

5374.00runs/s

1617.80runs/s

1660.60runs/s

540.69runs/s

1243.60runs/s

420.82runs/s

39.88runs/s

1579.07runs/s

205.08runs/s

2176.00runs/s

955.94runs/s

5265.20runs/s

103.49runs/s

2761.20runs/s

93.36runs/s

1854.36runs/s

572.66runs/s

918.50runs/s

3200.20runs/s

621.27runs/s

GCC4.6,non-PGO

478.10runs/s

1566.00runs/s

523.55runs/s

492.75runs/s

2492.63runs/s

1018.88runs/s

2807.60runs/s

821.88runs/s

3413.40runs/s

660.27runs/s

2419.15runs/s

269.80runs/s

485.92runs/s

519.25runs/s

627.66runs/s

142.56runs/s

25.33runs/s

217.56runs/s

149.89runs/s

372.83runs/s

7395.48runs/s

143.12runs/s

221.16runs/s

264.83runs/s

349.89runs/s

98.90runs/s

800.31runs/s

593.96runs/s

985.00runs/s

1449.80runs/s

5397.60runs/s

1519.80runs/s

1603.00runs/s

515.64runs/s

1222.80runs/s

431.61runs/s

40.60runs/s

1537.95runs/s

203.41runs/s

2126.20runs/s

1040.95runs/s

5290.60runs/s

103.32runs/s

2789.00runs/s

90.79runs/s

1769.55runs/s

543.98runs/s

972.36runs/s

3228.40runs/s

633.86runs/s

GCC4.5,PGO,no build hardening (official mozilla.org build)

501.09runs/s

1650.00runs/s

560.15runs/s

490.70runs/s

2356.51runs/s

1065.77runs/s

2876.20runs/s

764.32runs/s

3464.40runs/s

673.60runs/s

2552.87runs/s

274.79runs/s

592.96runs/s

523.61runs/s

770.13runs/s

159.92runs/s

26.70runs/s

248.46runs/s

160.36runs/s

411.30runs/s

7452.69runs/s

164.86runs/s

264.91runs/s

278.84runs/s

358.10runs/s

107.08runs/s

829.00runs/s

620.75runs/s

1003.29runs/s

1413.60runs/s

5383.40runs/s

1572.80runs/s

1748.00runs/s

567.60runs/s

1218.60runs/s

435.82runs/s

37.51runs/s

1467.39runs/s

202.10runs/s

2154.40runs/s

1082.06runs/s

5467.80runs/s

104.22runs/s

2828.00runs/s

89.20runs/s

1832.26runs/s

586.92runs/s

958.16runs/s

3238.60runs/s

640.42runs/s

MozillaTeam/PGOBenchmarks (last edited 2012-07-04 15:37:24 by chrisccoulson)