From: mem@jhufos.pha.jhu.edu (Mel Martinez x8378) Subject: [*]sys70_vs_71_speed.txt Date: Fri, 27 Nov 92 18:15:59 EST report/sys71_vs_70_speed.txt This submission is a compilation report on the speed of the Mac OS System version 7.1 versus System version 7.0.1 on various Mac models. The motivation for this report was the many rumours going around about a performance decline in SANE performance on some machines. Since changes in performance of the System has a direct effect on users' productivity, I thought it would be useful to compile actual tests so that people could refer to actual facts when making the decision on whether to upgrade to Sys7.1 or not. The tests used are the suite of benchmarks performed by the program info-mac/util/speedometer_31.hqx. These benchmarks are only valid for comparison purposes between mac models and should not be used to compare to other platforms. Also, when looking at ANY benchmarks, you should always keep in mind that no single benchmark ever tells the whole story. If you do not understand the meaning of a particular benchmark in the following listings, I strongly urge you to download Speedometer and read the screens presented in the on-line help feature. The machines tested here represent only a small subset of the growing family of mac models. Still, a fairly good cross-section of machines are represented: The Mac LC, Mac IIci, PowerBook 170 & Quadra 700. I would love to have included more machines, but these are the only reports that have been submitted to me so far. As I am about to leave town on research for a few weeks, I can not wait for more & thought I would go ahead and submit these. Short summary of results: The details vary from machine to machine, but the bottom line seems to be that there is not a tremendous amount of performance difference between the two system versions. Sys 7.1 IS about 10% faster at quickdraw graphics on the Quadra, but in all other tests the differences are small, with a few exceptions here and there. See individual results for details. I would like to thank Murph Sewall, K. David Hawksworth & Daniel Schwalbe for their help in assembling this report. This report replaces info-mac/report/sys-70-71-speeds.txt. Mel Martinez The Johns Hopkins University Dept. of Physics mem@jhufos.pha.jhu.edu *************************************************************************** Quadra 700 tests *************************************************************************** Tests performed by : Mel Martinez mem@jhufos.pha.jhu.edu I performed 4 different tests with the Quadra 700: Sys 7.0.1 w/Extentions ON, Sys 7.0.1 w/Extentions OFF, Sys 7.1 w/Extentions ON and Sys 7.1 w/Extentions OFF. I found very little performance difference except for quickdraw. In other tests, sys7.1 was *slightly* faster than 7.0.1, but not tremendously. ===========Sys 7.0 + Extentions OFF======= Speedometer Report for mem. Prepared November 5, 1992. Machine Record Version #: 5 User Comment: Q700: 8 MB, Q105HD, Sys7.0.1, Internal Video, Extensions OFF System Information: Computer: Mac Quadra 700 CPU: MC68040 FPU: Integral FPU MMU: Integral MMU Color Quickdraw: 2.30 (32 Bit QD) System Version: 7.0.1 Finder Version: 7.0 AppleTalk Version: 56 LaserWriter Version: 7.1.1 Laser Prep Version: Not Found ImageWriter Version: Not Found ROM Version: $067C ROM Size: 1024 Bit Depth: 8 Horizontal DPI: 77 Vertical DPI: 77 Primary Screen Size: 1152 x 870 Physical RAM: 8192K Logical RAM: 8179K P.R. Results (Uses Mac Classic as 1.0): CPU: 16.320 Graphics: 19.497 Disk: 2.348 Name of Hard Disk tested: Spectre Math: 100.918 Performance Rating (PR): 22.939 Benchmark Results (Uses Mac Classic as 1.0): KWhetstones: 1153.846 158.061 Dhrystones: 20000.000 20.526 Towers: 18.909 QuickSort: 17.166 Bubble Sort: 18.000 Queens: 19.083 Puzzle: 22.083 Permutations: 20.254 Fast Fourier: 126.247 F.P. Matrix Multiply: 117.945 Integer Matrix Multiply: 23.527 Sieve: 19.268 Benchmark Average: 48.422 FPU Tests (Uses Mac II as 1.0): FFPU Fast Fourier: 10.733 FPU KWhetstones: 4285.714 6.000 FPU F.P. Matrix Mult.: 11.025 FPU Test Average: 9.252 Color Tests (Uses Mac II as 1.0): Black & White: 4.820 4 Colors: 4.961 16 Colors: 4.876 256 Colors: 4.576 Color Test Average: 4.808 ========= Sys 7.0 + Extentions ON===== User Comment: Q700, 8 MB, Q105HD, Sys 7.0.1 + Tup 1.1.1, Caches ON, AppleTalk ON, File Sharing ON, Numerous (30+) CPs & Extentions. System Information: [Same as previous report] P.R. Results (Uses Mac Classic as 1.0): CPU: 15.871 Graphics: 18.943 Disk: 2.248 Name of Hard Disk tested: Spectre Math: 101.086 Performance Rating (PR): 22.589 Benchmark Results (Uses Mac Classic as 1.0): KWhetstones: 1111.111 152.207 Dhrystones: 19607.843 20.124 Towers: 18.909 QuickSort: 17.166 Bubble Sort: 17.608 Queens: 18.320 Puzzle: 21.721 Permutations: 20.254 Fast Fourier: 126.247 F.P. Matrix Multiply: 115.839 Integer Matrix Multiply: 22.289 Sieve: 18.878 Benchmark Average: 47.463 FPU Tests (Uses Mac II as 1.0): FFPU Fast Fourier: 10.733 FPU KWhetstones: 4000.000 5.600 FPU F.P. Matrix Mult.: 10.750 FPU Test Average: 9.027 Color Tests (Uses Mac II as 1.0): Black & White: 4.637 4 Colors: 4.779 16 Colors: 4.709 256 Colors: 4.450 Color Test Average: 4.644 ========Sys 7.1 + Extentions OFF======= Speedometer Report for mem. Prepared November 5, 1992. User Comment: Q700: 8MB, Q105HD, Sys7.1,Caches ON, Internal Video & Ethernet, All Extentions OFF System Information: Computer: Mac Quadra 700 CPU: MC68040 FPU: Integral FPU MMU: Integral MMU Color Quickdraw: 2.30 (32 Bit QD) System Version: 7.1.6 Finder Version: 7.1 AppleTalk Version: 57 LaserWriter Version: 7.1.2 Laser Prep Version: Not Found ImageWriter Version: Not Found ROM Version: $067C ROM Size: 1024 Bit Depth: 8 Horizontal DPI: 77 Vertical DPI: 77 Primary Screen Size: 1152 x 870 Physical RAM: 8192K Logical RAM: 8179K P.R. Results (Uses Mac Classic as 1.0): CPU: 16.320 Graphics: 19.497 Disk: 2.333 Name of Hard Disk tested: Spectre Math: 102.203 Performance Rating (PR): 23.064 Benchmark Results (Uses Mac Classic as 1.0): KWhetstones: 1153.846 158.061 Dhrystones: 20000.000 20.526 Towers: 18.352 QuickSort: 17.166 Bubble Sort: 18.000 Queens: 18.320 Puzzle: 22.083 Permutations: 20.254 Fast Fourier: 127.619 F.P. Matrix Multiply: 117.945 Integer Matrix Multiply: 22.891 Sieve: 19.268 Benchmark Average: 48.374 FPU Tests (Uses Mac II as 1.0): FPU Fast Fourier: 10.733 FPU KWhetstones: 4000.000 5.600 FPU F.P. Matrix Mult.: 11.025 FPU Test Average: 9.119 Color Tests (Uses Mac II as 1.0): Black & White: 4.904 4 Colors: 5.158 16 Colors: 5.277 256 Colors: 5.256 Color Test Average: 5.149 =======Sys 7.1 + Extentions ON====== User Comment: Q700: 8 MB, Q105HD, Sys 7.1, Internal Video & Ethernet, Caches ON, AppleTalk ON, NUMEROUS CPs & Extentions ON System Information: [Same as previous report] P.R. Results (Uses Mac Classic as 1.0): CPU: 16.018 Graphics: 19.309 Disk: 2.319 Name of Hard Disk tested: Spectre Math: 101.268 Performance Rating (PR): 22.791 Benchmark Results (Uses Mac Classic as 1.0): KWhetstones: 1153.846 158.061 Dhrystones: 19736.842 20.256 Towers: 18.352 QuickSort: 17.166 Bubble Sort: 18.000 Queens: 19.083 Puzzle: 21.370 Permutations: 20.254 Fast Fourier: 126.247 F.P. Matrix Multiply: 117.945 Integer Matrix Multiply: 22.891 Sieve: 19.071 Benchmark Average: 48.225 FPU Tests (Uses Mac II as 1.0): FFPU Fast Fourier: 10.733 FPU KWhetstones: 4000.000 5.600 FPU F.P. Matrix Mult.: 11.315 FPU Test Average: 9.216 Color Tests (Uses Mac II as 1.0): Black & White: 4.727 4 Colors: 4.961 16 Colors: 5.073 256 Colors: 5.068 Color Test Average: 4.957 *************************************************************************** Mac LC tests *************************************************************************** Tests performed by: K. David Hawksworth khawkswo@magnus.acs.ohio-state.edu Here are Speedometer 3.1 results comparing System 7.0.1/Tuneup 1.1.1 vs 7.1 on my Mac LC. 7.1 is on my 40 meq Quantum internal drive and 7.0.1 is residing in a 50 meq partition on my Futjisu 90 meq External. I'm not sure what influence the drive has on Speedometer results. There is a difference in disk performance between the two drives according to Speedometer. At any rate, I hope these measurements are useful to you. I was very suprised to see 7.1 give slightly better results. My perception has been that 7.1 runs a *tad* slower than 7.0.1/tuned. I quess it must be all in my head. :-) K. David Hawksworth =========Sys 7.1============== Speedometer Report for . Prepared November 17, 1992. Machine Record Version #: 5 User Comment: System 7.1 HD Optimized prior to test. EXT/CP Loaded: Disinfectant 2.9 SuperClock 3.9.1 QuickTime 1.5 Extension Manager 1.8 SuperLaserSpool 3.0 Darkside 3.2 open in background System Information: Computer: Mac LC CPU: MC68020 FPU: No FPU MMU: Mac II AMU Color Quickdraw: 2.30 (32 Bit QD) System Version: 7.1.6 Finder Version: 7.1 AppleTalk Version: Not Loaded LaserWriter Version: Not Found Laser Prep Version: Not Found ImageWriter Version: 7.0.1 ROM Version: $067C ROM Size: 512 Bit Depth: 8 Horizontal DPI: 72 Vertical DPI: 72 Primary Screen Size: 640 x 480 Physical RAM: 4096K Logical RAM: 4092K P.R. Results (Uses Mac Classic as 1.0): CPU: 3.545 Graphics: 4.401 Disk: 1.918 Name of Hard Disk tested: SANTA 90 Math: 4.125 Performance Rating (PR): 3.534 Benchmark Results (Uses Mac Classic as 1.0): KWhetstones: 34.924 4.784 Dhrystones: 2313.030 2.373 Towers: 2.345 QuickSort: 3.410 Bubble Sort: 3.990 Queens: 3.606 Puzzle: 3.571 Permutations: 3.035 Fast Fourier: 3.274 F.P. Matrix Multiply: 3.268 Integer Matrix Multiply: 3.619 Sieve: 4.695 Benchmark Average: 3.497 =========Sys 7.0.1=========== Speedometer Report for . Prepared November 17, 1992. Machine Record Version #: 5 User Comment: System 7.0.1/Tuneup 1.1.1 HD Optimized Prior to Test Following Ext/CP Loaded: Disinfectant 2.9 SuperClock 3.9.1 QuickTime 1.5 Extension Manager 1.8 SuperLaserSpool 3.0 Darkside 3.2 Open in Background System Information: Computer: Mac LC CPU: MC68020 FPU: No FPU MMU: Mac II AMU Color Quickdraw: 2.30 (32 Bit QD) System Version: 7.0.1 Finder Version: 7.0 AppleTalk Version: Not Loaded LaserWriter Version: Not Found Laser Prep Version: Not Found ImageWriter Version: 7.0 ROM Version: $067C ROM Size: 512 Bit Depth: 8 Horizontal DPI: 72 Vertical DPI: 72 Primary Screen Size: 640 x 480 Physical RAM: 4096K Logical RAM: 4092K P.R. Results (Uses Mac Classic as 1.0): CPU: 3.537 Graphics: 4.436 Disk: 1.386 Name of Hard Disk tested: F-90 Math: 4.115 Performance Rating (PR): 3.434 Benchmark Results (Uses Mac Classic as 1.0): KWhetstones: 34.863 4.775 Dhrystones: 2313.030 2.373 Towers: 2.345 QuickSort: 3.344 Bubble Sort: 3.990 Queens: 3.606 Puzzle: 3.571 Permutations: 3.035 Fast Fourier: 3.256 F.P. Matrix Multiply: 3.263 Integer Matrix Multiply: 3.650 Sieve: 4.707 Benchmark Average: 3.493 ************************************************************************ Mac IIci tests ************************************************************************ Tests performed by: Daniel Schwalbe G00017@MSUS1.MSUS.EDU I broke down over the weekend and installed system 7.1. Very smooth installation. I ran some timing tests using a math program called Maple and I got about a 2% speedup with 7.1 which was about the improvements in FPU benchmarks that speedometer showed. The slowdown in Math ratings that speedometer showed did not seem to affect Maple in the few tests I ran. Also, the first time I ran the tests with 7.1, I got a disk rating of 1.0. After removing a 2.5 megabyte temp file the installer left behind in the system folder, I got 2.17. Following are speedometer results. I restarted the machine with the extensions off just before running each test. =============Sys 7.0.1================ Speedometer Report for . Prepared November 22, 1992. Machine Record Version #: 5 User Comment: ???? System Information: Computer: Mac IIci CPU: MC68030 FPU: MC68882 MMU: MC68030 MMU Color Quickdraw: 2.30 (32 Bit QD) System Version: 7.0.1 Finder Version: 7.0 AppleTalk Version: 56 LaserWriter Version: 7.1.1 Laser Prep Version: Not Found ImageWriter Version: Not Found ROM Version: $067C ROM Size: 512 Bit Depth: 8 Horizontal DPI: 72 Vertical DPI: 72 Primary Screen Size: 640 x 480 Physical RAM: 20480K Logical RAM: 20158K P.R. Results (Uses Mac Classic as 1.0): CPU: 6.455 Graphics: 9.654 Disk: 1.776 Name of Hard Disk tested: Macintosh HD Math: 19.848 Performance Rating (PR): 7.818 Benchmark Results (Uses Mac Classic as 1.0): KWhetstones: 281.690 38.587 Dhrystones: 5545.286 5.691 Towers: 4.800 QuickSort: 5.597 Bubble Sort: 7.363 Queens: 6.273 Puzzle: 8.439 Permutations: 4.603 Fast Fourier: 19.933 F.P. Matrix Multiply: 19.192 Integer Matrix Multiply: 7.770 Sieve: 7.628 Benchmark Average: 11.323 FPU Tests (Uses Mac II as 1.0): FFPU Fast Fourier: 2.300 FPU KWhetstones: 1250.000 1.750 FPU F.P. Matrix Mult.: 2.139 FPU Test Average: 2.063 Color Tests (Uses Mac II as 1.0): Black & White: 2.558 4 Colors: 2.717 16 Colors: 2.794 256 Colors: 2.338 Color Test Average: 2.602 Next for 7.1: Speedometer Report for . Prepared November 22, 1992. Machine Record Version #: 5 User Comment: ???? System Information: Computer: Mac IIci CPU: MC68030 FPU: MC68882 MMU: MC68030 MMU Color Quickdraw: 2.30 (32 Bit QD) System Version: 7.1.6 Finder Version: 7.1 AppleTalk Version: 57 LaserWriter Version: 7.1.2 Laser Prep Version: Not Found ImageWriter Version: Not Found ROM Version: $067C ROM Size: 512 Bit Depth: 8 Horizontal DPI: 72 Vertical DPI: 72 Primary Screen Size: 640 x 480 Physical RAM: 20480K Logical RAM: 20158K P.R. Results (Uses Mac Classic as 1.0): CPU: 6.455 Graphics: 9.654 Disk: 2.174 Name of Hard Disk tested: Macintosh HD Math: 10.153 Performance Rating (PR): 6.928 Benchmark Results (Uses Mac Classic as 1.0): KWhetstones: 95.693 13.108 Dhrystones: 5607.476 5.755 Towers: 4.800 QuickSort: 5.597 Bubble Sort: 7.431 Queens: 6.273 Puzzle: 8.548 Permutations: 4.603 Fast Fourier: 8.216 F.P. Matrix Multiply: 8.637 Integer Matrix Multiply: 7.700 Sieve: 7.628 Benchmark Average: 7.358 FPU Tests (Uses Mac II as 1.0): FFPU Fast Fourier: 2.300 FPU KWhetstones: 1304.347 1.826 FPU F.P. Matrix Mult.: 2.160 FPU Test Average: 2.095 Color Tests (Uses Mac II as 1.0): Black & White: 2.568 4 Colors: 2.714 16 Colors: 2.788 256 Colors: 2.340 Color Test Average: 2.602 ************************************************************************* PowerBook 170 tests ************************************************************************* Tests performed by: Murph Sewall SEWALL@UCONNVM.UCONN.EDU Today was the day I backed up my hard drive and installed 7.1 on my PB 170. I ran the first benchmark and realized I still had the processor set for 16 MHz, so I went ahead and ran the comparisons at both speeds. I ran the tests with Extensions Off for maximum comparability, but the numbers pretty well match my earlier machine records which I did with the full load of extensions. The 7.1 vs 7.0.1 figures don't look much different to me. It also turns out to have been a good idea to buy the PowerBook RAM upgrade. With all extensions or no extensions, 7.1 takes a little MORE RAM on startup (about 60K more). Perhaps 7.1 will prove better at memory management, and won't fragment the heap the way the earlier version do. ===========Sys 7.0.1 @ 16 MHz =============== Speedometer Report for Murph Sewall. Prepared November 21, 1992. Machine Record Version #: 5 User Comment: System 7.0.1 Tuneup 1.1.1, PB 170 8/80, Extensions Off, 16 MHz System Information: Computer: PowerBook 170 CPU: MC68030 FPU: MC68882 MMU: MC68030 MMU Color Quickdraw: 2.30 (32 Bit QD) System Version: 7.0.1 Finder Version: 7.0 AppleTalk Version: 57 LaserWriter Version: 7.1.1 Laser Prep Version: Not Found ImageWriter Version: Not Found ROM Version: $067C ROM Size: 1024 Bit Depth: 1 Horizontal DPI: 72 Vertical DPI: 72 Primary Screen Size: 640 x 400 Physical RAM: 8192K Logical RAM: 8190K P.R. Results (Uses Mac Classic as 1.0): CPU: 4.128 Graphics: 4.095 Disk: 2.138 Name of Hard Disk tested: Murph PBHD Math: 14.922 Performance Rating (PR): 4.800 Benchmark Results (Uses Mac Classic as 1.0): KWhetstones: 209.790 28.738 Dhrystones: 3921.568 4.024 Towers: 3.759 QuickSort: 4.055 Bubble Sort: 4.709 Queens: 4.770 Puzzle: 5.115 Permutations: 4.510 Fast Fourier: 15.530 F.P. Matrix Multiply: 14.776 Integer Matrix Multiply: 4.553 Sieve: 5.250 Benchmark Average: 8.316 FPU Tests (Uses Mac II as 1.0): FFPU Fast Fourier: 1.387 FPU KWhetstones: 923.076 1.292 FPU F.P. Matrix Mult.: 1.291 FPU Test Average: 1.323 Color Tests (Uses Mac II as 1.0): Black & White: 0.992 4 Colors: 0.000 16 Colors: 0.000 256 Colors: 0.000 Color Test Average: 0.992 ===================Sys 7.0.1 @ 25 MHz ========= User Comment: System 7.0.1 Tuneup 1.1.1, PB 170 8/80, Extensions Off, 25 MHz System Information: [Same as previous report] P.R. Results (Uses Mac Classic as 1.0): CPU: 6.268 Graphics: 5.280 Disk: 2.206 Name of Hard Disk tested: Murph PBHD Math: 22.456 Performance Rating (PR): 6.778 Benchmark Results (Uses Mac Classic as 1.0): KWhetstones: 310.880 42.586 Dhrystones: 5703.422 5.853 Towers: 5.379 QuickSort: 6.130 Bubble Sort: 7.431 Queens: 7.046 Puzzle: 7.934 Permutations: 6.630 Fast Fourier: 22.886 F.P. Matrix Multiply: 21.623 Integer Matrix Multiply: 7.000 Sieve: 8.197 Benchmark Average: 12.391 FPU Tests (Uses Mac II as 1.0): FFPU Fast Fourier: 2.205 FPU KWhetstones: 1463.414 2.048 FPU F.P. Matrix Mult.: 2.018 FPU Test Average: 2.091 Color Tests (Uses Mac II as 1.0): Black & White: 1.300 4 Colors: 0.000 16 Colors: 0.000 256 Colors: 0.000 Color Test Average: 1.300 ===================Sys 7.1 @ 16 MHz =========== Speedometer Report for Murph Sewall. Prepared November 21, 1992. Machine Record Version #: 5 User Comment: System 7.1, PB 170 8/80, Extensions Off, 16 MHz System Information: Computer: PowerBook 170 CPU: MC68030 FPU: MC68882 MMU: MC68030 MMU Color Quickdraw: 2.30 (32 Bit QD) System Version: 7.1.6 Finder Version: 7.1 AppleTalk Version: 57 LaserWriter Version: 7.1.2 Laser Prep Version: Not Found ImageWriter Version: Not Found ROM Version: $067C ROM Size: 1024 Bit Depth: 1 Horizontal DPI: 72 Vertical DPI: 72 Primary Screen Size: 640 x 400 Physical RAM: 8192K Logical RAM: 8190K P.R. Results (Uses Mac Classic as 1.0): CPU: 4.099 Graphics: 4.078 Disk: 2.141 Name of Hard Disk tested: Murph PBHD Math: 14.744 Performance Rating (PR): 4.766 Benchmark Results (Uses Mac Classic as 1.0): KWhetstones: 211.267 28.940 Dhrystones: 3906.250 4.009 Towers: 3.804 QuickSort: 4.055 Bubble Sort: 4.682 Queens: 4.770 Puzzle: 5.216 Permutations: 4.473 Fast Fourier: 15.654 F.P. Matrix Multiply: 14.981 Integer Matrix Multiply: 4.578 Sieve: 5.250 Benchmark Average: 8.368 FPU Tests (Uses Mac II as 1.0): FFPU Fast Fourier: 1.387 FPU KWhetstones: 923.076 1.292 FPU F.P. Matrix Mult.: 1.287 FPU Test Average: 1.322 Color Tests (Uses Mac II as 1.0): Black & White: 0.990 4 Colors: 0.000 16 Colors: 0.000 256 Colors: 0.000 Color Test Average: 0.990 ===================Sys 7.1 @ 25 MHz =========== Speedometer Report for Murph Sewall. Prepared November 21, 1992. Machine Record Version #: 5 User Comment: System 7.1, PB 170 8/80 Extensions Off, 25 MHz System Information: [Same as previous report] P.R. Results (Uses Mac Classic as 1.0): CPU: 6.479 Graphics: 5.287 Disk: 2.251 Name of Hard Disk tested: Murph PBHD Math: 22.162 Performance Rating (PR): 6.844 Benchmark Results (Uses Mac Classic as 1.0): KWhetstones: 312.500 42.808 Dhrystones: 5660.377 5.809 Towers: 5.426 QuickSort: 6.130 Bubble Sort: 7.500 Queens: 7.387 Puzzle: 8.179 Permutations: 6.552 Fast Fourier: 23.066 F.P. Matrix Multiply: 21.989 Integer Matrix Multiply: 7.058 Sieve: 8.197 Benchmark Average: 12.508 FPU Tests (Uses Mac II as 1.0): FFPU Fast Fourier: 2.146 FPU KWhetstones: 1463.414 2.048 FPU F.P. Matrix Mult.: 2.067 FPU Test Average: 2.087 Color Tests (Uses Mac II as 1.0): Black & White: 1.297 4 Colors: 0.000 16 Colors: 0.000 256 Colors: 0.000 Color Test Average: 1.297 *****End of Tests*****