Re: Analysis on make parallelism for buildworld
This message is in MIME format. The first part should be readable text,
while the remaining parts are likely unreadable without MIME-aware tools.
--2070317791-1281399244-1257436302=:8188
Content-Type: TEXT/PLAIN; CHARSET=US-ASCII
Content-ID: <alpine.BSF.2.00.0911052122421.8188@freebsd>
On Tue, 20 Oct 2009, Simon 'corecode' Schubert wrote:
> Hey,
>
> the question on which make parallelism to use comes up repeatedly. However
> the answer usually is driven by anecdotal evidence and not by empirical data.
> To this end, I ran a small benchmark test to add one data point. I have no
> idea about confidence intervals, so somebody will have to chime in here.
>
>
> I advise to run builds at -j ncpu+1 for 4-cpu systems. Until we have numbers
> for 2-cpu and UP systems, we can not provide conclusive advice, however I
> would try using -j3 for those two cases.
>
Hi Simon:
Please find attached the preliminary results from the first run
set on a AMD64 X2 system.
The data (so far) has been plotted and the generated
make-j-runtimes.png is hereby attached.
Here are the environment details
# uname -a
DragonFly amd64x2.datasynergy.org 2.5.1-DEVELOPMENT DragonFly v2.5.1.181.gd15a4-DEVELOPMENT #2: Thu Nov 5 20:35:21 IST 2009 root@amd64x2.datasynergy.org:/usr/obj/usr/src/sys/AMD64-P-MQ amd64
# swapinfo
Device 1K-blocks Used Avail Capacity Type
/dev/ad4s1b 4194176 9996 4184180 0% Interleaved
# top snapshot
load averages: 3.92, 3.47, 3.15
up 0+11:45:23 08:33:37
38 processes: 38 running
CPU0 states: 37.0% user, 0.0% nice, 3.9% system, 0.0% interrupt, 59.1% idle
CPU1 states: 49.2% user, 0.0% nice, 18.2% system, 0.0% interrupt, 32.6% idle
Mem: 142M Active, 552M Inact, 478M Wired, 60M Cache, 167M Buf, 608M Free
Swap: 4096M Total, 9996K Used, 4086M Free
# vmstat -w 5
procs memory page disks faults cpu
r b w avm fre flt re pi po fr sr ad4 md0 in sy cs us sy id
5 1 0 203824 754532 14568 1 0 0 14684 278 0 0 921 10126 5508 26 8 66
5 2 0 161512 788848 28303 0 0 0 30109 0 0 0 647 8186 8301 85 12 2
4 0 0 287640 677560 26282 0 0 0 20797 0 0 0 639 7012 6691 86 11 2
4 0 0 182192 767152 27185 0 0 0 31759 0 0 0 646 7565 7178 85 13 2
4 0 0 325100 645208 25646 0 0 0 19628 0 0 0 640 6893 6090 88 11 1
# vmstat -s
234673986 cpu context switches
39075925 device interrupts
3455565 software interrupts
0 traps
430276210 system calls
1 kernel threads created
1010795 fork() calls
1268091 vfork() calls
0 rfork() calls
2444061 exec() calls
386 swap pager pageins
803 swap pager pages paged in
1528 swap pager pageouts
3580 swap pager pages paged out
7220 vnode pager pageins
16381 vnode pager pages paged in
0 vnode pager pageouts
0 vnode pager pages paged out
251 page daemon wakeups
11719895 pages examined by the page daemon
29072 pages reactivated
44311304 copy-on-write faults
0 copy-on-write optimized faults
530080912 zero fill pages zeroed
14409435 zero fill pages prezeroed
1088 intransit blocking page faults
619469650 total VM faults taken
0 pages affected by kernel thread creation
64643286 pages affected by fork()
50198608 pages affected by vfork()
0 pages affected by rfork()
624395522 pages freed
3153399 pages freed by daemon
192851424 pages freed by exiting processes
55712 pages active
178325 pages inactive
14227 pages in VM cache
130817 pages wired down
92092 pages free
4096 bytes per page
712512521 total name lookups
cache hits (91% pos + 8% neg) system 0% per-directory
deletions 0%, falsehits 0%, toolong 0%
# Application load profile
The system is running the following applications
. ssh daemon
. csh shell
. make
Please review and let me know if there is any tweak/correction
that you deem necessary.
thanks
Saifi.
--2070317791-1281399244-1257436302=:8188
Content-Type: APPLICATION/OCTET-STREAM; NAME=make-j-runtimes.png
Content-Transfer-Encoding: BASE64
Content-ID: <alpine.BSF.2.00.0911052121350.8188@freebsd>
Content-Description: AMD64X2 make -j runtimes
Content-Disposition: ATTACHMENT; FILENAME=make-j-runtimes.png
iVBORw0KGgoAAAANSUhEUgAAAoAAAAHgCAMAAAACDyzWAAABKVBMVEX///8A
AACgoKD/AAAAwAAAgP/AAP8A7u7AQADu7gAgIMD/wCAAgECggP+AQAD/gP8A
wGAAwMAAYIDAYIAAgABA/4AwYICAYABAQEBAgAAAAICAYBCAYGCAYIAAAMAA
AP8AYADjsMBAwIBgoMBgwABgwKCAAACAAIBgIIBgYGAgICAgQEAgQIBggCBg
gGBggICAgEAggCCAgICgoKCg0ODAICAAgIDAYACAwODAYMDAgADAgGD/QAD/
QECAwP//gGD/gIDAoADAwMDA/8D/AAD/AP//gKDAwKD/YGAA/wD/gAD/oACA
4OCg4OCg/yDAAADAAMCgICCgIP+AIACAICCAQCCAQICAYMCAYP+AgADAwAD/
gED/oED/oGD/oHD/wMD//wD//4D//8BUJrxzAAAREUlEQVR4nO2di3arKhBA
dbX9/1++97RRZ3go6MCI7r3OaZoEAXEHBM10mgAAAAAAAAAAAAAAAAAAAAAA
oBvznHo+ry+H74uER0kKss7mnizoqErFCco5ykq8H9VTJbOr0sPIHN1jAY+T
FGRddFyKBVze8BFwNy0C5si0zFkBCw5IewENqckSAc8wz7/Dw/ZfdlN/b4r3
5nUDnURkdz3rJUtdkMr0s51OKZ5N0Yti8ym3R0v1VJ4yZar5wt/T2yFgjvVQ
Tku7ry8H7yVTrs8+W8kDVZa1OFx7BSXzFKXLiiQqv7d5dh+iCiaTqLqV7ANI
TgkYJVlfqhZw7W22rGX3dizgWu4ZAWWxwT4s78kKxruZEDDqohFwj0JLygTc
k2VfQLlxsqBknnqDcgEnJWwoYOholCRIrX6Xn4kpvQ8g8RZQ2hMLWNYDhlnU
CJjoAYMSQr2j5lO/J0tAwDzyPF64pk7P//6F3UbyJL8y62yPJF9UJUSbByXp
mkXqLHktP2OzZOlhBVP7qCo250rItxLASbLdIkAX6NYAAOAAca6+9/b+S1eK
v/1A5VLDs+1ym+Zcp6j/fgTzLLV+pVdO4mwSb6mnW9Zi0vf5kZqipkuIMsth
N2VU0+p1Rp5LFyRRL+q0eqf/fiSnJPuT6OO91IsRN1vTiRaskutdy7NJ/RLm
syugzCgsIV1ssoTdJIkdu8681Tqsbrz0EiaZ5Ys6z+RO5wRMrAWpYvd3IHmI
7ybgvNMoeq0uWptSr227OamdFP7qD37UtPExjOTe+lJdiaC8rfJT8UPYc8o3
d4/hVstt58Watq5+oq11CbIWoo3VDsaHI3hQjRUpfg8DCwQMmzb9SV+3mETz
Be312TCl0m5nEB3tZJsmjmgmScGDKGl746+htofUcV6rJVrgs4HOM2z5OchT
7cq6S6GqugUzLZFokKBB/Qg/eYlPpZWA6eO7bpJLqTvZLYlOqYoNkmRTBrWO
Ph2xv4GEKQHn7Zfth8xX71juAOhGUnWZVX6izcO93mmJMJEbYQuf7AHVPsUf
zilsvvXVaQoT5qpUIGC4Y8cpg6OSEHDPklSJQd6ysXSeceI5+kBvGyRyCYtR
5cefjFDAe/hXKmDU7FkB95zZa/bDKiVtDrVKqpXLM/sQN9F0WCX9UrKxtDXJ
ts41SCzm3uHIZp2siy9hzRNj4e9HcFJJ5uVjGX7y1IthMy7PRdv8/QgHz+UT
v53zBEkmkWTLLzUiBu8dP+wJGGyQbkvdPPJZ0ASptg4aWR8HXWxcQq6CyVa6
iX/QFY46AAAAwAcxfbkpBlUryeLGLfBogvmqYZ7JqWhQolwZycxyVQWDKXNq
8hkuECT2Lr2zGOjJpdaPV2kmpYBaHJvVktG2OpFeRtNbhcsla4Jo81kt5yHg
HdBdw9ZffN6UCZfuSR7pYMVLdzBq4Wzr3BZ5xDPZT6mrcxkB5zmZ57pep6qs
1/L0rm+VmGUdRI+Lgc3Rx1cOgtHhiq/XJw5zvpgpOLDq+Eurt2rN89otRh1g
ZgiWn6VIzqBCotbqc6FfgHYokUQ38HkzSBjfKZIY9vQGIgOZZFMnczltMz3b
A4Z5ph5ExyYGd1ndUMDN3KgNwJxMf5EUMOHaVQEn3Z1K/ZN9rM6sRED1flyh
ZA8oi8C/tpwSMPnwl2bOHzAlixrvRFEJOUsFLKigqGqw72uysDwEbIwedFPD
7JowpWowXuUP2Da0acM3d5cHUazaQOe8mhMlST3o7jTY9Wl1LbX5iTYFR8Y8
YmPWGkL2RuD7MmatAQAAAAAAAAAAAAAAYBJXwlOXzgFak7w7Lby/CKAVoueb
ERC6E90bOW8PaxKAFJYSTlNgnxDQqpy44OEypsotMtb3hMc351qVExc8XMZU
2TrjvS8rWJaTLny4jKmyecafsTz5YFlOsuzhMqbKPTJ2KgcGAwHhOhcmswgI
BuwJ+LW/pXFNvMsBF6SAoXD7zxEQapjTE00EhD7Ea2xRfIWvI3SGvSreqRxo
i4g4Ii7/0wNCJ5I3PiEg9CJzyx2zYOjDFm1rnYREf9KsLkOzqt2jHBgMBARX
EBBc6SLG19fXHK8AAfTuAXOrkfBa3IZgXHwF3+JnkjucA2Yv08CIfEfP4lc2
7iCgBBfHYLkSt/wXy4BBd/cdv6AyalXDgBPl4OJ92fv6z/cROqdeNb60NS7e
je0urCgAwWN6wDS4eBO0fNkheLRzwBqYvLghT/52o7AMMQu2ABf7sk07oklI
ZUZmVbpHORMuduZidJcHCijAxcZcjy70bAEFuHhPXiOgoHDygqg9eKOAkh0X
EbAHbxdQELqIgAb8LP9ymIghv6Q39Y6O1QJOFy/wEzz7iV6RGAm4PvSPD9gM
/EsQ3H6gvx38R9Dd/fyEL+gMbWol7414jID/HPSuxN0oiEX6c4TO0LZWc/Sw
JjGMR92HX/lQUBNeAV4vxW2U94DWQcpj+4buAT9goETffqDjJHxwOAf8VOJh
Q/ACnaAgOwRn6DULfrKAKChJLXhcGUdtxPAMUt4FFGwFC9GFYGAbELAUOsEm
IGA5KNgABKwBA81BwCroBK1BwEpQ0BYErAYFLUHAE2CgHQh4BjpBMxDwHCho
BAKeBQVNQMDzYKABCHgBOsHrIOAlUPAqCHgRFLwGAl4GA6+AgNehE7wAAlqA
gqdBQBtQ8CQIaAUGngIBzaATPAMCGoKC9SCgKShYCwIag4F1IKA1dIJVIKA9
KFgBArYAA4tBwCbQCZaCgI1AwTIQsBkoWIJxhNREsHzjckYCA4+xEkME5H1e
gMrT0AkeYiTGJ1Z1Ili+bTnDgYIHWEVI1bF5HxEl3wgUzDL//EqxE0G6NCMV
MP1hUfKv08nAw3jgN+TnfzEMajxv/dsjg5RfpVMnGP9FhPvzM1vV+MlR8q/T
R8Hob8KYZt2G2arS8foLyzCSdgo2c0PSrPJmPeABrxfQ4lTwyI2GojTC6Byw
AASs6gRPdUPjnQP+/IrRpc4I+I9YQcMRb8RZMNeC+9H33GoYuojRsae14kJ3
ctCpsS6t6NMz9TvXNKPkhOpcp8alEUmnobHbbNuOcH5pOH6i4EafIfhvvXFg
rFsEAxfoAXM00E5AJ/iBc8AMzRfVUPAXZsFpeiyqoeDEOqAvGIiAvtAJIqAz
b1cQAd15t4IIeAPebCAC3oEXd4IIeA9eqyAC3oWXKoiA9+GVBiLgjXhjJ4iA
t+J9CiLgzXibggh4O95lIALej1d1ggh4R16kIALek9cYiIA35S2dIALelnco
aBmknOhYxrxBQesg5cQHNOX5BtoGKUdAax7fCRoHKZ+jhzXFW4OUX+XBCppJ
sfZ5CQmXJBblvJQHK2gkxidIOUNwKx5soO2f6kLARjy3E2QZZhCeqiAL0cPw
TAURcCCeaCACjsQDO0EEHIvHKYiAo/EwBRFwPB5lIAIOyJM6QQQckucoiICD
8hQFEXBYnmEgAo7LIzpBBByZByiIgGMzvIEIODijd4IIODxjK4iAD2BkBRHw
EYxrIAI+g79OcEAPEfAp/FMQAd3LeTNfI54LIuBj+BJ416UcBHwSq3hfEZ7V
2gMBn8SOZndVEgGfRJVU91ASAWHFQ0kEhB3aK4mAUIW1kggIF7mmJAKCOTVK
IiB0IK+kVYjeJTpbHKXNshx4DIuIc8WQPS/Eb6whKfUzAlTCATViZAX8e3Na
O0AEhFKqBMxuE5pHlHwooFaKvIDTJMZfouRDOaYxoieClEMltn8nBAGhklox
5uQmyfD4LMPAMZVi6JlFu3LgLdQK+O8fAoIZ1QKmx2DrcuAtVA/Bcm2lXTnw
FmwmIfblwEvgbhhwBQHBFbNLcYblwItAQHDF7HYsw3LgRSAguMIkBFxBQHAF
AcEVBARXEBBcQUBwBQHBFQQEVxAQXKm+H5ArIWBJ/R3RCAiG1H8pqUs58BYQ
EFxhCAZXEBBcYRkGXDmzDNOjHHgJDMHgyplZcC5CKtGxoBoTAYkPCGcxG4IR
EM5gMwlZg5Tr+NAEKYc9TKVI2kcPCAeYzWgZguEMJgIyCYGz1EVGyE1CWIaB
k9gIaFsOvAibhWjzcuAt9JIJASEJd8OAKyfE4G4YsOPEOSCTELCDSQi4UiUG
EVLBmjMCNi8H3gNfywRXWIYBV4gNA67wpSRwpfoccGYZBgxBQHClXkCGYDCk
XgzWAcEQlmHAleplmE7lwEuoXobpUw68BS7FgSsICK5wJQRcQUBwhWUYcIUe
EFxBQHCFL6aDKwgIrtgMwUuE1O1xffFcOfAWzgiYeHWNCKifER8QDjARYwsQ
vViHgFBGXXzAnS8Gq9CoBCmHAmql2BFwfZEg5VCFTWwY2dMxBEMFJgImZx8I
CAWYLMOk119YhoFjzkRG6FEOvATuhgFXEBBcQUBwBQHBFQQEVxAQXEFAcAUB
wRUEBFcQEFxBQHAFAcEVBARXEBBcQUBwBQHBFQQEVxAQXEFAcAUBwRUEBFcQ
EFxBQHAFAcEVBARXEBBcQUBwBQHBFQQEV2zESMZlIzwbHGMbpJwAlVAJAoIr
ZmJE4fGJkg8HGEqxROglSj7UYTUJWX4yBEMVZueAEwLCCYwEJEo+nIOFaHAF
AcEVBARXEBBcQUBwBQHBFQQEVxAQXEFAcAUBwRUEBFcQEFxBQHAFAcEVBARX
EBBcQUBwBQHBFQQEVxAQXEFAcAUBwRUEBFcQEFxBQHAFAcEVBARXEBBcQUBw
xSxA5ZQLkmVaDjwNsyj5UyZMoGk58Dhs4gOKHhABoQbbITgRq3xNQJByCDAN
Ur79QpByKKeJgAzBUEqbIRgBoRCClIMrLESDKwgIriAguIKA4AoCgisICK4g
ILiCgOAKAoIrCAiuICC4goDgCgKCKwgIriAguIKA4AoCgisICK4gILiCgOAK
AoIrCAiuICC4goDgCgKCKwgIfnz/ivHdoygEbM63+DkK3/+L0afGCNie72k0
//6v79ypxgjYge92/n23Yv6mBxyWZlbENNsFox7wLxAb4dnsOGNFwx6wEVbn
gPPjAlQ2PaNv1OWMdw5oNQueDyKkdpxtm3H2aPqNZyPOgs1D9OoA5esY/H9P
O38PFiU/MZ75yfVMrKPkx/at2TecbZdYYUSrXXgzfYKU/862B7NivDP6IekU
Jb/beqMZ453Rj0mfKPn9rrhYMeYZ/YB0mRiMOAuGPnA3DLiCgOAKAoIrCAiu
ICC4goDgCgKCKwgIriAguIKA4AoCgisICK4gILiCgOAKAoIrCAiuICC4goDg
CgKCKwgIriAguIKA4AoCgisICK4gILiCgOAKAoIr4wvYLGeq3CNny4zTQbLs
ywlKHS5jqtwo449vnYOUD9E0nXJ+eZXXDhABnXJ+eZU388Ig5cvwDBBiKOBH
wjkRpBygD7k/VAPQnL2/lATQns+Qrh8AAAAAAAAA3keDKbHMssGyepN1enmD
BlVecrXOMVlIg3orAe2zN881uD5OlT+ZdhCwwWW5Oe4BbfNvfzRbNH3TLNtc
ve2zXtx8CG7VpTTLsonhrYfgFh/KRwjYoojWpw3TcJ8Z+wL6XbEdT8Ae4yMC
tjkRSZbUKkv559rtc2+SZcMqtzptbVTlpYzWNFpy+GuQNvc+DFjlhueALe8w
Gf2mlQHrT5UBAAAAAAAAAAAAAGBUji4a6FuMd5Jx8QHOUCHgbloEhFPUiIOA
YMByW+9ys8vyP61Q3AOmt0NAKETcujXPi46Jb4CIGxjXl6c1pX5AQChG3ug3
y3vnSgWcZyngmkHfvYBhCbuwfX+SPeDfE9VrIiAUEo2h8RAcpFa/65M/hmCo
RRo0Bz6lUy+/qXv0gylJr6/rwIto87UegFLo1gAAAOC+/AfB+jz1vVEu+QAA
AABJRU5ErkJggg==
--2070317791-1281399244-1257436302=:8188--