Debian Experiments

The following two tables contain the test results of runs of our tool musketeer on a set of concurrent pthreads programs that are part of the Debian Linux distribution. The first table lists the binaries for which musketeer could successully infer fences (for at least TSO). The second table lists the binaries for which musketeer timed out (timeout 10m) for both TSO and Power.

The first column (Package) in the tables gives the name of the Debian package, and the second column (Binary) the binary within the package. The binaries are goto-programs, prepared by goto-cc (part of the CPROVER framework, see http://www.cprover.org/goto-cc). The third column (LoC) gives the number of lines of code as counted by goto-instrument (again part of the CPROVER framework). The fourth column (Nodes) gives the number of nodes in the corresponding aeg. The fifth column (TSO cy.) gives the number of critical cycles (for TSO) found in the aeg. The sixth column (TSO time) states the time it took to infer fences for the binary on TSO (i.e. the overall runtime of musketeer on that binary), and the seventh column (TSO fences) gives the number of fences inferred. The last three columns give the same data for Power. If a certain data item is not available (e.g. because musketeer timed out during the cycle search), the corresponding table cell contains a “-”.

From the tables one can also see in which phase musketeer timed out when it could not infer fences within 10m. If the column “Nodes” and the following columns contain a hyphen, then musketeer timed out during the pointer analysis and aeg construction phase (phase 1). If the “TSO cy.” (resp. “Power cy.”) column and the further columns contain a hyphen, then musketeer timed out during the cycle search in the aeg (phase 2). If the “TSO time” (resp. “Power time”) column contains a hyphen, then musketeer timed out during the ILP solving phase (phase 3). We found that when a timeout occured it was always either during phase 1 or phase 2. We did not observe a timeout during phase 3.


Table 1: Programs successfully analysed by musketeer (for at least TSO).
PackageBinaryLoCNodesTSO cy.TSO timeTSO fencesPower cy.Power timePower fences
 
abxabx118315200.13000.160
aiccuaiccu17021673063.590069.710
airspy-hairspy_info697400.02000.020
airspy-hairspy_r820t752500.03000.030
airspy-hairspy_si5351c785400.03000.030
airspy-hairspy_spiflash824600.10000.110
alsa-utialsaloop22243962067.250067.570
antpmgant124914400.14000.150
aoetoolsaoe-sancheck4564300.05000.060
aprechod9399536046.850046.880
aprglobalmutexchild93599800.41000.370
aprocchild93479200.43000.360
aprproc_child9341000.29000.260
aprreadchild935217403.92003.960
aprsendfile97666850255.0200262.390
aprsockchild937917500.81000.770
aprtestlockperf948818406.04006.740
aprtestmutexscope942027802.85004.080
aprtestshmconsumer936612900.63000.610
aprtestshmproducer935812800.64000.600
aprtryread934811100.45000.410
arponarpon17991815016.54027043.082
asmailasmail18627700.18000.170
audacioulibaudgui.so4172000.15000.150
augeastest-lock13661700.08000.080
augeastest-thread_create1133400.06000.060
autodirautodir2478124104.26004.280
autofslookup_ldap.so10308000.33000.270
avis-clievent_loop_test181982506.07006.770
avis-clitests37189100.83000.820
axelaxel1461214018.250021.670
balsamain-window.o2083000.12000.100
bambam238517402.08002.040
bfbtestebfbtester71754306.340826.6512
blktraceblkiomon7599300.21000.170
blktraceblktrace143841601.9101348516.515
blktracebtreplay66910400.34070.344
bootcharbootchart-collector123812000.83000.820
btscannebtscanner253788702.80002.840
ccidparse19272400.07000.050
checkcheck_thread_stress13399500.84000.850
check-mkunixcat80700.00000.000
chmlibchm_http1147186014.750406577--
chronychronyd859663140556.490---
c-icaptest_allocators609229500.33000.330
c-icaptest_arrays615047000.96000.960
c-icaptest_base646068900.18000.160
c-icaptest_cache611467901.25001.210
c-icaptest_headers60819800.21000.170
c-icaptest_lists619033203.6400316.920
c-icaptest_md56077200.32000.270
c-icaptest_tables61039700.20000.200
c-icapc-icap-mkbdb628312000.28000.260
c-icapc-icap-stretch65008200.21000.220
ckthroughput107800.01000.010
ckbarrier_centralized91800.00000.000
ckbarrier_combining1751800.01000.010
ckbarrier_dissemination140900.01000.010
ckbarrier_mcs123800.01000.000
ckbarrier_tournament1751000.01000.010
ckthroughput1761000.01000.010
ckvalidate156600.00000.000
ckvalidate166700.00000.000
ckck_cohort.THROUGHPUT1522700.01000.010
ckvalidate1431300.01000.010
ckck_epoch_poll3621700.03000.020
ckck_epoch_synchronize3701700.03000.020
ckck_stack3121100.02000.020
ckck_fifo_mpmc2227500.02000.020
ckck_fifo_spsc1461200.01000.010
ckck_hp_fifo_donner3351200.02000.020
ckck_hp_fifo4051100.04000.030
ckck_hp_stack3291200.02000.020
cknbds_haz_test3121000.02000.010
ckparallel_bytestring.dele10594801.67001.670
ckparallel_bytestring10584801.64001.630
ckthroughput1401000.01000.010
ckvalidate125600.00000.000
ckck_pr_cas_64_2971600.00000.000
ckck_pr_cas_64941600.00000.000
ckck_pr_fas_64941600.00000.000
ckck_list1401300.02000.020
ckck_slist1261300.01000.010
ckck_stailq1551800.03000.030
ckparallel_bytestring12964805.72005.670
ckck_ring_spmc3213500.03000.020
ckck_ring_spmc_template3213500.03000.030
ckck_ring_spsc2102500.01000.010
ckck_neutral.THROUGHPUT1781700.02000.020
ckck_rp.THROUGHPUT1631700.01000.010
ckck_wp.THROUGHPUT1631700.02000.020
ckck_neutral1421400.01000.010
ckck_rp1511400.01000.010
ckck_wp1511400.01000.010
ckthroughput154800.00000.000
ckvalidate215800.00000.000
ckck_sequence1191000.00000.000
ckck_anderson.THROUGHPUT1642100.01000.010
ckck_cas.THROUGHPUT1302100.00000.000
ckck_clh.THROUGHPUT1432100.01000.000
ckck_dec.THROUGHPUT1332100.01000.010
ckck_fas.THROUGHPUT1302100.00000.000
ckck_hclh.THROUGHPUT1572100.01000.010
ckck_mcs.THROUGHPUT1512100.01000.010
ckck_spinlock.THROUGHPUT1302100.00000.000
ckck_ticket_pb.THROUGHPUT1442100.00000.000
ckck_ticket.THROUGHPUT1332100.01000.010
cklinux_spinlock.THROUGHPU1122100.00000.000
ckck_anderson159800.01000.010
ckck_cas123800.00000.000
ckck_clh139800.01000.000
ckck_dec126800.00000.000
ckck_fas123800.00000.000
ckck_hclh152800.01000.010
ckck_mcs143800.01000.010
ckck_spinlock123800.00000.000
ckck_ticket145800.00000.000
ckck_ticket_pb140800.00000.000
cklinux_spinlock97800.00000.000
ckmpmc_pair1414300.01010.022
ckmpmc_pop1504400.01010.012
ckmpmc_push1302200.01000.010
ckmpmc_trypair1403500.01000.010
ckmpmc_trypop1523600.01000.010
ckmpmc_trypush1312200.01000.010
ckmpnc_push1262200.00000.000
ckpthreads_pair1052600.01000.000
ckspinlock_eb_pair1292600.01000.010
ckspinlock_eb_pop1353300.01000.010
ckspinlock_eb_push1322900.01000.010
ckspinlock_pair1272600.01000.010
ckspinlock_pop1333300.01000.010
ckspinlock_push1302900.01000.010
ckupmc_pop1412000.01000.010
ckupmc_push1272200.01000.010
ckupmc_trypop1442000.01000.010
ckupmc_trypush1292200.01000.010
ckthroughput155800.00000.000
ckvalidate1941000.00000.000
ckthroughput160800.00000.000
ckvalidate139600.00000.000
clamconftest_410200.00000.000
clamconftest_510200.00000.000
clamsmtpclamsmtpd17521488079.560236434--
clsyncclsync374748960151.8300166.550
crossfircfsndserv55682400.19000.170
ctfutilsctfmerge5489778038.720038.650
das-watcdas_watchdog2763900.04000.040
dbmixdbin.o218000.00000.000
dbmixdbin108548074.12533310--
dc3dddc3dd.o2158000.11000.100
diodkconjoin70246600.32000.300
diodpathwalk71085000.32000.290
diodtatomic6961200.32000.300
diodtcreate6967300.32000.280
diodtfcntl2713019900.36000.300
diodtfcntl3715825500.34000.330
diodtflock26969200.31000.290
diodtflock705111300.32000.290
diodtfsgid69701500.31000.310
diodtrename6953200.31000.300
diodtstatfs69993600.33000.280
diodtstat70012800.34000.310
diodtsuppgrp70392300.32000.280
diodtcap846818300.36000.320
diodtconf838932700.58000.490
diodtfcntl84857400.36000.320
diodtfidpool82509600.43000.390
diodtlist83642000.36000.310
diodtlua8337200.35000.340
diodtopt835923000.46000.420
diodtsetfsuid84392700.35000.330
diodtsetfsuidsupp842211900.35000.320
diodtsetuid84151500.37000.310
diodtsuppgrp84262300.38000.330
diodconjoin82694100.37000.310
diodtattach824059012.470012.460
diodtattachmt828572015.010014.920
diodtflush8302120084.160083.950
diodtgetxattr8284151068.360068.170
diodtmkdir825597035.580035.000
diodtread825889027.900028.150
diodtremovexattr824073023.400023.200
diodtsetxattr824973023.630023.530
diodtstat8257124023.980023.940
diodtwrite825081027.420027.420
diodtxattr8221200.38000.310
dioddiodcat8454169044.460044.450
dioddioddate8421137030.260030.270
dioddiodload8467185054.300053.770
dioddiodls85083270129.0400128.880
dioddiodmount87521565081.600080.870
dioddiodshowmount8419346060.460060.710
dioddtop888110330224.5600225.570
direwolfaclients9085500.06000.050
djmountdjmount31767400.20000.200
djmounttest_upnp3145249033.300033.310
dnshistodnshistory1358888735.8711149.877
doodledoodled278076025.770025.690
driftnetdriftnet181586501.37001.470
dssijack-dssi-host111516500.49000.420
dumathread-test955700.02000.020
dvbackupdvconnect52317200.08000.160
efliteeflite924235100.5637690.7237
espeakupespeakup3864010.02120.023
espeakupespeakup3864010.02120.023
etherapeetherape647494731626.404689930.7819
extaceextace402136201.020032.500
eztrace17312-lt-eztrace_convert118015302.79002.790
eztraceeztrace_avail10672100.06000.060
eztraceeztrace_convert118015302.88002.920
eztraceeztrace_loaded10662100.06000.060
eztraceeztrace_stats114214902.45002.410
eztracedummy_thread562200.00000.000
eztracetest_pthread875400.00000.000
eztracestdio732300.00000.000
faifafaifa16392600.07000.050
fakerootthread15200.00000.000
fcitx-clcloudpinyin.c.o599000.07000.090
fcitx-clfcitx-cloudpinyin.so837000.07000.080
fcitxtestmessage8941701.09000.990
fiobackend.o1272000.07000.070
flam3flam3-convert103461301.98001.920
flowgrinflowgrindd2582498017.440017.720
flowgrinflowgrindd-flowgrindd.o464000.01000.010
flvstreastreams285234100.20000.190
fontconftest-pthread10613300.40000.340
fprobefprobe9113160148.390---
fprobe-ufprobe-ulog1009275024.680047.170
fusedavfusedav14359200.09000.080
fusecusexmp72459301.14001.110
fusefioc7201156011.180011.160
fusefsel7240168013.140013.130
fusefusexmp_fh7631156011.200011.110
fusefusexmp7293156011.260011.410
fusehello7147156011.190011.090
fusehello_ll71918902.14002.130
fusenull7142156011.130011.100
fuselibfuse.so.2.9.37077000.19000.170
fuseulockmgr_server2592100.01000.010
fusesmbfusesmb.cache10891200.56000.570
fusesmbfusesmb14021700.14000.150
g15compog15composer13447001.48001.480
g15macrog15macro5866100.02000.020
g15mpdg15mpd4532800.01000.010
gangliagmetad479820603.81003.810
ghostessghostess2275100801.90001.830
ghostessghostess-ghostess.o1476000.10000.070
glfwboing2632134209.09009.160
glfwgears2637122808.01008.090
glfwheightmap2749128909.82009.740
glfwlistmodes243511000.09000.090
glfwmipmaps24791339013.640013.910
glfwmtbench253717900.10000.120
glfwmthello243310600.09000.090
glfwparticles28371287011.970015.370
glfwpong3d27732131034.660034.960
glfwsplitview26401510011.490011.610
glfwtriangle2463122506.94007.140
glfwwave2584126307.91008.010
glfwaccuracy2461119106.83006.870
glfwdefaults2440101504.45004.450
glfwdynamic2448111906.41006.590
glfwevents25951436010.170010.460
glfwfsaa2466128008.30008.370
glfwfsinput2471122407.60007.660
glfwiconify2489121608.59008.530
glfwjoysticks247720200.10000.090
glfwpeter24691446010.200010.430
glfwreopen2492134807.94007.990
glfwtearing2449119106.81006.870
glfwversion2537103604.89004.990
gnupg-pkgnupg-pkcs11-scd156214500.31000.310
gphoto2gphoto2416821707.84007.830
gphoto2gphoto2-main.o1313000.06000.050
grossbloom1041251709.120029.120
grossgrossd3694149209.86009.810
grossmsgqueue10958400.04000.040
grosssha2567695800.02000.030
ivykistest224311200.31000.310
ivykiskojines24148800.22000.210
ivykislibivykis.so.0.3.52102000.05000.060
ivykis16720-lt-avl22161600.09000.080
ivykis41680-lt-iv_event_raw_21507400.12000.120
ivykis45379-lt-struct_sizes2145000.07000.050
ivykis48365-lt-timer21428400.11000.100
ivykis52401-lt-timer_order21538600.31000.330
ivykis9596-lt-iv_signal_test21387800.19000.180
ivykisavl22161600.09000.090
ivykisclient21757100.12000.120
ivykisconnectfail21597200.12000.110
ivykisconnectreset22248100.13000.120
ivykisiv_event_raw_test21507400.16000.110
ivykisiv_event_test216511700.25000.220
ivykisiv_fd_pump_discard21907300.14000.120
ivykisiv_fd_pump_echo21857200.11000.110
ivykisiv_inotify_test22107000.17000.170
ivykisiv_popen_test218212400.62000.590
ivykisiv_signal_child_test214713700.66000.660
ivykisiv_signal_test21387800.18000.210
ivykisiv_thread_test213913800.26000.260
ivykisiv_wait_test219112900.59000.590
ivykisiv_work_test216920400.44000.440
ivykisnull21357200.10000.130
ivykisserver21786900.11000.120
ivykisserver_thread2189138310.2679120.3615
ivykisstruct_sizes2145000.06000.060
ivykistimer21428400.13000.100
ivykistimer_order21538600.34000.310
ivykisserver_thread-server.o65000.00000.000
jack-stdjack-stdin2706300.02000.020
jack-stdjack-stdout2275600.02000.010
jalvjalv12707300.21000.200
jalvjalv.gtk317557300.30000.280
jalvjalv.gtk17577300.31000.290
libapachqsfilter21487191023.340023.290
libapachqsrotate4376700.26000.260
libasyncasyncns-test7553300.22000.190
libatomitest_atomic6604400.50000.500
libatomitest_atomic_pthreads1425922058.310059.060
libatomitest_malloc342200.17000.160
libatomitest_stack3462700.22000.180
libdvdvconnect52819800.11018500.839
libfiukill.bin819100.09000.070
libfiumalloc.bin819100.08000.090
libfiummap.bin819100.11000.080
libfiuopen64.bin819100.08000.090
libfiuopen.bin819100.08000.070
libfiupread64.bin819100.08000.090
libfiupread.bin819100.08000.090
libfiustrdup.bin819100.08000.080
libfiutest-enable_stack_by_n8033100.31000.340
libfiutest-enable_stack8032400.33000.300
libfiutest-parallel8673000.27000.300
libfiutest-parallel-wildcard8772400.73000.730
libgaduconn-async859018401.55001.510
libgaduhttphash8580200.32000.290
libgadusend8576591035.220035.410
libgadustatus856137003.68003.670
libgaduconnect925128706.60006.520
libgadupacket868336200.56000.580
libgaduprotocol911221702.16002.110
libgaduresolver88442528041.570044.680
libgaduclient874241205.50005.500
libgadudcc787951097025.120025.030
libgaduuserlist870646706.57006.550
libloexample_server27567300.14000.160
libloexample_tcp_echo_serve279315702.380---
liblononblocking_server_exam2789496047.780048.000
liblo44917-lt-testlo36479902.50002.480
liblosubtest276912801.500---
liblotest_bidirectional_tcp27688320112.1800386.030
liblotestlo36479902.52002.490
liblooscdump2759476022.390022.350
liblooscsend28955700.51000.510
liblscpexample_server3230300.09000.080
libocasmsvmocas239465803.54003.510
libocassvmocas24831841021.660022.510
libpthre3388-lt-test_witem_cach58819200.10060.104
libpthre39116-lt-test_latency72039121.0911918.098
libpthre5053-lt-test_api7256857192.083405230.7124
libpthretest_api7256857192.103405230.7624
libpthretest_latency72039121.1411918.058
libpthretest_witem_cache58819200.10060.114
libqbipcclient68462198055.100055.170
libqbipcserver685756709.82009.780
libqbmapnotify6860000.24000.210
libqbtcpclient6768400.21000.200
libqbtcpserver679115300.52000.500
libqb19920-lt-crash_test_dum67601377032.060031.990
libqb29305-lt-loop.test719958905.80005.860
libqb33173-lt-array.test680658905.86005.820
libqb39814-lt-map.test734758906.86006.860
libqb46702-lt-rb.test685658905.60005.600
libqb53308-lt-log.test7232000.24000.210
libqb59629-lt-ipc.test760958906.00006.040
libqbarray.test680658905.86005.890
libqbbench-log67521251083.570081.730
libqbbmcpt6792132307.91007.860
libqbbms68541035012.240012.190
libqbcrash_test_dummy67601377032.180032.100
libqbformat_compare_speed6743800.20000.180
libqbipc.test760958906.04005.990
libqblog.test7232000.23000.210
libqbloop678374309.90009.840
libqbloop.test719958905.84005.840
libqbmap.test734758906.91006.840
libqbrbreader6733956010.170010.120
libqbrb.test685658905.59005.590
libqbutil.test680458905.91005.860
libqb22273-lt-qb-blackbox6718790010.940010.950
libqbqb-blackbox6718790011.010010.920
librawhalf_mt792300.01010.012
libshoutexample30306508.75008.720
libshoutnonblocking3046116028.430028.380
libspf2spfd.o420000.01000.010
libsysaccpu7912500.04000.040
libsysacdisk8053000.06000.070
libsysacmemory7632500.03000.040
libsysacnetwork8061800.07000.060
libsysacprocess8283700.18000.180
libsysacswap7792300.04000.030
liburcucds_hlist_add_head_rc1068200.09000.090
liburcucds_hlist_del_rcu10793400.35020.722
liburcucds_hlist_for_each_en10721200.09000.080
liburcucds_hlist_for_each_rc10751200.09000.080
liburcucds_lfs_pop_all_block1340200.06000.050
liburcucds_lfs_pop_blocking1341200.06000.050
liburcucds_lfs_push1339200.06000.050
liburcucds_list_add_rcu1067200.09000.080
liburcucds_list_add_tail_rcu1067200.09000.090
liburcucds_list_del_rcu10773400.35020.722
liburcucds_list_for_each_ent10711200.09000.090
liburcucds_list_for_each_rcu10741200.09000.080
liburcucds_list_replace_rcu10853400.35020.732
liburcucds_lfht_add24953300.31000.300
liburcucds_lfht_add_replace25146602.120543.456
liburcucds_lfht_add_unique25083400.32000.300
liburcucds_lfht_del25358303.130584.695
liburcucds_lfht_destroy25157302.630564.106
liburcucds_lfht_for_each_ent25154300.51000.500
liburcucds_lfht_lookup25194300.50000.490
liburcucds_lfq_dequeue23955100.610621.428
liburcucds_lfq_enqueue23741200.15000.130
liburcubp1175900.08000.080
liburcumb10742800.65000.640
liburcumembarrier10845900.7801486.688
liburcuqsbr10832100.64000.620
liburcusignal11024000.81000.780
liburcutest_perthreadlock17405800.18000.170
liburcutest_perthreadlock_timi16341700.17000.160
liburcutest_rwlock17294800.19000.190
liburcutest_rwlock_timing16261300.19000.160
liburcutest_urcu_assign_dynam17517800.300480.812
liburcutest_urcu_assign17817800.280480.912
liburcutest_urcu_bp_dynamic_18326100.22000.210
liburcutest_urcu_bp18756100.22000.200
liburcutest_urcu_dynamic_link17367200.310480.872
liburcutest_urcu17917200.300480.842
liburcutest_urcu_gc181610100.580966.834
liburcutest_urcu_hash4592162014.390014.190
liburcutest_urcu_lfq_dynlink343520609.200---
liburcutest_urcu_lfq355620609.600---
liburcutest_urcu_lfs_dynlink3486318024.850---
liburcutest_urcu_lfs3596318025.520---
liburcutest_urcu_lfs_rcu_dyn343219907.940---
liburcutest_urcu_lfs_rcu351819908.140---
liburcutest_urcu_lgc179010100.530966.814
liburcutest_urcu_mb17795500.27000.260
liburcutest_urcu_mb_gc18047900.44000.420
liburcutest_urcu_mb_lgc17787900.43000.390
liburcutest_urcu_qsbr_dynamic17385300.26000.250
liburcutest_urcu_qsbr17925300.27000.250
liburcutest_urcu_qsbr_gc18077600.41000.400
liburcutest_urcu_qsbr_lgc17817600.41000.370
liburcutest_urcu_qsbr_timing16781700.22000.200
liburcutest_urcu_signal_dynam17546300.30000.300
liburcutest_urcu_signal18076300.30000.290
liburcutest_urcu_signal_gc18328300.53000.550
liburcutest_urcu_signal_lgc18068300.51000.480
liburcutest_urcu_signal_timin17052400.24000.250
liburcutest_urcu_signal_yield18136800.31000.290
liburcutest_urcu_timing16893400.250480.662
liburcutest_urcu_wfcq_dynlink7987300.79000.870
liburcutest_urcu_wfcq9607300.79000.860
liburcutest_urcu_wfq_dynlink6744600.11000.110
liburcutest_urcu_wfq7494600.16000.150
liburcutest_urcu_wfs_dynlink7947400.24000.500
liburcutest_urcu_wfs9247400.25000.540
liburcutest_urcu_yield17977700.300480.842
liburcutest_mutex2075400.01000.010
liburcurcutorture_urcu_bp201734505.54005.520
liburcurcutorture_urcu_mb1919345012.440012.430
liburcurcutorture_urcu_qsbr1930345011.690011.790
liburcurcutorture_urcu_signal1947409015.650018.500
liburcu12089-lt-test_urcu_mult73635102.87002.500
liburcu18634-lt-test_urcu_mult72615102.21002.450
liburcutest_urcu_multiflavor_72615102.23002.480
liburcutest_urcu_multiflavor73635102.22002.450
libxcrypblowfish-test11951400.09000.090
lingotlingot250411000.34000.340
logapplogapp166128806.06006.050
memcachememcached-debug538261289.964---
memcachememcached523160289.434---
memcachetestapp1225400.05000.040
mesa-demxeglthreads4027400.02000.030
mesa-demglthreads3607200.02000.020
mesa-demsharedtex_mt2807400.02000.020
meterecmeterec2279662014.510050.140
microcommicrocom127711700.17000.180
miredoserver.o230000.01000.010
miredoteredo-mire14232600.06000.060
miredomiredo24553500.14000.130
miredomiredo-privproc1405700.04000.040
miredomiredo-server11873500.10000.090
miredorelayd.o250000.01000.010
mktorrenmktorrent6841500.07000.080
mmpongmmpongd146418500.96000.970
mutextratwo_threads_one_mutex1001100.00000.000
mxallowdmxallowd4117500.04000.040
n2nsupernode162152603.59005.910
netsniffcurvetun334026306.25006.220
netsniffflowtop20117700.57000.560
nisypbind151076803.6301382265.4013
nisypbind-mt.o497000.01000.010
nisypserv_test3708900.05000.040
nisypserv_test.o364000.00000.000
npth27086-lt-t-mutex259200.01000.000
npth28610-lt-t-thread337800.01000.010
nptht-mutex259200.01000.010
nptht-thread337800.01000.010
nsprlibplds4.so11994000.32000.290
nsprlibplc4.so12208000.33000.300
nsprlibnspr4.so11647000.31000.280
nss-pam-nslcd.o470000.01000.010
ocamlnetnetplex-admin3092200.58000.510
ocamlnetocamlrpcgen3252200.47000.410
openaistestlck80712305.90005.860
openaistesttmr5639700.33000.330
opendnssods-hsmspeed23114507.57007.550
opendnssods-hsmspeed23114507.40007.410
parproutparprouted5322000.02000.010
partclonpartclone.chkimg12832570011.150017.070
partclonpartclone.dd13422824015.540023.370
partclonpartclone.exfat322156260228.4300249.190
partclonpartclone.extfs14723386024.710037.250
partclonpartclone.f2fs292438070411.3800542.900
partclonpartclone.fat16394695045.040064.840
partclonpartclone.hfsp14734125028.350046.120
partclonpartclone.imager13522824015.770023.490
partclonpartclone.minix14893500026.110040.090
partclonpartclone.ntfs14473771025.200040.300
partclonpartclone.reiser414123117020.880030.610
partclonpartclone.restore13322824015.550023.320
pidentdidentd1367581011.010212.522
pnscanpnscan78117701.17001.160
portmidilatency129522900.18000.180
portmidimidithread131137100.31000.310
portmidimidithru129439200.22000.220
portmidimm149529700.24000.250
portmidiqtest1282000.05000.040
portmiditest141953100.98000.990
privbindtestbind1033520.001180.016
proxsmtpproxsmtpd202319340167.750---
ptunnelptunnel111918056519.573207043.3132
radsecprradsecproxy5431847020.630024.020
radsecprt_fticks5453200.18000.150
rng-toolrngd10554041050.89218872.1326
rss-glxmatrixview718284014.210087.340
rtkitrtkit-daemon157913700.38000.380
rtpproxyrtpproxy23863212081.230081.600
seeseetxt222730202.36002.300
signing-keyanalyze3298300.15000.140
sleepdsleepd75013400.94001.090
slurm-drdrmaa-run4002222520207.4500216.790
slurm-drhpc-bash3880400.15000.130
slurm-drexception_test465710858053.760054.610
sndfile-sndfile-jackplay1241800.00000.000
soundmodsoundmodemconfig75692900.49000.470
soundmodchansimberr520039601.51001.490
soundmodchansim516435701.27001.280
soundmodsoundmodem58045600302.940---
spectoolspectool_curses26422600.36000.390
spectoolspectool_gtk5243900.23000.230
spectoolspectool_net24161600.25000.210
spectoolspectool_raw25523700.26000.230
sshguardsshguard257030900408.840---
sucracksucrack70515790.111280.137
taningiaatom2698200.35000.330
taningiairi2713200.15000.160
taningialist2731200.12000.090
taningialog2656200.09000.070
taningiasrv2657200.10000.070
taningiaxmpp-client-226944200.24000.210
taningiaxmpp-client26964800.25000.240
taningialibtaningia.so.0.0.22636000.07000.080
timemachmain.o157000.00000.000
timemachtimemachine9777800.11000.090
twclocktwclock8362052970.39118001.753
udpcastudp-receiver1982837421.421490.672
udpcastudp-sender2408824119.471135.582
w3camw3camd5932900.10000.100
weborfweborf1915432108994.331288095.685
wmaloadewmaloader3245500.02000.020
wysihtmlwysidocbookdaemon89700.00000.000
wysihtmlwysihtmldaemon59500.00000.000
xine-uifbxine1700674539.502---
xine-uixine-remote103012300.18030.182
xmms2-scxmms2-scrobbler8312805.13005.140
xnbdlibxutils_la-io.o188000.00000.000
xnbdlibxnbd_internal.so.0.0.2107000.05000.040
xnbdxnbd-bgctl25179900.66000.620
xnbdxnbd-cachestatdump2124200.06000.050
xnbdxnbd-client250210400.39000.400
xnbdxnbd-server2729400020.690019.560
xnbdxnbd-tester243310100.33000.320
xnbdxnbd-watchdog2242800.08000.060
xnbdxnbd-wrapper299312301.54001.530
 


Table 2: Programs on which musketeer timed out (timeout 10m) for both TSO and Power.
PackageBinaryLoCNodesTSO cy.TSO timeTSO fencesPower cy.Power timePower fences
 
a2jmidida2jmidid13761659------
apfafclient45942538------
apfafserver6249-------
aprsockperf94601087------
autofsautomount12647-------
bablconcurrency-stress-test4311-------
batmandbatmand4011-------
blcrchild.o101-------
blcrpipe.o403-------
blcrsimple_pthread.o102-------
boolectoilingeling13291-------
boolectoplingeling13350-------
bwabwa8255-------
cacti-spspine3314-------
c-icapc-icap101434603------
c-icapc-icap-client6246729------
citadel-citadel7806-------
ckparallel_bytestring.dele1072343------
ckparallel_bytestring1071343------
ckparallel_direct1057340------
cntlmcntlm3838-------
collectdcollectd63891161------
coriandecoriander9042-------
crossfircrossfire-client-gtk2124961546------
crunchcrunch1946851------
daemonlist9245251------
daemonmap91121359------
dapldapltest8474-------
dioddiod9974-------
diodtnpsrv29870-------
diodtnpsrv39859-------
diodtnpsrv8377-------
diodtserialize9018-------
direwolfdirewolf10032-------
dmtcpdmtcp334-------
dmtcpinotify1129-------
dmtcppthread122-------
dmtcppthread249-------
dmtcppthread434-------
dmtcppthread528-------
dumatestmt987-------
dvbstreadvbstreamer814615902------
eegdevrecinxdf2950244------
eegdev28989-lt-systobiia3210286------
eegdevsystobiia3210286------
fcitxfcitx9012-------
fftw3mpi-bench6585-------
fftw310850-lt-bench3711-------
fftw322181-lt-bench3709-------
fftw339151-lt-bench3711-------
fftw36928-lt-bench3711-------
fftw3bench3711-------
fftw3fftwf-wisdom3613385------
fftw3fftwl-wisdom3613385------
fftw3fftwq-wisdom3613385------
fftw3fftw-wisdom3611385------
fizmofizmo-ncursesw12042-------
flam3flam3-animate10394-------
flam3flam3-genome10836-------
flam3flam3-render10425-------
freecellfreecell-solver-multi-thr5876605------
fsarchivfsarchiver6453-------
g15statsg15stats11931021------
gcomprisgcompris-gnuchess5746-------
gdnsd40534-lt-gdnsd10803-------
gdnsdgdnsd10803-------
gdnsd13341-lt-t17_extn_empty418828741------
gdnsd18627-lt-t18_extn_all.b418828741------
gdnsd23427-lt-t21_extn_subs.419431675------
gdnsd27971-lt-t22_nets_corne419029719------
gdnsd32580-lt-t99_loadonly.bi419928868------
gdnsd7587-lt-t15_nogeo.bin420235587------
gdnsdgdnsd_geoip_test426129456------
gdnsdt00_v4db.bin419934120------
gdnsdt01_v6db.bin419532164------
gdnsdt02_v4citydb.bin419733142------
gdnsdt03_v6citydb.bin419733142------
gdnsdt04_v64db.bin419532164------
gdnsdt06_v4nets.bin419934120------
gdnsdt07_v6nets.bin421039499------
gdnsdt10_def.bin419230697------
gdnsdt11_def2.bin419230697------
gdnsdt12_defnone.bin419230697------
gdnsdt13_castatdef.bin418929230------
gdnsdt14_missingcoords.bin419331186------
gdnsdt15_nogeo.bin420235587------
gdnsdt16_extnets.bin421039499------
gdnsdt17_extn_empty.bin418828741------
gdnsdt18_extn_all.bin418828741------
gdnsdt19_extn_allg.bin418828741------
gdnsdt20_extn_allgs.bin418828741------
gdnsdt21_extn_subs.bin419431675------
gdnsdt22_nets_corner.bin419029719------
gdnsdt23_gn_corner.bin418828741------
gdnsdt99_loadonly.bin419928868------
jack-toojack-dl1954-------
jack-toojack-osc2026-------
jack-toojack-play2044-------
jack-toojack-plumbing2089-------
jack-toojack-record2004-------
jack-toojack-scope2139-------
jack-toojack-transport1935-------
jack-toojack-udp1993-------
libapachqslog15861054------
libloexample_client2742287------
liblscpexample_client2878-------
libqbsimplelog68703661------
libqbbmc68302243------
libspf2spfd4901-------
libspf2spfd_static4901-------
liburcutest_urcu_defer1793214------
liburcurcutorture_urcu1931505------
liburcutest_urcu_fork1597249------
netsniffmausezahn11836-------
nss-pam-nslcd6111-------
partclonpartclone.btrfs13125-------
portmidisysex1465380------
 


This document was translated from LATEX by HEVEA.