Changeset 92 for papers/FDL2012/exp_results.tex
- Timestamp:
- Apr 6, 2012, 10:37:41 PM (13 years ago)
- File:
-
- 1 edited
Legend:
- Unmodified
- Added
- Removed
-
papers/FDL2012/exp_results.tex
r89 r92 1 1 We have conducted preliminary experiments to test and compare the performance 2 of our strategy with existing abstraction-refinementtechniques available in2 of our strategy with existing techniques available in 3 3 VIS. There are several abstraction-refinement techniques implemented in VIS 4 4 accessible via \emph{approximate\_model\_check}, 5 5 \emph{iterative\_model\_check}, \emph{check\_invariant} and 6 \emph{incremental\_ctl\_ model\_check} commands. However, among the available7 techniques, \emph{incremental\_ctl\_ model\_check} is the only one that supports CTL formulas and fairness constraints which are necessary in our test platforms. It is an automatic abstraction refinement algorithm which generates an initial conservative abstraction principally by reducing the size of the latches by a constant factor. If the initial abstraction is not conclusive, a \emph{goal set} will then be computed in order to guide the refinement process \cite{PardoHachtel98incremCTLMC} \cite{PardoHachtel97autoAbsMC}.6 \emph{incremental\_ctl\_verification} commands. However, among the available 7 techniques, \emph{incremental\_ctl\_verification} is the only one that supports CTL formulas and fairness constraints which are necessary in our test platforms. It is an automatic abstraction refinement algorithm which generates an initial conservative abstraction principally by reducing the size of the latches by a constant factor. If the initial abstraction is not conclusive, a \emph{goal set} will then be computed in order to guide the refinement process \cite{PardoHachtel98incremCTLMC} \cite{PardoHachtel97autoAbsMC}. 8 8 9 9 … … 18 18 \toprule 19 19 \multicolumn{3}{l}{\textbf{Experiment}} & \emph{Number of} & \emph{BDD} & \emph{Number of } & \emph{Analysis}\\ 20 \multicolumn{3}{l}{\textbf{Platform}} &\emph{BDD Variables} & \emph{Size} & \emph{Reachable States} & \emph{Time (s)} \\20 \multicolumn{3}{l}{\textbf{Platform}} &\emph{BDD Variables} & \emph{Size} & \emph{Reachable States} & \emph{Time (s)} \\ 21 21 \midrule 22 22 \midrule … … 24 24 & Concrete & 2 Masters-1 Slave & 445 & 24406 & 7.71723e+06 & 35.2 \\ 25 25 & Model & 4 Masters-1 Slave & 721 & 84118 & 3.17332e+12 & 2818.3 \\ 26 & & 4 Masters-2 Slaves & 911 & N/A & N/A & >1 day\\26 & & 4 Masters-2 Slaves & 895 & 238990 & 5.708e+15 & 68882.3\footnotemark[1] \\ 27 27 \cline{2-7} 28 28 \cline{2-7} … … 36 36 & Model & 4 Masters-1 Slave & 498 & 121 & 1.80144e+18 & 0.02 \\ 37 37 & for $\phi_2$ & 4 Masters-2 Slaves & 586 & 141 & 3.68935e+21 & 0.02 \\ 38 \midrule38 % \midrule 39 39 \midrule 40 &\multicolumn{2}{c}{Concrete Model} & 822 & 161730 & 3.7354e+07 & 300.12 \\40 &\multicolumn{2}{c}{Concrete Model} & 822 & 161730 & 3.7354e+07 & 300.12 \\ 41 41 \cline{2-7} 42 42 \cline{2-7} … … 45 45 &\multicolumn{2}{c}{Final Abstract Model for $\phi_4$} & 425 & 187 & 1.66005e+12 & 0.04 \\ 46 46 \bottomrule 47 \bottomrule 47 %\bottomrule 48 48 49 \end{tabular} 49 50 … … 51 52 \end{table*} 52 53 54 %\footnotetext[1]{Computed on a calculation server.} 53 55 54 56 … … 72 74 & & Standard MC & - & 6.13 \\ 73 75 \midrule 74 \midrule76 %\midrule 75 77 & & Prop. Select. & 1 & 2.0 \\ 76 78 VCI-PI: & $\phi_1$ & Incremental & 0 & 20.4 \\ … … 81 83 & & Standard MC & - & 39.4 \\ 82 84 \midrule 83 \midrule85 %\midrule 84 86 85 87 & & Prop. Select. & 1 & 2.1 \\ … … 91 93 & & Standard MC & - & >1 day \\ 92 94 \midrule 93 \midrule95 %\midrule 94 96 95 97 & & Prop. Select. & 1 & 2.2 \\ … … 101 103 & & Standard MC & - & >1 day\\ 102 104 \midrule 103 \midrule105 %\midrule 104 106 & & Prop. Select. & 0 & 1.02 \\ 105 107 &$\phi_3$ & Incremental & N/A & >1 day \\ … … 111 113 112 114 \bottomrule 113 \bottomrule115 %\bottomrule 114 116 115 117 \end{tabular} … … 117 119 \caption{\label{TabVerif} Verification Results } 118 120 \end{table} 119 120 121 121 122 122 … … 128 128 $\phi_1$ is the type $AF((p=1)*AF(q=1))$ and $\phi_2$ is actually a stronger 129 129 version of the same formula with $AG(AF((p=1)*AF(q=1)))$. We have a total of 130 2 7verifed components properties to be selected in VCI-PI plateform.130 26 verifed components properties to be selected in VCI-PI plateform. 131 131 In comparison to $\phi_2$, we can see that, a better set of properties available will result in a better abstraction and less refinement iterations. 132 132
Note: See TracChangeset
for help on using the changeset viewer.