diff options
Diffstat (limited to 'content/evaluation.tex')
| -rw-r--r-- | content/evaluation.tex | 18 |
1 files changed, 6 insertions, 12 deletions
diff --git a/content/evaluation.tex b/content/evaluation.tex index 8f587d1..b17fd9d 100644 --- a/content/evaluation.tex +++ b/content/evaluation.tex @@ -23,7 +23,7 @@ \begin{figure}[t] \centering \includegraphics[width=0.8\linewidth]{images/novel_eval_method.png} - \caption{A novel evaluation method which solves the issue of real-world experimentation, which is unsustainable and costly~\cite{DBLP:conf/ccgrid/MastenbroekAJLB21}.} + \caption[A novel evaluation method proposal.]{A novel evaluation method which solves the issue of real-world experimentation, which is unsustainable and costly~\cite{DBLP:conf/ccgrid/MastenbroekAJLB21}.} \label{fig:novel_eval_method} \end{figure} @@ -72,7 +72,7 @@ We believe the deviation in the results of the experiments stemming only from th \begin{figure}[t] \centering \includegraphics[width=0.8\linewidth]{images/red_yellow_alarms.pdf} - \caption{The results of Experiment 1. \textcolor{Orange}{\ding{110} \textbf{\sffamily Red Alarms}} signify 90\% of acceptable failure threshold was reached. \textcolor{Goldenrod}{\ding{110} \textbf{\sffamily Yellow Alarms}} signify 80\% of the threshold was reached.} + \caption[The results of Experiment 1.]{The results of Experiment 1. \textcolor{Orange}{\ding{110} \textbf{\sffamily Red Alarms}} signify 90\% of acceptable failure threshold was reached. \textcolor{Goldenrod}{\ding{110} \textbf{\sffamily Yellow Alarms}} signify 80\% of the threshold was reached.} \label{fig:red_yellow_alarms} \end{figure} @@ -97,7 +97,7 @@ Importantly, the more failure-intense the trace, the more alarms are raised on b \begin{figure}[t] \centering \includegraphics[width=0.8\linewidth]{images/alarms_vs_failures.pdf} - \caption{Comparison between the total number of raised alarms and the ground truth failure distribution during a BitBrains workload in the SURF-SARA cluster. The failure traced used in this experiment models Gmail outage reports~\cite{DBLP:journals/tpds/TalluriNCKCBI26}.} + \caption[Total number of failures versus numbe rof alarms raised.]{Comparison between the total number of raised alarms and the ground truth failure distribution during a BitBrains workload in the SURF-SARA cluster. The failure traced used in this experiment models Gmail outage reports~\cite{DBLP:journals/tpds/TalluriNCKCBI26}.} \label{fig:alarms_vs_failures} \end{figure} @@ -114,7 +114,7 @@ In our experiment, the numbers differ significantly. \begin{figure}[t] \centering \includegraphics[width=0.8\linewidth]{images/failure_detecton_rate.pdf} - \caption{In this figure we show the total failure detection rate (\textcolor{Thistle}{\ding{110} \textbf{\sffamily Red + Yellow Alarms / Total Failures}}). + \caption[Failure detection rate overview.]{In this figure we show the total failure detection rate (\textcolor{Thistle}{\ding{110} \textbf{\sffamily Red + Yellow Alarms / Total Failures}}). Our results are much different from DyTwin's performance~\cite{DBLP:conf/sc/TaheriBPRHDEWPM24}. We believe this is due to the irreconcilable differences between our experimental setups.} \label{fig:failure_detecton_rate} @@ -143,17 +143,11 @@ In this section we try to show \mysystem can additionally work well together wit \centering \includegraphics[width=1.2\linewidth]{images/conceptual_experiment.pdf} \end{minipage} - \caption{Left figure shows the potential failure distribution likelihood to approximate the true failure distribution. + \caption[The results of Experiment 2.]{Left figure shows the potential failure distribution likelihood to approximate the true failure distribution. Right figure shows the results of the conceptual experiment to show the \emph{potential} gains of employing a good predictive analytics engine with \mysystem.} \label{fig:failure_likelihood} \end{figure} -\begin{figure}[ht] - \centering - \includegraphics[width=\linewidth]{images/failure_models_table.png} - \caption{The failure models table, by Javadi \etal~\cite{DBLP:journals/jpdc/JavadiKIE13}.} - \label{tab:failure_models_table} -\end{figure} - +\input{sources/failure_models.tex} \subsection{Context}\label{sss:context_experiment2} In order to predict when a host failure might occur, the most straightforward approach is to use long-established statistical methods. |