Analysis of the type 2 error of the PARDelta method for different Delta values

Vol 56, 2024 - 309895
Complete Articles (CA)
Favorite this paper
How to cite this paper?
Abstract

The empirical evaluation of algorithms yields a large set of data that needs to be statistically evaluated. Commonly, the generated set has some missing inputs due to an algorithm's inability to find a solution for a given test case. These missing data strongly limit the use of statistical tests, as classical hypothesis tests cannot be directly applied in the evaluation of these datasets. The ParDelta method emerges as a pre-processing method that inputs the missing data, creating a complete dataset that can be statistically analyzed. The literature uses the PARDelta method with Delta = 10. However, there are no justifications for such a value. In this work we evaluate the power of the PARDelta method for Delta values between 2 and 50 employing a dataset generated by an integer linear programming resolver. The results showed little variation for the different Delta values. 

Share your ideas or questions with the authors!

Did you know that the greatest stimulus in scientific and cultural development is curiosity? Leave your questions or suggestions to the author!

Sign in to interact

Have a question or suggestion? Share your feedback with the authors!

Institutions
  • 1 Universidade Federal de Alfenas
Track
  • 9. EST&MP – Statistics and Probabilistic Models
Keywords
PARDelta
Error Type 2
Statistical evaluation
Integer Linear Programming