Evaluation procedure is a piece of Java code that takes the algorithm file (solution file in case of a challenge) and calculates its quality measure, score, if the algorithm is applied to a given dataset.
Typically, the algorithm file contains executable code that's interpreted by the procedure and executed to process the dataset. The outcome of algorithms' execution is evaluated by the procedure in a way that produces single floating-point number, the result (score).
In case of challenges,
Evaluation procedure implements all steps of the experiment (if the algorithm is executable code). In TunedIT, evaluation procedures are pluggable and every user can implement a new one (read more...).
- this can be a solution file submitted by participant in case of a challenge -