I have prepared a new function called CFU_ratioRMS to compute the ratio of...
I have prepared a new function called CFU_ratioRMS to compute the ratio of RMSE for two experiments and provide the p-value of the Fisher test with Ho: RMSE1/RMSE2 = 1. Furthermore, a trouble has been detected in the computation of the number of independant data in a time series. The computation of the confidence interval and significance level in CFU_corr and CFU_RMS may have been affected by this trouble as they rely on parametric tests. I advise you to check whether the significance level and confidence intervals of your correlation and RMSE is modified with version 18. Some more details are described below : 1) CFU_ratioRMS : You have to provide three matrix: two for the 2 experiments you wish to compare and 1 observational dataset. All three input matrix should have the same dimensions. The output matrix contains a dimension of length 2 at the position of the input dimension along which the RMSE has been requested : the ratio of the two RMSE1 + the p-value of the Fisher test. 2) The computation of the number of independant data in a time series rely on a formula provided in the VonStorch & Zwiers and which seems not to be accurate enough. The number of independant data can be larger than the true number of data in the original formulation. I have made a temporary fix which consists in bounding the number of independant data by the true number of data. This may not be an optimal solution but it seems to provide good results on the few examples I have tested.
Please register or sign in to comment