However, say I have another Callback which does some computation on_epoch_end and returns some metrics, it will not be displayed by the recorder, since the recorder captures the results before the new callbacks are being executed.
Please correct me if I am misunderstanding anything.
Yup, this is correct. I have been thinking about it, especially because some callbacks might be computing a metric (like precision, recall, f2) that you can’t average over the batches, and need to pass new metrics. So this is an unsolved issue yet.
I think we need a better system, with the possibility to add a new callback where we want it (end/beginning or in between). I think callbacks in general need an order attribute so that the callbackhandler can sort them out, and this is what will solve this.
But no more dev for now, only doc ;). As soon as I get the time, this will be on the first new things implemented.