Understanding metrics and callbacks

fbeta is intended for one-hot-encoded targets (often in a multiclassification problem). Maybe you used it for binary classification problem?