You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository has been archived by the owner on Oct 9, 2023. It is now read-only.
I'd like to create my own callback that will create an image of a confusion matrices for multilabel classification in TensorBoard. To do that at the end of validation epoch, I have to somehow get to outputs of all validation steps. I am trying to implement on_validation_batch end in my custom callback to store outputs internally after every validation batch:
The problem is outputs are None, which I guess is because ImageClassifier's validation_step doesn't return anything. How can I easily override it? Of course I can make my own LightningModule, but if I were to, I could as well not use Lightning Flash at all ;) I went through the code and I see this validation_step to be overriden is a few levels deep in an adapter that is an attribute of ImageClassifier instance, which makes it hard to override.
Of course, if you have any suggestion how I can implement what I want differently, I am open to it.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
I'd like to create my own callback that will create an image of a confusion matrices for multilabel classification in TensorBoard. To do that at the end of validation epoch, I have to somehow get to outputs of all validation steps. I am trying to implement on_validation_batch end in my custom callback to store outputs internally after every validation batch:
The problem is outputs are None, which I guess is because ImageClassifier's validation_step doesn't return anything. How can I easily override it? Of course I can make my own LightningModule, but if I were to, I could as well not use Lightning Flash at all ;) I went through the code and I see this validation_step to be overriden is a few levels deep in an adapter that is an attribute of ImageClassifier instance, which makes it hard to override.
Of course, if you have any suggestion how I can implement what I want differently, I am open to it.
Beta Was this translation helpful? Give feedback.
All reactions