Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
This PR adds a callback class to be used in transformers model training. Transformers callbacks are objects that can customize the behavior of the training loop in the PyTorch or Keras Trainer. They can inspect the training loop state and take decisions (like early stopping) or perform actions (like logging, saving, or evaluation). LangTest utilizes this functionality by implementing an automatic testing callback. The callback class is flexible and customizable and can be easily integrated with any transformers model.
Usage
Create a callback instance with one line and then use it in the callbacks of trainer:
Screenshots (if appropriate):
The report after each epoch is printed and saved if configured to do so.
Notebook:
https://colab.research.google.com/github/JohnSnowLabs/langtest/blob/main/demo/tutorials/misc/HF_Callback_Text_Classification.ipynb
https://colab.research.google.com/github/JohnSnowLabs/langtest/blob/main/demo/tutorials/misc/HF_Callback_Text_Classification.ipynb