Filter on token length

[cwiggi01]

Would like to filter dataset for images that contain over the token limit 75, would be nice to do that and then move them, etc.

[jhc13]

In the current implementation, the tokens for an image are counted only when the image is selected. I will check how much time it takes to count the tokens for every image, then consider adding the filter if it isn't too slow.

[jhc13]

I tested it and it was reasonably fast, so I added the token count filter (as well as a tag count and character count filter). It will be included in the next release.

[jhc13]

This has been released in v1.7.0.

In the Filter Images box above the image list, type tokens:>75 to filter for images with more than 75 tokens in the caption.