How to use Osprey-Chat to generate a short description for all masks of an image?

[tiesanguaixia]

Thank you for the amazing work! I saw the Offline demo you introduced, but it seems that this process still requires manual clicking on specific masks to generate a specific description, rather than generating descriptions for all masks at once. I currently hope to use Osprey (of course, Osprey-Chat is better) to build a fully automated process that does not require human involvement, generating a brief description for each mask in a picture. Do you have any suggestions? Thanks a lot!

[LiWentomng]

@tiesanguaixia
If you have gt masks for all pictures, you can try to perform the inference process, like https://github.com/CircleRadon/Osprey/blob/main/osprey/eval/refcocog_eval.py
otherwise, you can first use SAM everything mode to extract all the masks.