AniDB tasks are blocking the queue too much. It could be handled better.

[plato79]

VERSION INFORMATION

Server Version: 5.0.0.0 Stable
(76da970)

Desktop Version: -

If you've compiled your own version, please use the last commit you compiled.

DESCRIPTION

When there are thousands of tasks in the queue and all of the workers are working on AniDB tasks the queue is emptied extremely slow. I believe that's because AniDB tasks are handled one by one.

STEPS TO REPRODUCE

This could happen entirely random when importing a lot of files.

POSSIBLE SOLUTION

At every 5-6 tasks processed, the worker tasks should be analyzed. If all of them are AniDB tasks or if it's bigger than a set value, then non-AniDB tasks should be brought forward of the queue ( around 8 tasks maybe ) . This way while anidb tasks are executed one by one as intended, shoko could take care of other tasks ( grabbing TMDB Image, trakt.tv data update etc.. ).

It should be checked constantly because after those 8 tasks are processed it may be possible that again 10+ anidb tasks are clumped together in front of the queue and blocking other tasks.

[harshithmohan]

AniDB tasks are always done one by one, and other non-anidb tasks are not blocked by them if you have workers available 🤔

I will tag the experts: @revam @da3dsoul

[da3dsoul]

Mohan is correct. I saw you are on the discord. You can ask more detailed questions there. I'll close this, as AniDB simply does not block other task types.