PATE-GAN: Teachers

[ganevgv]

Description

Upon inspecting PATE-GAN, I believe there might be an issue with the teachers-discriminators. Algorithm 1 on page 7 from the paper, states that the teachers are supposed to be classifiers which are meant to be continuously trained over the whole training procedure (lines 9-10 in Algorithm 1). Instead, L104 defines classifiers (Logistic Regressions) which are (re-)fit from scratch at each iteration; this might prevent them from continuously learning.