Fix skip_if causing serialization of a recursive type to be O(2**n) instead of O(n)

Fix skip_if causing serialization of a recursive type to be O(2**n) instead of O(n) #875