Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Apply the persistant training schema form NCAs #20

Open
5 tasks done
Francesco215 opened this issue May 7, 2023 · 0 comments
Open
5 tasks done

Apply the persistant training schema form NCAs #20

Francesco215 opened this issue May 7, 2023 · 0 comments
Labels
enhancement New feature or request

Comments

@Francesco215
Copy link
Owner

Francesco215 commented May 7, 2023

This is similar to what is done in the neural CA paper

To do:

  • Define a pool of seed states to start the iterations from, initially filled with the single black pixel seed state.
  • Sample a batch from the pool for use in the training step.
  • Replace one sample in this batch with the original, single-pixel seed state to prevent the equivalent of "catastrophic forgetting".
  • Conclude the training step.
  • Replace samples in the pool that were sampled for the batch with the output states from the training step over this batch.
@Francesco215 Francesco215 added the enhancement New feature or request label May 7, 2023
Francesco215 added a commit that referenced this issue May 15, 2023
made ShakespeareGenerator
Francesco215 added a commit that referenced this issue May 16, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant