Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Initialization of psis and lambdas #10

Open
rossfadely opened this issue Oct 11, 2012 · 4 comments
Open

Initialization of psis and lambdas #10

rossfadely opened this issue Oct 11, 2012 · 4 comments
Assignees

Comments

@rossfadely
Copy link
Owner

  • Initializing psis to 0.5 * datavar seems to be ok (see other issue on logdet going negative)
  • Initializing lambas to something close to the datavar is bad, the covariance initialization in this case is HUGE and the final covariance doesnt become sensible
@rossfadely
Copy link
Owner Author

  • Final lambdas have values order ~ +/- unity, so using randn to initialize isnt crazy
  • PCA is probably the most sensible way to go

@davidwhogg
Copy link
Collaborator

holy crap that sucks. Let's make sure we either:

  1. figure out what initializations are legit, or
  2. figure out why the code is broken and fails on some initializations

And either way, let's document it in the code and document.

@rossfadely
Copy link
Owner Author

Hogg and Fadely concluded:

  • That initializing lambdas to zero may be sensible
  • If we dont, there seem to be cases where psis get negative elements early during EM
  • There may be some bug
  • If there isn't this is important to document and get the word out

@davidwhogg
Copy link
Collaborator

we should initialize with a probabilsitic pca on each of the k-means. Will issue this.

@ghost ghost assigned rossfadely Oct 17, 2012
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants