Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Running in parallel #40

Closed
Sameeranjoshi opened this issue Apr 11, 2023 · 3 comments
Closed

Running in parallel #40

Sameeranjoshi opened this issue Apr 11, 2023 · 3 comments

Comments

@Sameeranjoshi
Copy link

I am using ytopt for running a few thousand sampling tests. I want to know if there is any way to run them in parallel or speed up the searching somehow.

I have inputs such that almost 60% of sampling inputs are false positives, so even reducing them from the total sampling space would also be another pointer I wish to know if any.
I tried to use the conditionals and forbidden but they don't seem to be applicable for the use case which I am trying to get working, my usecase is that I want to keep the multiplication of tx * ty which are 2 integer hyperparameters below 1024 which refers to the threadIdx.x andthreadIdx.ywhich should be less than 1024 the total thread limit on a GPU, any suggestions would be helpful.

Thanks

@wuxf99
Copy link
Contributor

wuxf99 commented Jul 6, 2023

Sorry for the late response. Yes, you can try our latest development https://github.com/ytopt-team/ytopt-libensemble to run them in parallel to speed up the search and evaluation processes. For your case, you can add the constraint in your parameter configuration space to make sure x * y < 1024 using LessThanCondition.

@nchristensen
Copy link
Contributor

nchristensen commented Oct 27, 2023

@Sameeranjoshi See automl/ConfigSpace#280 for an implementation of this functionality.

@wuxf99
Copy link
Contributor

wuxf99 commented Nov 4, 2023

Thanks

@wuxf99 wuxf99 closed this as completed Nov 4, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants