Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release v0.10 #17

Merged
merged 29 commits into from
Jan 7, 2025
Merged

Release v0.10 #17

merged 29 commits into from
Jan 7, 2025

Conversation

qchiujunhao
Copy link
Collaborator

@qchiujunhao qchiujunhao commented Dec 31, 2024

  • upgrade Ludwig version

  • Enable GPU usage

  • Better HTML and outputs

  • Passed all tests

  • Removed explicit overriding of $TMP* from the code.

  • Replaced all instances of pwd with .

  • Sanitized ${dataset.element_identifier}.

  • Incorporated yaml.safe_dump().

  • Changed format = "auto" in Ludwig_visualize.xml.

  • Replaced ludwig_model with the html format.

  • Added min and max for numeric parameters.

  • Fixed typo.

qchiujunhao and others added 27 commits March 26, 2024 11:52
Since ludwig[full] will install torch and Ray. Ludwig has strong support for Ray, a framework for distributed computing, so we are not going to use Horovod. Ray doesn't support python 3.11 now.
since Galaxy provides this functionality
* job_conf change

* Readme comments resolved_1
* Readme comments and job_conf changes

* expect_num_outputs added (test on xml files)
* Update README.md

Specify that users should select the branch they want to install.

* path for job_conf.yml

* added a Dockerfile for GPU

* Reorganized the Dockerfile

* add unzip after testing

* define the docker requirements for gpu
* lint and tests

* passed the tests

* deleted the code for debugging

* add a triggered branch

* change to new version of actions

* lint the import order

* new html and assert_contents

* update hyperopt test file

* define the order and replace pwd

* passed all tests locally

* use the same docker image

* Update temp_hyperopt_training.learning_rate.pdf

after update_test_data

* Removed tool declarations in actions.
* comments fixed

* Update ludwig_hyperopt.py

line added for lint

* fix_from_comments_Junhao

* fix_#2

* Change discover_datasets pattern in viz outputs

Noticed that there is a comment about this.

---------

Co-authored-by: JunhaoQiu <[email protected]>
@qchiujunhao qchiujunhao marked this pull request as draft January 6, 2025 02:40
* fixed issues after testing on the cancer server

1. The Ray server requires `TMP` environment variables to start.

2. Sometimes datasets have spaces at the end of their filenames. During sanitization, these spaces cause the name to become `**.csv_`, which raises an issue. To fix this, spaces in the filename are replaced with nothing before sanitization.

3.Removed the table in the hyperopt HTML report since it was too visually unappealing. A JSON file output is provided instead.

* test data updated

* python lint

* replace -> strip
* deleted table from html

1. deleted test stats table from experiment report html
2. change some output name

* python lint
@qchiujunhao qchiujunhao marked this pull request as ready for review January 7, 2025 22:30
@qchiujunhao qchiujunhao merged commit bdea943 into main Jan 7, 2025
22 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants