Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[pull] main from NVIDIA:main #30

Merged
merged 1 commit into from
Nov 21, 2024
Merged

[pull] main from NVIDIA:main #30

merged 1 commit into from
Nov 21, 2024

Conversation

pull[bot]
Copy link

@pull pull bot commented Nov 21, 2024

See Commits and Changes for more details.


Created by pull[bot] (v2.0.0-alpha.1)

Can you help keep this open source service alive? 💖 Please sponsor : )

* Handle deprecated `hidden_size` arg in norm modules

Signed-off-by: Tim Moon <[email protected]>

* Support initializing norm ops on CPU

Signed-off-by: Tim Moon <[email protected]>

* Add integration test for Megatron-LM

Signed-off-by: Tim Moon <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Rename Mcore integration test

Signed-off-by: Tim Moon <[email protected]>

* Handle case in RMSNorm where hidden dim is not provided

Signed-off-by: Tim Moon <[email protected]>

---------

Signed-off-by: Tim Moon <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
@pull pull bot added the ⤵️ pull label Nov 21, 2024
@pull pull bot merged commit 6b98768 into phu0ngng:main Nov 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant