Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

testsuite: fixes for Lassen #5551

Merged
merged 2 commits into from
Dec 20, 2023

Conversation

wihobbs
Copy link
Member

@wihobbs wihobbs commented Nov 10, 2023

Problem: Lassen doesn't like the words login, workflow, or infeasible, and it causes our CI spellcheck tests to break on that machine.

Add those words to the exempt word list in the docs.

Looking at previous issues, I thought that #3071 might be at play since LC_ALL=C is set on Lassen but not on TOSS 4 machines. Changing that to LC_ALL="" didn't solve the issue.

I also tried using SHARNESS_SKIP_TESTS=spellcheck command listed in the testsuite readme, but it still ran the test. Do we support that command? When I git grep'd for it in core I couldn't find anywhere in our shell scripts it's used. I did find SKIP_TESTS in t/sharness.sh but setting that variable to the same thing also didn't exempt the spellcheck test.

Also, just if anyone was curious ;) according to the OED "log in" or "log-in" are the official words. "workflow" and "infeasible" are also words.

@wihobbs wihobbs force-pushed the doc-spellcheck-lassen branch from 2d616bc to 8b5a052 Compare November 10, 2023 18:34
@grondo
Copy link
Contributor

grondo commented Nov 10, 2023

I also tried usingSHARNESS_SKIP_TESTS=spellcheck command listed in the testsuite readme, but it still ran the test. Do we support that command? When I git grep'd for it in core I couldn't find anywhere in our shell scripts it's used. I did find SKIP_TESTS in t/sharness.sh but setting that variable to the same thing also didn't exempt the spellcheck test.

The problem is that the spellcheck test is not a sharness test, it is under doc and all sharness tests are under t.

The README should indeed reference SKIP_TESTS not SHARNESS_SKIP_TESTS, want to add a patch to this PR to change that?

@wihobbs wihobbs force-pushed the doc-spellcheck-lassen branch 3 times, most recently from b6d2e2e to 6d30c41 Compare November 13, 2023 17:22
@wihobbs
Copy link
Member Author

wihobbs commented Nov 13, 2023

Thanks @grondo for the workaround on the bit mapping/affinity tests. The testsuite runs in lassen on a compute node using make check. I'm looking into some failures on the runner now, although I think it might be a problem with lassen's hwloc, because the tests are taking a while to run like they used to on tioga... looking at it more.

@wihobbs wihobbs changed the title doc: add login, workflow, infeasible to dict testsuite: fixes for Lassen Nov 13, 2023
@wihobbs
Copy link
Member Author

wihobbs commented Nov 13, 2023

All right, it's down to one consistent failure.

FAIL: t5000-valgrind.t 1 - valgrind reports no new errors on 2 broker run
ERROR: t5000-valgrind.t - exited with status 1

And some inconsistent failures in t2233. I'll see if these keep showing up.

One thing (not to take this offtrack, just noting to myself) is that HWLOC_COMPONENTS=x86 does not need to be set in Lassen's gitlab CI configuration. It was causing a lot of junk output, and the number of failing tests decreased with it removed.

@grondo
Copy link
Contributor

grondo commented Dec 20, 2023

Want to resolve conflicts here and rebase on current master?

@wihobbs
Copy link
Member Author

wihobbs commented Dec 20, 2023

Yeah, let's do that and get this closed. We can come back to t5000 later

@wihobbs wihobbs force-pushed the doc-spellcheck-lassen branch from 6d30c41 to 2f45995 Compare December 20, 2023 16:52
@wihobbs wihobbs requested a review from grondo December 20, 2023 16:52
Copy link
Contributor

@grondo grondo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice, thanks!

@wihobbs
Copy link
Member Author

wihobbs commented Dec 20, 2023

Ughhhhh, fixing

Problem: Lassen doesn't seem to like the words login,
workflow, or infeasible, and it causes our CI spellcheck tests
to break on that machine.

Add those words to the exempt word list in the docs.
Problem: SHARNESS_SKIP_TESTS isn't the correct
environment variable to skip a sharness test.

Update the readme to SKIP_TESTS which is referenced in
t/sharness.sh.
@wihobbs
Copy link
Member Author

wihobbs commented Dec 20, 2023

Thanks @grondo!

Copy link

codecov bot commented Dec 20, 2023

Codecov Report

Merging #5551 (9a85ddf) into master (41bc9ab) will increase coverage by 0.02%.
The diff coverage is n/a.

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #5551      +/-   ##
==========================================
+ Coverage   83.42%   83.44%   +0.02%     
==========================================
  Files         487      487              
  Lines       82872    82872              
==========================================
+ Hits        69138    69156      +18     
+ Misses      13734    13716      -18     

see 10 files with indirect coverage changes

@mergify mergify bot merged commit 9dbec6a into flux-framework:master Dec 20, 2023
33 checks passed
@wihobbs wihobbs deleted the doc-spellcheck-lassen branch January 12, 2024 19:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants