ct_run & spec file with groups runs all tests

[fregate]

Describe
I have some application, tests and spec file to run different tests for different profiles (in rebar3). And if I have more than one suite I cannot run only one specified group of tests in all test suites. In spec file I described group {groups, 'This', [platform_SUITE, unit_SUITE], unit_tests}. which I want to run in tests. So If I specify only one (any) suite - it runs only tests in unit_tests group, but if I specify all or group of suites - it run all tests in its.

Erlang/OTP 28 [DEVELOPMENT] [erts-15.2] [source-52b82ede8b] [64-bit] [smp:16:16] [ds:16:16:10] [async-threads:1] [jit:ns]

Common Test starting (cwd is /.../myapp)

Common Test: Running make in test directories...
Recompile: platform_SUITE
Eshell V15.2 (press Ctrl+G to abort, type help(). for help)
Recompile: unit_SUITE

CWD set to: "/.../myapp/_build/x/[email protected]_16.48.30"

TEST INFO: 2 test(s), 5 case(s) in 2 suite(s)

Testing apps.myapp.platform_SUITE: Starting test, 3 test cases

Has to be only 1 test (1 test in unit_tests group)

and for unit_SUITE

Testing apps.myapp.unit_SUITE: Starting test, 2 test cases

To Reproduce
Run ct_run -spec spec/unit.ct.spec in app dir.

myapp.zip

Expected behavior
Run only specified group test in specified suites.

Affected versions
Erlang/OTP 25 [erts-13.2.2.5] - main
Erlang/OTP 28 [DEVELOPMENT] [erts-15.2] [source-52b82ede8b] - from github master

[u3s]

yes. looks like a bug indeed. thanks for report.