KAFKA-17915: Convert remaining Kafka Client system tests to use KRaft

[kevin-wu24]

Convert tests/kafkatest/tests/client/client_compatibility_features_test.py, tests/kafkatest/tests/client/client_compatibility_produce_consume_test.py, and
tests/kafkatest/tests/client/quota_test.pyto use KRaft.

Committer Checklist (excluded from commit message)

• Verify design and implementation
• Verify test coverage and CI build status
• Verify documentation (including upgrade notes)

[github-actions]

A label of 'needs-attention' was automatically added to this PR in order to raise the
attention of the committers. Once this issue has been triaged, the triage label
should be removed to prevent this automation from happening again.

[lianetm]

Thanks for the patch @kevin-wu24! Overall lgtm. Couple of comments:

Regarding the quota_test, since is being migrated to kraft with this PR, should we revise the force_use_zk_connection param it's still using?

Also, could you please run the updated test and share the output to validate the changes? Thanks!

[kevin-wu24]

Thanks for the review @lianetm!

Regarding the quota_test, since is being migrated to kraft with this PR, should we revise the force_use_zk_connection param it's still using?

Yes, this boolean is always False, so we can remove it.

Also, could you please run the updated test and share the output to validate the changes? Thanks!

Link to system test run: https://semaphore.ci.confluent.io/workflows/6d93b69f-8d61-4b30-974b-09e092d276df passed

[lianetm]

Thanks @kevin-wu24 ! LGTM.

[lianetm]

Just for the record, here is the public link to the test results shared above:
https://confluent-open-source-kafka-branch-builder-system-test-results.s3-us-west-2.amazonaws.com/trunk/2025-01-08--001.3d3c4cba-6c8d-4f37-940a-0969c1f5f5dd--1736378886--kevin-wu24--KAFKA-17915-p2--c92b4514a8/report.html

[lianetm]

Merged to trunk and cherry-picked to 4.0