Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[#5118] feat(auth): Lakehouse Iceberg catalog supports Ranger authorization plugin #5467

Merged
merged 11 commits into from
Nov 6, 2024

Conversation

jerqi
Copy link
Contributor

@jerqi jerqi commented Nov 5, 2024

What changes were proposed in this pull request?

Lakehouse Iceberg catalog supports Ranger authorization plugin

Why are the changes needed?

Fix: #5118

Does this PR introduce any user-facing change?

Add the document.

How was this patch tested?

Add E2E tests.

@jerqi jerqi marked this pull request as draft November 5, 2024 09:47
@jerqi jerqi self-assigned this Nov 5, 2024
@jerqi jerqi requested a review from xunliu November 5, 2024 11:03
@jerqi jerqi closed this Nov 6, 2024
@jerqi jerqi reopened this Nov 6, 2024
@jerqi jerqi marked this pull request as ready for review November 6, 2024 03:31
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The RangerIcebergE2EIT class is the same as RangerHiveE2EIT, I think we can abstract a common IT class.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

They are similar but different. For same update SQL, Iceberg will succeed but Hive will throw exception.

@jerqi jerqi closed this Nov 6, 2024
@jerqi jerqi reopened this Nov 6, 2024
Comment on lines 52 to 57
| `authorization-provider` | Providers to use to implement authorization plugin such as `ranger`. | (none) | No | 0.6.0-incubating |
| `authorization.ranger.admin.url` | The Apache Ranger web URIs. | (none) | No | 0.6.0-incubating |
| `authorization.ranger.auth.type` | The Apache Ranger authentication type `simple` or `kerberos`. | `simple` | No | 0.6.0-incubating |
| `authorization.ranger.username` | The Apache Ranger admin web login username (auth type=simple), or kerberos principal(auth type=kerberos), Need have Ranger administrator permission. | (none) | No | 0.6.0-incubating |
| `authorization.ranger.password` | The Apache Ranger admin web login user password (auth type=simple), or path of the keytab file(auth type=kerberos) | (none) | No | 0.6.0-incubating |
| `authorization.ranger.service.name` | The Apache Ranger service name. | (none) | No | 0.6.0-incubating |
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe need to change 0.6.0-incubating to 0.8.0-xxx?

Copy link
Contributor Author

@jerqi jerqi Nov 6, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This option reuse Hive properties. I don't add a new properity. This propeties are introduced in 0.6.0-incubating. But property doesn't bind to a fixed version. If you think it's necessary, I can this version.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Change to 0.8.0-incubating.

@jerqi jerqi requested a review from xunliu November 6, 2024 11:02
Copy link
Member

@xunliu xunliu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@xunliu xunliu merged commit 6776402 into apache:main Nov 6, 2024
26 checks passed
@jerqi jerqi deleted the ISSUE-5118 branch November 6, 2024 12:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Improvement] Iceberg supports Ranger plugin
2 participants