-
Notifications
You must be signed in to change notification settings - Fork 237
Site: Add a page for policy management #1600
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
|
||
- **Custom policy types**: Can be defined for specific organizational needs (WIP) | ||
|
||
- **FGAC (Fine-Grained Access Control) policies**: Row filtering and column masking (WIP) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
- **FGAC (Fine-Grained Access Control) policies**: Row filtering and column masking (WIP) | |
- **FGAC (Fine-Grained Access Control) policies**: Row filtering, column masking, column hiding (WIP) |
|
||
### Retrieving Applicable Policies | ||
|
||
Here is an example to find all policies that apply to a specific resource (including inherited policies): |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
should we also mention the RBAC comes into picture ? as not every one can see all the policies applicable to a resource, for ex i think in current implementation we need to require permission on a resource to see the policy applicable ?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Added it
|
||
Policies can be inheritable or non-inheritable: | ||
|
||
- **Inheritable policies**: Apply to the target resource and all its child resources |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
[doubt] is it possible to define the child resources type it needs to be applicable to ? for ex what would remove-orphans means for a view or generic tables ?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
That's a good point. Let me clarify a bit.
|
||
## What is a Policy? | ||
|
||
A policy in Apache Polaris is a structured object that defines rules governing actions on specified resources under |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
[optional]
A policy in Apache Polaris is a structured object that defines rules governing actions on specified resources under | |
A policy in Apache Polaris is a structured entity that defines rules governing actions on specified resources under |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@flyrain Thanks for adding these. Overall LGTM, added some comments.
- **Custom policy types**: Can be defined for specific organizational needs (WIP) | ||
|
||
- **FGAC (Fine-Grained Access Control) policies**: Row filtering, column masking, column hiding (WIP) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
IMHO, the site contains only the features/concepts that has been finalized and implemented, but I also that mentioning these features here can help form a better understanding of the general scope of policy. Should we phrase this more generally, such as: 'Support for additional predefined system policy types and custom policy type definitions is in progress. For more details, please refer to the roadmap.' This way, we avoid over-sharing implementation details while still giving users a clear sense of the feature scope.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think calling FGAC out explicitly will provide a clear picture of what we are trying to do, as the questions about FGAC policy will come up naturally from anyone who understand policies. However, I'm OK with either way. Let me know if you strongly feel which way is better. I can make the changes correspondently.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
That makes total sense—thanks for the clear explanation! My main concern was that listing those three specific FGAC policy types might give the impression that the community has already made concrete decisions on the direction. Maybe we could just mark them as tentative examples to make it clearer they're still under discussion (i.e. extends the WIP
a little bit)?
- **`system.data-compaction`**: Defines rules for data compaction operations | ||
- Schema Definition: @https://polaris.apache.org/schemas/policies/system/data-compaction/2025-02-03.json | ||
- Controls file compaction to optimize storage and query performance | ||
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Applicable resources: Iceberg table, namespace, catalog |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
was wondering, can we follow an E2E example
for ex :
- define policy 1, policy 2
- attach policy 1 on table (NS1.tb1) and policy 2 on namsepace (NS1)
- get applicable policy on table t1
This will help the E2E flow ? WDYT ?
read permission on that resource. The permission model may be enhanced in the future when Fine-Grained Access Control | ||
policy is introduced, which will provide more granular control over policy visibility and management. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
should we skip this part for now ? as its bit too much info.
read permission on that resource. The permission model may be enhanced in the future when Fine-Grained Access Control | |
policy is introduced, which will provide more granular control over policy visibility and management. | |
read permission on that resource. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Overall, LGTM but a few questions :)
} | ||
``` | ||
|
||
The policy content is validated against a schema specific to its type. Here are a few policy content examples |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The policy content is validated against a schema specific to its type. Here are a few policy content examples | |
The policy content is validated against a schema specific to its type. Here are a few policy content examples: |
} | ||
``` | ||
|
||
For inheritable policies, only one policy of a given type can be attached to a resource. For non-inheritable policies, multiple policies of the same type can be attached. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
[not requesting change]: is there a document about why this is the case?
Polaris supports several predefined system policy types (prefixed with `system.`): | ||
|
||
- **`system.data-compaction`**: Defines rules for data compaction operations | ||
- Schema Definition: @https://polaris.apache.org/schemas/policies/system/data-compaction/2025-02-03.json |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
question: what does the "@" do for links in this framework?
No description provided.