amazonaws.com – lakeformation
Lake Formation
Defines the public endpoint for the Lake Formation service.
- Homepage
- https://api.apis.guru/v2/specs/amazonaws.com:lakeformation/2017-03-31.json
- Provider
- amazonaws.com:lakeformation / lakeformation
- OpenAPI version
- 3.0.0
- Spec (JSON)
- https://api.apis.guru/v2/specs/amazonaws.com/lakeformation/2017-03-31/openapi.json
- Spec (YAML)
- https://api.apis.guru/v2/specs/amazonaws.com/lakeformation/2017-03-31/openapi.yaml
Tools (49)
Extracted live via the executor SDK.
-
addLfTagsToResource.postOperationAttaches one or more LF-tags to an existing resource.
-
assumeDecoratedRoleWithSaml.postOperationAllows a caller to assume an IAM role decorated as the SAML user specified in the SAML assertion included in the request. This decoration allows Lake Formation to enforce access policies against the SAML users and groups. This API operation requires SAML federation setup in the caller’s account as it can only be called with valid SAML assertions. Lake Formation does not scope down the permission of the assumed role. All permissions attached to the role via the SAML federation setup will be included in the role session.
This decorated role is expected to access data in Amazon S3 by getting temporary access from Lake Formation which is authorized via the virtual API
GetDataAccess. Therefore, all SAML roles that can be assumed viaAssumeDecoratedRoleWithSAMLmust at a minimum includelakeformation:GetDataAccessin their role policies. A typical IAM policy attached to such a role would look as follows: -
batchGrantPermissions.postOperationBatch operation to grant permissions to the principal.
-
batchRevokePermissions.postOperationBatch operation to revoke permissions from the principal.
-
cancelTransaction.postOperationAttempts to cancel the specified transaction. Returns an exception if the transaction was previously committed.
-
commitTransaction.postOperationAttempts to commit the specified transaction. Returns an exception if the transaction was previously aborted. This API action is idempotent if called multiple times for the same transaction.
-
createDataCellsFilter.postOperationCreates a data cell filter to allow one to grant access to certain columns on certain rows.
-
createLfTag.postOperationCreates an LF-tag with the specified name and values.
-
deleteDataCellsFilter.postOperationDeletes a data cell filter.
-
deleteLfTag.postOperationDeletes the specified LF-tag given a key name. If the input parameter tag key was not found, then the operation will throw an exception. When you delete an LF-tag, the
LFTagPolicyattached to the LF-tag becomes invalid. If the deleted LF-tag was still assigned to any resource, the tag policy attach to the deleted LF-tag will no longer be applied to the resource. -
deleteObjectsOnCancel.postOperationFor a specific governed table, provides a list of Amazon S3 objects that will be written during the current transaction and that can be automatically deleted if the transaction is canceled. Without this call, no Amazon S3 objects are automatically deleted when a transaction cancels.
The Glue ETL library function
write_dynamic_frame.from_catalog()includes an option to automatically callDeleteObjectsOnCancelbefore writes. For more information, see . -
deregisterResource.postOperationDeregisters the resource as managed by the Data Catalog.
When you deregister a path, Lake Formation removes the path from the inline policy attached to your service-linked role.
-
describeResource.postOperationRetrieves the current data access role for the given resource registered in Lake Formation.
-
describeTransaction.postOperationReturns the details of a single transaction.
-
extendTransaction.postOperationIndicates to the service that the specified transaction is still active and should not be treated as idle and aborted.
Write transactions that remain idle for a long period are automatically aborted unless explicitly extended.
-
getDataCellsFilter.postOperationReturns a data cells filter.
-
getDataLakeSettings.postOperationRetrieves the list of the data lake administrators of a Lake Formation-managed data lake.
-
getEffectivePermissionsForPath.postOperationReturns the Lake Formation permissions for a specified table or database resource located at a path in Amazon S3.
GetEffectivePermissionsForPathwill not return databases and tables if the catalog is encrypted. -
getLfTag.postOperationReturns an LF-tag definition.
-
getQueryState.postOperationReturns the state of a query previously submitted. Clients are expected to poll
GetQueryStateto monitor the current state of the planning before retrieving the work units. A query state is only visible to the principal that made the initial call toStartQueryPlanning. -
getQueryStatistics.postOperationRetrieves statistics on the planning and execution of a query.
-
getResourceLfTags.postOperationReturns the LF-tags applied to a resource.
-
getTableObjects.postOperationReturns the set of Amazon S3 objects that make up the specified governed table. A transaction ID or timestamp can be specified for time-travel queries.
-
getTemporaryGluePartitionCredentials.postOperationThis API is identical to
GetTemporaryTableCredentialsexcept that this is used when the target Data Catalog resource is of type Partition. Lake Formation restricts the permission of the vended credentials with the same scope down policy which restricts access to a single Amazon S3 prefix. -
getTemporaryGlueTableCredentials.postOperationAllows a caller in a secure environment to assume a role with permission to access Amazon S3. In order to vend such credentials, Lake Formation assumes the role associated with a registered location, for example an Amazon S3 bucket, with a scope down policy which restricts the access to a single prefix.
-
getWorkUnitResults.postOperationReturns the work units resulting from the query. Work units can be executed in any order and in parallel.
-
getWorkUnits.postOperationRetrieves the work units generated by the
StartQueryPlanningoperation. -
grantPermissions.postOperationGrants permissions to the principal to access metadata in the Data Catalog and data organized in underlying data storage such as Amazon S3.
For information about permissions, see .
-
listDataCellsFilter.postOperationLists all the data cell filters on a table.
-
listLfTags.postOperationLists LF-tags that the requester has permission to view.
-
listPermissions.postOperationReturns a list of the principal permissions on the resource, filtered by the permissions of the caller. For example, if you are granted an ALTER permission, you are able to see only the principal permissions for ALTER.
This operation returns only those permissions that have been explicitly granted.
For information about permissions, see .
-
listResources.postOperationLists the resources registered to be managed by the Data Catalog.
-
listTableStorageOptimizers.postOperationReturns the configuration of all storage optimizers associated with a specified table.
-
listTransactions.postOperationReturns metadata about transactions and their status. To prevent the response from growing indefinitely, only uncommitted transactions and those available for time-travel queries are returned.
This operation can help you identify uncommitted transactions or to get information about transactions.
-
putDataLakeSettings.postOperationSets the list of data lake administrators who have admin privileges on all resources managed by Lake Formation. For more information on admin privileges, see .
This API replaces the current list of data lake admins with the new list being passed. To add an admin, fetch the current list and add the new admin to that list and pass that list in this API.
-
registerResource.postOperationRegisters the resource as managed by the Data Catalog.
To add or update data, Lake Formation needs read/write access to the chosen Amazon S3 path. Choose a role that you know has permission to do this, or choose the AWSServiceRoleForLakeFormationDataAccess service-linked role. When you register the first Amazon S3 path, the service-linked role and a new inline policy are created on your behalf. Lake Formation adds the first path to the inline policy and attaches it to the service-linked role. When you register subsequent paths, Lake Formation adds the path to the existing policy.
The following request registers a new location and gives Lake Formation permission to use the service-linked role to access that location.
ResourceArn = arn:aws:s3:::my-bucket UseServiceLinkedRole = trueIf
UseServiceLinkedRoleis not set to true, you must provide or set theRoleArn:arn:aws:iam::12345:role/my-data-access-role -
removeLfTagsFromResource.postOperationRemoves an LF-tag from the resource. Only database, table, or tableWithColumns resource are allowed. To tag columns, use the column inclusion list in
tableWithColumnsto specify column input. -
revokePermissions.postOperationRevokes permissions to the principal to access metadata in the Data Catalog and data organized in underlying data storage such as Amazon S3.
-
searchDatabasesByLfTags.postOperationThis operation allows a search on
DATABASEresources byTagCondition. This operation is used by admins who want to grant user permissions on certainTagConditions. Before making a grant, the admin can useSearchDatabasesByTagsto find all resources where the givenTagConditionsare valid to verify whether the returned resources can be shared. -
searchTablesByLfTags.postOperationThis operation allows a search on
TABLEresources byLFTags. This will be used by admins who want to grant user permissions on certain LF-tags. Before making a grant, the admin can useSearchTablesByLFTagsto find all resources where the givenLFTags are valid to verify whether the returned resources can be shared. -
startQueryPlanning.postOperationSubmits a request to process a query statement.
This operation generates work units that can be retrieved with the
GetWorkUnitsoperation as soon as the query state is WORKUNITS_AVAILABLE or FINISHED. -
startTransaction.postOperationStarts a new transaction and returns its transaction ID. Transaction IDs are opaque objects that you can use to identify a transaction.
-
updateDataCellsFilter.postOperationUpdates a data cell filter.
-
updateLfTag.postOperationUpdates the list of possible values for the specified LF-tag key. If the LF-tag does not exist, the operation throws an EntityNotFoundException. The values in the delete key values will be deleted from list of possible values. If any value in the delete key values is attached to a resource, then API errors out with a 400 Exception - "Update not allowed". Untag the attribute before deleting the LF-tag key's value.
-
updateResource.postOperationUpdates the data access role used for vending access to the given (registered) resource in Lake Formation.
-
updateTableObjects.postOperationUpdates the manifest of Amazon S3 objects that make up the specified governed table.
-
updateTableStorageOptimizer.postOperationUpdates the configuration of the storage optimizers for a table.
-
openapi.previewSpecPreview an OpenAPI document before adding it as a source
-
openapi.addSourceAdd an OpenAPI source and register its operations as tools