Manage metalake using Apache Gravitino

This page introduces how to create, modify, view, and delete metalakes by using Gravitino.

Prerequsites

You have installed and launched Gravitino. For more details, see Get started.

Let's say, the access is http://localhost:8090.

Create a metalake

To create a metalake, you can send a POST request to the /api/metalakes endpoint or use the Gravitino Admin client.

The following is an example of creating a metalake:

Shell

curl -X POST -H "Accept: application/vnd.gravitino.v1+json" \
-H "Content-Type: application/json" -d '{"name":"metalake","comment":"This is a new metalake","properties":{}}' \
http://localhost:8090/api/metalakes

Java

GravitinoAdminClient gravitinoAdminClient = GravitinoAdminClient
    .builder("http://localhost:8090")
    .build();

GravitinoMetalake newMetalake = gravitinoAdminClient.createMetalake(
    NameIdentifier.of("metalake"),
    "This is a new metalake",
    new HashMap<>());
  // ...

Python

gravitino_admin_client: GravitinoAdminClient = GravitinoAdminClient(uri="http://localhost:8090")
gravitino_admin_client.create_metalake(name="metalake", 
                                       comment="This is a new metalake", 
                                       properties={})

Load a metalake

To load a metalake, you can send a GET request to the /api/metalakes/{metalake_name} endpoint or use the Gravitino Admin client.

The following is an example of loading a metalake:

Shell

curl -X GET -H "Accept: application/vnd.gravitino.v1+json" \
-H "Content-Type: application/json"  http://localhost:8090/api/metalakes/metalake

Java

// ...
GravitinoMetalake loaded = gravitinoAdminClient.loadMetalake(
    NameIdentifier.of("metalake"));
// ...

Python

gravitino_admin_client.load_metalake("metalake")

Alter a metalake

To alter a metalake, you can send a PUT request to the /api/metalakes/{metalake_name} endpoint or use the Gravitino Admin client.

The following is an example of renaming a metalake:

Shell

curl -X PUT -H "Accept: application/vnd.gravitino.v1+json" \
-H "Content-Type: application/json" -d '{
  "updates": [
    {
      "@type": "rename",
      "newName": "metalake_renamed"
    }
  ]
}' http://localhost:8090/api/metalakes/metalake

Java

// ...
GravitinoMetalake renamed = gravitinoAdminClient.alterMetalake(
    NameIdentifier.of("metalake"),
    MetalakeChange.rename("metalake_renamed")
);
// ...

Python

changes = (
    MetalakeChange.rename("metalake_renamed"),
)

metalake = gravitino_admin_client.alter_metalake("metalake", *changes)

The following table outlines the supported modifications that you can make to a metalake:

Supported modification	JSON	Java	Python
Rename metalake	{"@type":"rename","newName":"metalake_renamed"}	MetalakeChange.rename("metalake_renamed")	MetalakeChange.rename("metalake_renamed")
Update comment	{"@type":"updateComment","newComment":"new_comment"}	MetalakeChange.updateComment("new_comment")	MetalakeChange.update_comment("new_comment")
Set property	{"@type":"setProperty","property":"key1","value":"value1"}	MetalakeChange.setProperty("key1", "value1")	MetalakeChange.set_property("key1", "value1")
Remove property	{"@type":"removeProperty","property":"key1"}	MetalakeChange.removeProperty("key1")	MetalakeChange.remove_property("key1")

Enable a metalake

Metalake has a reserved property - in-use, which indicates whether the metalake is available for use. By default, the in-use property is set to true. To enable a disabled metalake, you can send a PATCH request to the /api/metalakes/{metalake_name} endpoint or use the Gravitino Admin client.

The following is an example of enabling a metalake:

Shell

curl -X PATCH -H "Accept: application/vnd.gravitino.v1+json" \
-H "Content-Type: application/json" -d '{"inUse": true}' \
http://localhost:8090/api/metalakes/metalake

Java

GravitinoAdminClient gravitinoAdminClient = GravitinoAdminClient
    .builder("http://localhost:8090")
    .build();

gravitinoAdminClient.enableMetalake("metalake");
  // ...

Python

gravitino_admin_client: GravitinoAdminClient = GravitinoAdminClient(uri="http://localhost:8090")
gravitino_admin_client.enable_metalake("metalake")

info

This operation does nothing if the metalake is already enabled.

Disable a metalake

Once a metalake is disabled:

• Users can only list, load, drop, or enable it.
• Any other operation on the metalake or its sub-entities will result in an error.

To disable a metalake, you can send a PATCH request to the /api/metalakes/{metalake_name} endpoint or use the Gravitino Admin client.

The following is an example of disabling a metalake:

Shell

curl -X PATCH -H "Accept: application/vnd.gravitino.v1+json" \
-H "Content-Type: application/json" -d '{"inUse": false}' \
http://localhost:8090/api/metalakes/metalake

Java

GravitinoAdminClient gravitinoAdminClient = GravitinoAdminClient
    .builder("http://localhost:8090")
    .build();

gravitinoAdminClient.disableMetalake("metalake");
  // ...

Python

gravitino_admin_client: GravitinoAdminClient = GravitinoAdminClient(uri="http://localhost:8090")
gravitino_admin_client.disable_metalake("metalake")

info

This operation does nothing if the metalake is already disabled.

Drop a metalake

Deleting a metalake by "force" is not a default behavior, so please make sure:

• There are no catalogs under the metalake. Otherwise, you will get an error.
• The metalake is disabled. Otherwise, you will get an error.

Deleting a metalake by "force" will:

• Delete all sub-entities (tags, catalogs, schemas, etc.) under the metalake.
• Delete the metalake itself even if it is enabled.
• Not delete the external resources (such as database, table, etc.) associated with sub-entities unless they are managed (such as managed fileset).

To drop a metalake, you can send a DELETE request to the /api/metalakes/{metalake_name} endpoint or use the Gravitino Admin client.

The following is an example of dropping a metalake:

Shell

curl -X DELETE -H "Accept: application/vnd.gravitino.v1+json" \
-H "Content-Type: application/json" http://localhost:8090/api/metalakes/metalake?force=false

Java

// ...
// force can be true or false
boolean success = gravitinoAdminClient.dropMetalake("metalake", false);
// ...

Python

gravitino_admin_client.drop_metalake("metalake", force=True)

List all metalakes

To view all your metalakes, you can send a GET request to the /api/metalakes endpoint or use the Gravitino Admin client.

The following is an example of listing all metalakes:

Shell

curl -X GET -H "Accept: application/vnd.gravitino.v1+json" \
-H "Content-Type: application/json"  http://localhost:8090/api/metalakes

Java

// ...
GravitinoMetalake[] allMetalakes = gravitinoAdminClient.listMetalakes();
// ...

Python

metalake_list: List[GravitinoMetalake] = gravitino_admin_client.list_metalakes()