Apache Gravitino Lineage support

Overview

Lineage information is critical for metadata systems, Gravitino supports data lineage by leveraging OpenLineage. Gravitino provides a specific Spark jar to collect lineage information with Gravitino identifier, please refer to Gravitino Spark lineage page. Additional, Gravitino server provides lineage process framework to receive, process and sink Open lineage events to other systems.

Capabilities

• Supports column lineages.
• Supports lineage across diverse Gravitino catalogs like fileset, Iceberg, Hudi, Paimon, Hive, Model, etc.
• Supports Spark.