ICEBERG_META

Description

iceberg_meta table-valued-function(tvf), Use for read iceberg metadata, operation history, snapshots of table, file metadata etc.

Syntax

ICEBERG_META(
    "table" = "<table>", 
    "query_type" = "<query_type>"
  );

Required Parameters

Each parameter in the iceberg_meta table function (tvf) is a "key"="value" pair.

Field	Description
<table>	The full table name, which must be specified in the format of database_name.table_name for the Iceberg table that you want to view.
<query_type>	The type of metadata you want to view. Currently, only snapshots is supported.

Examples

• Read and access the iceberg tabular metadata for snapshots.

  select * from iceberg_meta("table" = "ctl.db.tbl", "query_type" = "snapshots");

• Can be used with desc function :

  desc function iceberg_meta("table" = "ctl.db.tbl", "query_type" = "snapshots");

• Inspect the iceberg table snapshots :

  select * from iceberg_meta("table" = "iceberg_ctl.test_db.test_tbl", "query_type" = "snapshots");

  +------------------------+----------------+---------------+-----------+-------------------+------------------------------+
  |      committed_at      |  snapshot_id   |   parent_id   | operation |   manifest_list   |            summary           |
  +------------------------+----------------+---------------+-----------+-------------------+------------------------------+
  |  2022-09-20 11:14:29   |  64123452344   |       -1      |  append   | hdfs:/path/to/m1  | {"flink.job-id":"xxm1", ...} |
  |  2022-09-21 10:36:35   |  98865735822   |  64123452344  | overwrite | hdfs:/path/to/m2  | {"flink.job-id":"xxm2", ...} |
  |  2022-09-21 21:44:11   |  51232845315   |  98865735822  | overwrite | hdfs:/path/to/m3  | {"flink.job-id":"xxm3", ...} |
  +------------------------+----------------+---------------+-----------+-------------------+------------------------------+

• Filtered by snapshot_id :

  select * from iceberg_meta("table" = "iceberg_ctl.test_db.test_tbl", "query_type" = "snapshots") where snapshot_id = 98865735822;

  +------------------------+----------------+---------------+-----------+-------------------+------------------------------+
  |      committed_at      |  snapshot_id   |   parent_id   | operation |   manifest_list   |            summary           |
  +------------------------+----------------+---------------+-----------+-------------------+------------------------------+
  |  2022-09-21 10:36:35   |  98865735822   |  64123452344  | overwrite | hdfs:/path/to/m2  | {"flink.job-id":"xxm2", ...} |
  +------------------------+----------------+---------------+-----------+-------------------+------------------------------+