Tables

Here is the list of tables available in the system catalog.

system.cluster.workers

The table containing information about cluster workers.

Columns

• session_idSTRING NOT NULL

  The identifier for the session associated with the worker.

• worker_idUNSIGNED LONG NOT NULL

  The unique identifier for the worker.

• hostSTRING

  The hostname or IP address of the worker, if the worker is running.

• portUNSIGNED SHORT

  The port number the worker is listening on, if the worker is running.

• statusSTRING NOT NULL

  The current status of the worker.

• created_atTIMESTAMP_LTZ(6) NOT NULL

  The timestamp when the worker was created. This is the time when the worker is defined in the driver.

• stopped_atTIMESTAMP_LTZ(6)

  The timestamp when the worker was stopped.

system.execution.jobs

The table containing job information.

Columns

• session_idSTRING NOT NULL

  The identifier for the session associated with the job.

• job_idUNSIGNED LONG NOT NULL

  The unique identifier for the job.

• statusSTRING NOT NULL

  The current status of the job.

• created_atTIMESTAMP_LTZ(6) NOT NULL

  The timestamp when the job was created.

• stopped_atTIMESTAMP_LTZ(6)

  The timestamp when the job completed execution.

system.execution.stages

The table containing job stage information.

Columns

• session_idSTRING NOT NULL

  The identifier for the session associated with the stage.

• job_idUNSIGNED LONG NOT NULL

  The identifier for the job associated with the stage.

• stageUNSIGNED LONG NOT NULL

  The index for the stage.

• partitionsUNSIGNED LONG NOT NULL

  The number of partitions for the stage.

• inputsARRAY<STRUCT<stage: UNSIGNED LONG NOT NULL, mode: STRING NOT NULL>> NOT NULL

  The input stages for the stage.

• groupSTRING NOT NULL

  The slot sharing group for the stage.

• modeSTRING NOT NULL

  The output mode for the stage.

• distributionSTRING NOT NULL

  The output distribution for the stage.

• placementSTRING NOT NULL

  The task placement for the stage.

• statusSTRING NOT NULL

  The current status of the stage.

• created_atTIMESTAMP_LTZ(6) NOT NULL

  The timestamp when the stage was created.

• stopped_atTIMESTAMP_LTZ(6)

  The timestamp when the stage completed execution.

system.execution.tasks

The table containing task attempt information.

Columns

• session_idSTRING NOT NULL

  The identifier for the session associated with the task.

• job_idUNSIGNED LONG NOT NULL

  The identifier for the job associated with the task.

• stageUNSIGNED LONG NOT NULL

  The index for the stage associated with the task.

• partitionUNSIGNED LONG NOT NULL

  The partition index for the task.

• attemptUNSIGNED LONG NOT NULL

  The attempt number for the task.

• statusSTRING NOT NULL

  The current status of the task.

• created_atTIMESTAMP_LTZ(6) NOT NULL

  The timestamp when the task was created.

• stopped_atTIMESTAMP_LTZ(6)

  The timestamp when the task stopped execution.

system.session.sessions

The table containing user session information.

Columns

• session_idSTRING NOT NULL

  The unique identifier for the session.

• user_idSTRING NOT NULL

  The identifier for the user associated with the session. This can be an arbitrary string that identifies the user, or empty if the user is not known.

• statusSTRING NOT NULL

  The current status of the session.

• created_atTIMESTAMP_LTZ(6) NOT NULL

  The timestamp when the session was created.

• deleted_atTIMESTAMP_LTZ(6)

  The timestamp when the session was deleted.