This version is still in development and is not considered stable yet. For the latest stable version, please use Korvet 0.12.5!

Delta Storage Metrics

These metrics are emitted by korvet-storage-delta.

Storage metrics are only available when remote storage is configured with korvet.storage.remote.path.
Metric Description Tags

korvet.storage.archive.batch.time

Time to process a batch (read + write + commit)

stream, phase

korvet.storage.archive.messages.archived

Number of messages archived to Delta Lake

stream

korvet.storage.archive.messages.read

Number of archived messages read from Delta Lake

stream, operation

korvet.storage.archive.file.batch.size

Messages written per archived file batch

stream

korvet.storage.archive.file.count

File count produced per archival append

stream

korvet.storage.parquet.write.time

Time to write Parquet file

stream

korvet.storage.parquet.bytes.written

Total bytes written to Parquet files

stream

korvet.storage.parquet.file.size

Parquet file size in bytes (distribution summary)

stream

korvet.storage.delta.commit.time

Time to commit to Delta Lake transaction log

stream

korvet.storage.delta.commits

Number of Delta Lake commits

stream

korvet.storage.delta.read.time

Delta read latency

stream, operation, result

korvet.storage.delta.read.failures

Delta read failures

stream, operation, error_type

korvet.storage.delta.write.failures

Delta write failures

stream, operation, error_type