|
For the latest stable version, please use Korvet 0.19! |
Storage Metrics
These metrics are emitted by every Korvet storage tier under the
korvet.storage.* namespace. Each verb (read, write, ack)
is recorded once per call and tagged with tier=local|remote, so the same
dashboard query works across the local Redis tier and the remote
Iceberg tier. The read timer additionally carries mode=stream|group to
distinguish standalone reads from consumer-group reads.
Cross-Tier Verbs
Ack
Storage acknowledgement latency.
Name: korvet.storage.ack
Type: timer
Base unit: seconds
Key |
Description |
|
Operation outcome (e.g. |
|
Storage tier ( |
Archive
Remote segment archive latency for offload attempts from local Redis segments to the remote tier.
Name: korvet.storage.archive
Type: timer
Base unit: seconds
Key |
Description |
|
Operation outcome (e.g. |
|
Storage tier ( |
Archive Bytes
Remote bytes archived successfully.
Name: korvet.storage.archive.bytes
Type: counter
Base unit: bytes
Key |
Description |
|
Storage tier ( |
Archive Failures
Remote segment archive failures by exception type.
Name: korvet.storage.archive.failures
Type: counter
Key |
Description |
|
Exception class simple name, or |
|
Storage tier ( |
Archive Lag Oldest
Age of the oldest sealed remote-enabled segment waiting for archive.
Name: korvet.storage.archive.lag.oldest
Type: gauge
Base unit: seconds
Archive Lag Segments
Sealed remote-enabled segments waiting for archive.
Name: korvet.storage.archive.lag.segments
Type: gauge
Base unit: segments
Archive Segments
Remote segments archived successfully.
Name: korvet.storage.archive.segments
Type: counter
Base unit: segments
Key |
Description |
|
Storage tier ( |
Read
Storage read latency. Tagged by mode=stream|group to distinguish direct stream reads from consumer-group reads (XREADGROUP, pending claims, autoclaim).
Name: korvet.storage.read
Type: timer
Base unit: seconds
Key |
Description |
|
Read mode ( |
|
Operation outcome (e.g. |
|
Storage tier ( |
Read Messages
Messages returned per read call. Tagged by mode=stream|group.
Name: korvet.storage.read.messages
Type: distribution summary
Base unit: messages
Key |
Description |
|
Read mode ( |
|
Storage tier ( |
Local Tier (Redis)
Remote Tier (Iceberg And S3)
Remote-tier reads and writes flow through the shared cross-tier verbs above
with tier=remote. The cold tier also emits Iceberg scan/commit reports
and S3 SDK call metrics when korvet.storage.remote.metrics.enabled=true
and a Micrometer registry is available.
Commit Added Files
Number of Iceberg data files added by each cold-tier commit.
Name: iceberg.commit.added.files
Type: distribution summary
Base unit: files
Key |
Description |
|
Iceberg operation, such as |
|
Fully qualified Iceberg table name. |
Commit Added Records
Number of records added by each Iceberg cold-tier commit.
Name: iceberg.commit.added.records
Type: distribution summary
Base unit: records
Key |
Description |
|
Iceberg operation, such as |
|
Fully qualified Iceberg table name. |
Commit Attempts
Number of attempts Iceberg needed for each cold-tier commit.
Name: iceberg.commit.attempts
Type: distribution summary
Base unit: attempts
Key |
Description |
|
Iceberg operation, such as |
|
Fully qualified Iceberg table name. |
Commit Duration
Time spent committing Iceberg metadata changes for cold-tier writes and deletes.
Name: iceberg.commit.duration
Type: timer
Base unit: seconds
Key |
Description |
|
Iceberg operation, such as |
|
Fully qualified Iceberg table name. |
Commit Removed Files
Number of Iceberg data files removed by each cold-tier commit.
Name: iceberg.commit.removed.files
Type: distribution summary
Base unit: files
Key |
Description |
|
Iceberg operation, such as |
|
Fully qualified Iceberg table name. |
S3 Api Call Count
AWS SDK S3 API call count tagged by operation and error outcome.
Name: aws.s3.api.call.count
Type: counter
Key |
Description |
|
Whether the AWS SDK call ended with an error. |
|
AWS SDK operation name. |
S3 Api Call Duration
AWS SDK S3 API call duration for object-store operations issued by Iceberg.
Name: aws.s3.api.call.duration
Type: timer
Base unit: seconds
Key |
Description |
|
AWS SDK operation name. |
S3 Api Call Retry Count
AWS SDK retry count for S3 API calls issued by Iceberg.
Name: aws.s3.api.call.retry.count
Type: counter
Key |
Description |
|
AWS SDK operation name. |
S3 Http Client Acquire Duration
Time the AWS SDK S3 HTTP client spent acquiring concurrency for a request.
Name: aws.s3.http.client.acquire.duration
Type: timer
Base unit: seconds
Scan Bytes Scanned
Bytes in data files included in each Iceberg cold-tier scan result.
Name: iceberg.scan.bytes.scanned
Type: distribution summary
Base unit: bytes
Key |
Description |
|
Iceberg operation, such as |
|
Fully qualified Iceberg table name. |
Scan Files Scanned
Number of data files included in each Iceberg cold-tier scan result.
Name: iceberg.scan.files.scanned
Type: distribution summary
Base unit: files
Key |
Description |
|
Iceberg operation, such as |
|
Fully qualified Iceberg table name. |
Scan Files Skipped
Number of data files skipped by each Iceberg cold-tier scan.
Name: iceberg.scan.files.skipped
Type: distribution summary
Base unit: files
Key |
Description |
|
Iceberg operation, such as |
|
Fully qualified Iceberg table name. |
Scan Planning Duration
Time spent by Iceberg planning a scan against the cold tier.
Name: iceberg.scan.planning.duration
Type: timer
Base unit: seconds
Key |
Description |
|
Iceberg operation, such as |
|
Fully qualified Iceberg table name. |
See Storage Worker Metrics for offload and retention activity against the remote tier.