summarize

Summarize instance segmentation performance metrics at data set and class level

Since R2024b

Syntax

[summaryDataset,summaryClass] = summarize(metrics)

[summaryDataset,summaryClass] = summarize(metrics,MetricName=metricName)

Description

[summaryDataset,summaryClass] = summarize(metrics) summarizes the object detection evaluation metrics across all classes of the data set summaryDataset, and for each class in the data set summaryClass.

[summaryDataset,summaryClass] = summarize(metrics,MetricName=metricName) specifies the metrics category to return in the metrics summary.

Input Arguments

metrics — Instance segmentation performance metrics

instanceSegmentationMetrics object

instance segmentation performance metrics, specified as an instanceSegmentationMetrics object.

metricName — Metrics category to return

"all" (default) | "AP" | "LAMR""AOS"

Metrics category to return in the metrics summary, specified as one of these options.

• "all" – Returns the average precision and mean average precision metric values, aggregated over each overlap threshold, along with all additional metrics.

• "AP" – Returns only the average precision across all classes at each overlap threshold as a numThresh-by-1 numeric vector, and the mean average precision (mAP) computed across all overlap thresholds. numThresh is the number of overlap thresholds specified by the OverlapThreshold property of the instanceSegmentationMetrics object.

• "LAMR" – Returns only the log-average miss rate (LAMR) computed at each overlap threshold as a numThresh-by-1 numeric vector, and the mean of the log-average miss rate (mLAMR) computed across all overlap thresholds.

• "AOS" – Returns only the average orientation similarity (AOS) computed at each overlap threshold as a numThresh-by-1 array, and the mean of the average orientation similarity (mAOS) computed across all overlap thresholds.

  To specify "AOS" as the metric to return, your input data must contain rotated bounding boxes.

• "AOS" – Return only the average orientation similarity (AOS) computed at each overlap threshold as a numThresh-by-1 array, and the mean of the average orientation (mAOS) similarity computed across all overlap thresholds as a numeric scalar.

  To specify "AOS" as the metric to return, your input data must contain rotated bounding boxes.

Output Arguments

summaryDataset — Metrics summary over data set

table

Metric summary over the data set, returned as a 1-by-numMetrics table, where numMetrics is the number of specified metrics.

The columns of the table depend on the value of the metricName argument.

• "all" —

  NumObjects	mAPOverlapAvg	mAP	mLAMROverlapAvg	mLAMR	mAOSOverlapAvg	mAOS
  Number of object instances in the ground truth data, returned as a positive integer.	Mean average precision (mAP) averaged over all thresholds specified by the OverlapThreshold property of metrics, returned as a numeric scalar.	Mean average precision (mAP), or average precision averaged over all classes, computed at all overlap thresholds specified by the OverlapThreshold property of metrics, returned as a numThresh-by-1 numeric vector. numThresh is the number of overlap thresholds.	Mean log-average miss rate (mLAMR) averaged over all classes and all overlap thresholds specified by the OverlapThreshold property of metrics, returned as a numeric scalar.	Mean log-average miss rate (mLAMR) averaged over all classes, computed at all overlap thresholds, specified by the OverlapThreshold property of metrics, returned as a numThresh-by-1 numeric vector.	Mean average orientation similarity (mAOS) averaged over all classes, and averaged over all overlap thresholds specified by the OverlapThreshold property of metrics, returned as a numeric scalar.	Mean average orientation similarity (mAOS) averaged over all classes, computed at all overlap thresholds specified by the OverlapThreshold property of metrics, returned as a numThresh-by-1 numeric vector.

  To return the "mAOSOverlapAvg" and "mAOS" columns, your input data must contain rotated bounding boxes.

• "AP" —

  NumObjects	mAPOverlapAvg	mAP
  Number of object instances in the ground truth data, returned as a positive integer.	Mean average precision (mAP) averaged over all thresholds specified by the OverlapThreshold property of metrics, returned as a numeric scalar.	Mean average precision (mAP), or average precision averaged over all classes, computed at all overlap thresholds specified by the OverlapThreshold property of metrics, returned as a numThresh-by-1 numeric vector. numThresh is the number of overlap thresholds.

• "LAMR" —

  mLAMROverlapAvg	mLAMR
  Mean log-average miss rate (mLAMR) averaged over all classes and all overlap thresholds specified by the OverlapThreshold property of metrics, returned as a positive scalar.	Mean log-average miss rate (mLAMR) averaged over all classes, computed at all overlap thresholds, specified by the OverlapThreshold property of metrics, returned as a numThresh-by-1 numeric vector.

• "AOS" —

  mAOSOverlapAvg	mAOS
  Mean average orientation similarity (mAOS) averaged over all classes and all overlap thresholds specified by the OverlapThreshold property of metrics, returned as a numeric scalar.	Mean average orientation similarity (mAOS) averaged over all classes, computed at all overlap thresholds specified by the OverlapThreshold property of metrics, returned as a numThresh-by-1 numeric vector.

summaryClass — Metrics summary per class

table

Metrics summary per class, returned as a numClasses-by-numMetrics table, where numClasses is the number of classes, and numMetrics is the number of specified metrics.

The columns of the table depend on the value of the metricName argument.

• "all" —

  NumObjects	APOverlapAvg	AP	LAMROverlapAvg	LAMR	AOSOverlapAvg	AOS
  Number of object instances in the ground truth data for each class, returned as a positive integer.	Average precision (AP) for each class averaged over all thresholds specified by the OverlapThreshold property of metrics, returned as a numeric scalar.	Average precision (AP) for each class, computed at all overlap thresholds specified by the OverlapThreshold property of metrics, returned as a numThresh-by-1 numeric vector. numThresh is the number of overlap thresholds.	Log-average miss rate (LAMR) for each class, averaged over all overlap thresholds specified by the OverlapThreshold property of metrics.	Log-average miss rate (LAMR) for each class, computed at all overlap thresholds specified by the OverlapThreshold property of metrics, returned as a numThresh-by-1 numeric vector.	Average orientation similarity (AOS) for each class, averaged over all overlap thresholds specified by the OverlapThreshold property of metrics, returned as a numeric scalar.	Average orientation similarity (AOS) for each class, computed at all overlap thresholds specified by the OverlapThreshold property of metrics, returned as a numThresh-by-1 numeric vector.

  To return the "AOSOverlapAvg" and "AOS" columns, your input data must contain rotated bounding boxes.

• "AP" —

  NumObjects	APOverlapAvg	AP
  Number of object instances in the ground truth data for each class, returned as a positive integer.	Average precision (AP) for each class averaged over all thresholds specified by the OverlapThreshold property of metrics, returned as a numeric scalar.	Average precision (AP) for each class, computed at all overlap thresholds specified by the OverlapThreshold property of metrics, returned as a numThresh-by-1 numeric vector. numThresh is the number of overlap thresholds.

• "LAMR" —

  LAMROverlapAvg	LAMR
  Log-average miss rate (LAMR) for each class, averaged over all overlap thresholds specified by the OverlapThreshold property of metrics.	Log-average miss rate (LAMR) for each class, computed at all overlap thresholds specified by the OverlapThreshold property of metrics, returned as a numThresh-by-1 numeric vector.

• "AOS" —

  AOSOverlapAvg	AOS
  Average orientation similarity (AOS) for each class, averaged over all overlap thresholds specified by the OverlapThreshold property of metrics, returned as a numeric scalar.	Average orientation similarity (AOS) for each class, computed at all overlap thresholds specified by the OverlapThreshold property of metrics, returned as a numThresh-by-1 numeric vector.

Version History

Introduced in R2024b