Spaces:
Runtime error
Runtime error
title: ccc | |
tags: | |
- evaluate | |
- metric | |
description: "Concordance correlation coefficient" | |
sdk: gradio | |
sdk_version: 3.19.1 | |
app_file: app.py | |
pinned: false | |
# Metric Card for CCC | |
## Metric Description | |
The concordance correlation coefficient measures the agreement between two sets of | |
values. It is often used as a measure of inter-rater agreement when ratings have | |
continuous values. | |
## How to Use | |
The inputs are two sequences of floating point values. For example: | |
```python | |
ccc_metric = evaluate.load("agkphysics/ccc") | |
results = ccc_metric.compute(references=[0.2, 0.1], predictions=[0.1, 0.2]) | |
``` | |
### Inputs | |
- **predictions** (list of float): model predictions | |
- **references** (list of float): reference labels | |
### Output Values | |
- `ccc`: the concordance correlation coefficient. This is a value between -1 (perfect | |
anti-agreement) and 1 (perfect agreement), with 0 indicating no agreement. | |
### Examples | |
```python | |
>>> ccc_metric = evaluate.load("agkphysics/ccc") | |
>>> results = ccc_metric.compute(references=[0.2, 0.1], predictions=[0.1, 0.2]) | |
>>> print(results) | |
{'ccc': -1.0} | |
>>> results = ccc_metric.compute(references=[0.1, 0.2], predictions=[0.1, 0.2]) | |
>>> print(results) | |
{'ccc': 1.0} | |
>>> results = ccc_metric.compute(references=[0.1, 0.3], predictions=[0.1, 0.2]) | |
>>> print(results) | |
{'ccc': 0.666666641831399} | |
``` | |
## Limitations and Bias | |
*Note any known limitations or biases that the metric has, with links and references if possible.* | |
## Citation | |
```bibtex | |
@article{linConcordanceCorrelationCoefficient1989, | |
title = {A {{Concordance Correlation Coefficient}} to {{Evaluate Reproducibility}}}, | |
author = {Lin, Lawrence I-Kuei}, | |
year = {1989}, | |
journal = {Biometrics}, | |
volume = {45}, | |
number = {1}, | |
pages = {255--268}, | |
publisher = {{International Biometric Society}}, | |
issn = {0006-341X}, | |
url = {https://www.jstor.org/stable/2532051}, | |
doi = {10.2307/2532051} | |
} | |
``` | |
## Further References | |
Wikipedia: https://en.wikipedia.org/wiki/Concordance_correlation_coefficient | |