Quality Match GmbH

Better datasets create better machine learning models, enabling better products.Quality Match verifies and improves the quality of datasets for computer vision and machine learning. This can be applied - dataset architecture (are my dataset and taxonomy good.) - measure the quality of annotation providers (is the quality as advertised.) - evaluate model performance (when does the model fail.) - supervise model-drift (is the model still working.) and many more use cases. We focus on creating actionable, quantitative metrics on dataset quality, such - representativeness (bias analysis) - accuracy (labels, detection rates and geometric properties of annotations) - and ambiguity (edge cases due to bad data or bad taxonomies). We do this by breaking down quality questions into a large decision tree where each node is either a training-free, unambiguous crowd-sourcing task which is repeated until statistical significance, or a pretrained machine learning model with known confusion matrix. ...