Humans in the Loop is a social enterprise which provides human workforce and manual input for dataset collection and annotation, as well as model validation.
We provide fully annotated datasets and managed annotation teams to computer vision teams in the retail, automotive, health, satellite, manufacturing, and other industries.
The datasets that we supply are curated in order to be free from gender, cultural, and geographical biases and our annotators are trained in order to recognize and report issues with data diversity or representation.
We set up human-in-the-loop pipelines in which our workers are able to monitor edge cases where model certainty is low as well as to detect cases where the model performs with inaccuracies. We are also able to conduct dataset audits and collect and annotate additional data so as to mitigate existing biases.
Company Type: Startup
Research: Tools & News