Studies

We are looking for domain experts in a variety of fields, such as natural language processing, computational biology, and computer vision, who are currently developing or analyzing embedding spaces in their work. If you participate, you will be given an embedding analysis tool and asked to think aloud as you investigate data specific to your domain of expertise. You are encouraged, but not required, to prepare your own dataset(s) to visualize during the study. The study session will last 1-2 hours, after which you may opt to use the tool independently and return within 7-10 days for a follow-up interview. Participants will be paid $20 per hour spent in sessions with the investigators. Participants must be at least 18 years old. If you are interested in participating, please fill out this form, or email the researchers with any questions.

This study is no longer recruiting. During September 2021, we are conducting a follow-up study that you can read more about here.

We’re interviewing data scientists who work with AI to understand the challenges they face when developing and evaluating their models. We’re especially interested in how data scientists analyze their models beyond aggregate metrics like accuracy.