Despite substantial efforts to develop digital biomarkers, benchmarking and validating these algorithms remains difficult. Open, crowd-sourced efforts through DREAM Challenges is one approach to speed the process.