Tool Support for deep learning Experiments

Dear participant,

We are a group of researchers from Sweden, Netherlands, and Germany and kindly invite you to our survey on “Machine Learning Experiment Management Tools.” Such tools support practitioners performing machine learning (ML) or deep learning (DL) experiments, systematically managing all involved artifacts (scripts, datasets, hyperparameters, models, …). As a machine learning practitioner, we kindly invite you to participate. We also invite you to forward this invitation to other colleagues who might be interested in this survey as well.

Our survey elicits information on the management tools practitioners adopt, their perceived benefits, challenges, and limitations. Consequently, you will be asked to complete an online questionnaire based on your experience with ML experiments and/or specialised management tools. Since we are also interested in experiences of managing ML projects without dedicated tool support, it’s not necessary that you have actually used such a tool yourself in order to participate.

  • How long will it take?

[10] mins

  • What’s in it for you?

Report and reflection: As a participant, you can receive a report with the outcome of this study. Such a report can help increase your awareness of tooling trends and how they can be valuable for your own practices in developing ML projects.

  • What’s in it for us?

We will use the collected and anonymized data in the context of a research project to understand the landscape of ML experiment management tools.

Kindly find the survey questionnaire here →

Thanks in advance,

Carl Vågfelt Nihlmar (Chalmers|University of Gothenburg)

Samuel Idowu (Chalmers|University of Gothenburg)

Daniel Struber (Chalmers|University of Gothenburg, Radboud University Nijmegen, Netherlands)

Thorsten Berger (Chalmers|University of Gothenburg, Ruhr University Bochum, Germany)