MLTK01
MLTK01 is a toolkit for prototyping tangible learning things. It allows to cut out hardware prototyping time and focus on the design of interactions with tangible prototypes with machine learning abilities, giving space to explorations of unconventional data sources and to the creative craft of behaviors.
The toolkit is developed combining hardware and software from two existing open source tools: Arduino and ml5js, an easy-to-use tool that enable to play and customize a library of machine learning algorithms examples. The two are combined into a dedicated PCB that, extending the capabilities of an Arduino Nano, functions also as tangible interface and allows to easily plug, setup, train and play machine learning sketches. The aim is to allow designers to easily develop projects integrating ML abilities, moving the focus of the design activities from technical implementation issue to interaction qualities. In particular, we aim at facilitating critical reflections and provocations on how, why and with what consequences we may train ML models embodied into tangible artefacts.
Above: the prototyping process with MLTK01.
MLTK01 allows to eliminate the need for developing a communication protocol and writing a custom firmware for the hardware used. Removing this process generates benefits for the user as it saves time, but foremost is a crucial benefit not only because saves time, but foremost because it lowers the barrier for designers with low technical expertise to engage with ML explorations.
-
Lupetti, M.L., Romagnoli, L. (2022). MLTK01: A Prototyping Toolkit for Tangible Learning Things. In: Bruyns, G., Wei, H. (eds) [ ] With Design: Reinventing Design Modes. IASDR 2021. Springer, Singapore. https://doi.org/10.1007/978-981-19-4472-7_57