AI & ML Practical Magic

A $15 microcontroller can now be trained to recognize objects using nothing but a standard web browser.

April 29, 2026

Original Paper

WebSerial Vision Training for Microcontrollers: A Browser-Based Companion to On-Device CNN Training

arXiv · 2604.22834

The Takeaway

Training vision models usually requires powerful GPUs and complex software setups. This new browser-based tool allows users to train and deploy neural networks directly onto cheap hardware without installing anything. All the data stays local, meaning the process is private and works on any computer with a serial port. This makes high-quality vision AI accessible to hobbyists and small-scale manufacturers for a low cost. It democratizes the development of smart devices by removing the need for expensive cloud infrastructure.

From the abstract

This paper presents webmcu-vision-web, a single-file, zero-install browser application for end-to-end TinyML vision model training and deployment on the Seeed Studio XIAO ESP32-S3 Sense (XIAO ML Kit, $15--40 USD). Acting as a browser-based companion to the on-device Arduino firmware of Paper 1 [1], it provides a private, fully local machine learning pipeline, from firmware flashing through image collection, CNN training, weight export, and live activation visualization, without any software inst