An artificial intelligence-assisted digital microfluidic system for multistate droplet control

Digital microfluidics (DMF) is a versatile technique for parallel and field-programmable control of individual droplets. Given the high level of variability in droplet manipulation, it is essential to establish self-adaptive and intelligent control methods for DMF systems that are informed by the transient state of droplets and their interactions. However, most related studies focus on droplet localization and shape recognition. In this study, we develop the AI-assisted DMF framework µDropAI for multistate droplet control on the basis of droplet morphology. The semantic segmentation model is integrated into our custom-designed DMF system to recognize the droplet states and their interactions for feedback control with a state machine. The proposed model has strong flexibility and can recognize droplets of different colors and shapes with an error rate of less than 0.63%; it enables control of droplets without user intervention. The coefficient of variation (CV) of the volumes of split droplets can be limited to 2.74%, which is lower than the CV of traditional dispensed droplets, contributing to an improvement in the precision of volume control for droplet splitting. The proposed system inspires the development of semantic-driven DMF systems that can interface with multimodal large language models (MLLMs) for fully automatic control.