Interactive actuation of multiple opto-thermocapillary flow-addressed bubble microrobots
© Hu et al.; licensee Springer. 2014
Received: 4 July 2014
Accepted: 29 September 2014
Published: 23 October 2014
Opto-thermocapillary flow-addressed bubble (OFB) microrobots are a potential tool for the efficient transportation of micro-objects. This microrobot system uses light patterns to generate thermal gradients within a liquid medium, creating thermocapillary forces that actuate the bubble microrobots. An interactive control system that includes scanning mirrors and a touchscreen interface was developed to address up to ten OFB microrobots. Using this system, the parallel and cooperative transportation of 20-μm-diameter polystyrene beads was demonstrated.
KeywordsMicrorobot Bubble Thermocapillary flow Parallel actuation Interactive control
Microrobots, nontethered microstructures that can physically manipulate objects, are flexible tools for micro-transportation. Various types of microrobots have successfully transported objects such as microbeads -, microgels , and single cells ,.
Microrobotic transportation has two advantages when compared to tools such as optical tweezers, optically induced dielectrophoresis (ODEP), and micromanipulators. First, microrobotic transportation does not rely on the optical properties or chemistry of the target objects and the surrounding medium. In contrast, optical tweezers require a refractive index difference between the objects and medium . The medium properties can also play a role in ODEP manipulation, as the electrical conductivity of the medium can affect the electric field gradients that create the dielectrophoretic force . Secondly, although the most widely used micromanipulators can achieve high velocities during manipulation, their throughput is still limited , as this is a serial form of manipulation. Parallel operation of multiple micromanipulators is limited by the working space, due to the macroscale components of the micromanipulators. In contrast, the parallel transportation of microrobots has been demonstrated ,-.
One method for achieving parallel microrobot actuation used frequency-selective microrobots that have mechanical responses at different resonant frequencies . Time-division-multiplexed control signals were sent to two magnetic microrobots to achieve simultaneous, independent locomotion. Other frequency-based addressing methods were applied to three magnetic stick–slip microrobots, independently addressed in parallel , and to helical microrobots to enable different swimming velocities . Other methods of controlling multiple magnetic microrobots include having differing magnetization strengths  or temporarily disabling the magnetization of the microrobots . Electrostatic actuation was another method used, where slight variations in microrobot dimensions enabled independent addressing ,.
However, to simultaneously actuate more microrobots independently by magnetic force or electrostatic force, more complicated control and fabrication methods will be necessary. It is difficult to generate localized magnetic fields at the microscale, so each microrobot has to be fabricated slightly differently in order to be addressed independently using the methods mentioned above.
It is straightforward to create multiple localized optical patterns by using optical elements such as micromirrors , spatial light modulators , or scanning mirrors . Optical tweezers and OET take advantage of this capability to manipulate multiple targets at the same time ,. This feature of optically addressed systems is also inherent in the opto-thermocapillary flow-addressed bubble (OFB) microrobot system ,. However, unlike ODEP and optical tweezers, the OFB microrobots are gas bubbles in a liquid medium. The actuation of the OFB microrobots is less dependent on the material property and does not require direct laser or electrical field penetration through target objects, limiting the potential for damage to the objects under manipulation.
OFB microrobots have transported microbeads , cell-laden hydrogels ,, and single cells ,. Although possible, the parallel and independent addressing of more than five OFB microrobots has not been demonstrated. In this paper, multiple OFB microrobots were addressed by an interactive control system with a scanning mirror. Up to ten OFB microrobots are addressed and configured. In addition, four OFB microrobots were used to simultaneously pattern microbeads in hydrogel prepolymer. Microbeads were also handled by four OFB microrobots to demonstrate its cooperative working ability.
The OFB microrobot actuation takes place on an absorbing substrate. The absorbing layer on the substrate is made of a layer of indium tin oxide (ITO) that is 100 nm in thickness, topped with a layer of 1-μm-thick amorphous silicon (α-Si). This absorbing layer is able to convert light energy into heat. The ITO layer also serves as an adhesion layer for the α-Si.
The centerpiece of the scanning mirror control system is a custom script that uses the MATLAB Image Acquisition Toolbox to determine the positions of the light patterns on the second computer monitor. The x and y positions of the light patterns are recorded using units of pixels, which are converted to analog voltages by the MATLAB script. Subsequently, the script uses the MATLAB Data Acquisition Toolbox to queue the analog voltages into a data acquisition unit (DAQ; National Instruments USB-3653, National Instruments Corporation, Austin, TX, USA). The DAQ outputs the voltages to the control circuits of the scanning mirror system, thereby controlling the position of the mirrors. Thus, the scanning mirrors are adjusted to the correct angles to redirect the laser to the corresponding position on the substrate.
The scanning mirror finishes scanning through all the points of the light patterns in 0.05 s per cycle of the control script, independent of how many points there are in the cycle. Bubbles can be generated immediately in the liquid medium by the laser illumination, and longer illumination durations lead to larger bubble sizes . To control the bubble size, the heat generation at each location can be further controlled by pulsing the laser at various frequencies and duty cycles. This is controlled by a TTL signal provided by a function generator (Agilent 33220A, Agilent Technologies, Santa Clara, CA, USA). In the experiments presented here, the laser pulse frequency was 400 Hz, and the laser pulse width was 100 μs. This resulted in bubbles with diameters ranging from 7 to 10 μm, with an average diameter of 8 μm. The bubbles do not collapse during the experiments, as the laser pulse rate is rapid enough to maintain the bubble. However, if the laser is switched off, the bubble will collapse within 2 s due to the Laplace pressure. Under these actuation conditions, the OFB microrobots can move up to 500 μm/s.
The current control system requires two computers, one running the Processing program for the pattern generation subsystem and one running the MATLAB script for the scanning mirror control subsystem, as well as an extra monitor. It is currently nontrivial to create MATLAB scripts that will support touchscreen input, so this hardware workaround was implemented to take advantage of the image processing of MATLAB and the multi-touch library of Processing. This control system can be easily replicated by any research group in the microrobotic or micromanipulation research areas.
3Results and discussion
3.1 Control of multiple OFB microrobots
3.2 Transportation by multiple OFB microrobots
An interactive control system for the OFB microrobot was demonstrated by performing parallel and cooperative assembly of microbeads. This system has the potential to be scaled up even further, increasing the throughput and utility of the OFB microrobotic system.
Although the interactive control system performed well in the experiments described here, the system can be further simplified. The need for the webcam and extra monitor can be eliminated by directly outputting a signal with the light pattern location information from the pattern generation computer to the scanning mirror control computer. A single computer can also accomplish the functionality of the two computers in the current setup, if the MATLAB script is configured to accept input from the touchscreen of its host computer. Moreover, the live camera view of the OFB workspace can also be displayed directly on the touchscreen to make it easier for the operator to co-locate the target objects and the microrobots, similar to the control systems in ,.
It can be approximated that increasing the number of microrobots will linearly reduce the completion time of microassembly tasks until a saturation point is reached. Beyond this saturation point, the microrobot density will limit the amount of parallel micromanipulation that can occur. The maximum number of 10-μm-diameter OFB microrobots that theoretically can be generated in the field of view used here (600 μm by 450 μm) is 2,700 microrobots. However, the current system does not approach that limit, so the linear relationship can be used to estimate the impact on task completion time.
The maximum number of microrobots is limited in the current control system by the ability of the human operator to track multiple objects. In these experiments, a maximum of ten microrobots can be controlled by a single operator. In order to scale this system to control a much larger number of microrobots in parallel, automated controls have to be developed. An automated control system can build upon algorithms developed for path planning and macroscale robotic swarm research . In addition to increasing the throughput of microassembly tasks, multiple microrobots can enable certain manipulation tasks, such as studying temporal dynamics of micro-object interactions. In this case, it may be necessary to have several objects moving at various velocities and trajectories relative to one another, which can be achieved by using multiple microrobots.
The micro-object used in the experiments above is a 20-μm polystyrene bead, which is near in size to many biological micro-objects, such as cells. Thus, the results here are expected to be transferrable to these biological micro-objects. As one example, patterning of single mammalian cells into different patterns can benefit research in tissue engineering . When manipulating biological materials, temperature is a concern, as objects such as cells can die at temperatures above the physiological temperature of 37°C. In this system, the maximum temperature is localized to the very center of the laser spot and quickly decreases to a temperature that is safe for cells: the temperature is less than 30.5°C at a distance of 3.5 μm from the center of the laser spot . As the bubble radii in these experiments are approximately 5 μm, this ensures that cells are manipulated at a safe temperature.
This project was supported in part by grant number 1R01EB016458 from the National Institute of Biomedical Imaging and Bioengineering of the National Institutes of Health (NIH) as part of the NSF/NASA/NIH/USDA National Robotics Initiative. These contents are solely the responsibility of the authors and do not necessarily represent the official views of the NIH.
- Frutiger DR, Vollmers K, Kratochvil BE, Nelson BJ: Small, fast, and under control: wireless resonant magnetic micro-agents. Int J Rob Res 2009, 29: 613–636. 10.1177/0278364909353351View ArticleGoogle Scholar
- Tottori S, Zhang L, Qiu F, Krawczyk KK, Franco-Obregón A, Nelson BJ: Magnetic helical micromachines: fabrication, controlled swimming, and cargo transport. Adv Mater 2012, 24: 811–816. 10.1002/adma.201103818View ArticleGoogle Scholar
- Floyd S, Pawashe C, Sitti M: Two-dimensional contact and noncontact micromanipulation in liquid using an untethered mobile magnetic microrobot. IEEE Trans Robot 2009, 25: 1332–1342. 10.1109/TRO.2009.2028761View ArticleGoogle Scholar
- Steager EB, Sakar MS, Magee C, Kennedy M, Cowley A, Kumar V: Automated biomanipulation of single cells using magnetic microrobots. Int J Rob Res 2013, 32: 346–359. 10.1177/0278364912472381View ArticleGoogle Scholar
- Sakar MS, Steager EB, Kim DH, Kim MJ, Pappas GJ, Kumar V: Single cell manipulation using ferromagnetic composite microtransporters. Appl Phys Lett 2010, 96: 043705. 10.1063/1.3293457View ArticleGoogle Scholar
- Ashkin A, Dziedzic JM, Bjorkholm JE, Chu S: Observation of a single-beam gradient force optical trap for dielectric particles. Opt Lett 1986, 11: 288–290. 10.1364/OL.11.000288View ArticleGoogle Scholar
- Valley JK, Jamshidi A, Ohta AT, Hsu HY, Wu MC: Operational regimes and physics present in optoelectronic tweezers. J Microelectromechanical Syst 2008, 17: 342–350. 10.1109/JMEMS.2008.916335View ArticleGoogle Scholar
- Savia M, Koivo HN: Contact micromanipulation—survey of strategies. IEEE/ASME Trans Mechatronics 2009, 14: 504–514. 10.1109/TMECH.2008.2011986View ArticleGoogle Scholar
- Diller E, Floyd S, Pawashe C, Sitti M: Control of multiple heterogeneous magnetic micro-robots on non-specialized surfaces. IEEE international conference on robotics and automation 2011, 115–120.Google Scholar
- Diller E, Floyd S, Pawashe C, Sitti M: Control of multiple heterogeneous magnetic microrobots in two dimensions on nonspecialized surfaces. IEEE Trans Robot 2012, 28: 172–182. 10.1109/TRO.2011.2170330View ArticleGoogle Scholar
- Mahoney AW, Nelson ND, Peyer KE, Nelson BJ, Abbott JJ: Behavior of rotating magnetic microrobots above the step-out frequency with application to control of multi-microrobot systems. Appl Phys Lett 2014, 104: 144101. 10.1063/1.4870768View ArticleGoogle Scholar
- Diller E, Giltinan J, Sitti M: Independent control of multiple magnetic microrobots in three dimensions. Int J Rob Res 2013, 32: 614–631. 10.1177/0278364913483183View ArticleGoogle Scholar
- Diller E, Zhang N, Sitti M: Modular micro-robotic assembly through magnetic actuation and thermal bonding. J Micro-Bio Robot 2013, 8: 121–131. 10.1007/s12213-013-0071-7View ArticleGoogle Scholar
- Donald BR, Levey CG, Paprotny I: Planar microassembly by parallel actuation of MEMS microrobots. J Microelectromechanical Syst 2008, 17: 789–808. 10.1109/JMEMS.2008.924251View ArticleGoogle Scholar
- Paprotny I, Levey C, Donald BR: Turning-rate selective control: a new method for independent control of stress-engineered MEMS microrobots. Proceedings of robotics: science and systems conference 2012.Google Scholar
- Chiou PY, Ohta AT, Wu MC: Massively parallel manipulation of single cells and microparticles using optical images. Nature 2005, 436: 370–372. 10.1038/nature03831View ArticleGoogle Scholar
- Grier DG: A revolution in optical manipulation. Nature 2003, 424: 810–816. 10.1038/nature01935View ArticleGoogle Scholar
- Mio C, Gong T, Terray A, Marr DWM: Design of a scanning laser optical trap for multiparticle manipulation. Rev Sci Instrum 2000, 71: 2196. 10.1063/1.1150605View ArticleGoogle Scholar
- Hu W, Ishii KS, Ohta AT: Micro-assembly using optically controlled bubble microrobots. Appl Phys Lett 2011, 99: 094103. 10.1063/1.3631662View ArticleGoogle Scholar
- Hu W, Ishii KS, Ohta AT: Micro-assembly using optically controlled bubble microrobots in saline solution. IEEE international conference on robotics and automation 2012, 733–738.Google Scholar
- Hu W, Fan Q, Ohta AT: An opto-thermocapillary cell micromanipulator. Lab Chip 2013, 13: 2285–2291. 10.1039/c3lc50389eView ArticleGoogle Scholar
- Hu W, Ishii KS, Fan Q, Ohta AT: Hydrogel microrobots actuated by optically generated vapour bubbles. Lab Chip 2012, 12: 3821–3826. 10.1039/c2lc40483dView ArticleGoogle Scholar
- Processing.org http://processing.org/. Accessed: 16 Sep 2011
- Albrecht DR, Underhill GH, Mendelson A, Bhatia SN: Multiphase electropatterning of cells and biomaterials. Lab Chip 2007, 7: 702–709. 10.1039/b701306jView ArticleGoogle Scholar
- Zorlutuna P, Annabi N, Camci-Unal G, Nikkhah M, Cha JM, Nichol JW, Manbachi A, Bae H, Chen S, Khademhosseini A: Microfabricated biomaterials for engineering 3D tissues. Adv Mater 2012, 24: 1782–1804. 10.1002/adma.201104631View ArticleGoogle Scholar
- Onda K, Arai F: Parallel teleoperation of holographic optical tweezers using multi-touch user interface. IEEE international conference on robotics and automation 2012, 1069–1074.Google Scholar
- Bowman RW, Gibson G, Carberry D, Picco L, Miles M, Padgett MJ: iTweezers: optical micromanipulation controlled by an Apple iPad. J Opt 2011, 13: 044002. 10.1088/2040-8978/13/4/044002View ArticleGoogle Scholar
- Pimenta LCA, Michael N, Mesquita RC, Pereira GAS, Kumar V: Control of swarms based on hydrodynamic models. IEEE international conference on robotics and automation 2008, 1948–1953.Google Scholar
- Albrecht DR, Underhill GH, Wassermann TB, Sah RL, Bhatia SN: Probing the role of multicellular organization in three-dimensional microenvironments. Nat Methods 2006, 3: 369–375. 10.1038/nmeth873View ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited.