# Grasping state estimation of printable soft gripper using electro-conductive yarn

- Takahiro Matsuno
^{1}Email authorView ORCID ID profile, - Zhongkui Wang†
^{1}and - Shinichi Hirai†
^{1}

**Received: **4 September 2017

**Accepted: **31 October 2017

**Published: **9 November 2017

## Abstract

Automatic handling of many types of food materials are required to realize the automation of production of commercially prepared box lunches. A printable soft gripper was developed for food handling which is simple to produce with a 3D printer. However, the sensing ability of the printable soft gripper was not discussed in previous research. In this paper, a novel method for estimating the grasping state of a printable soft gripper using electro-conductive yarn is presented. Electro-conductive yarn is a conductive material, and the resistance of strings is changed by stretching. It is less expensive than other sensors that can be used for measurement of grasping state. Additionally, it is easy to assemble and disassemble by hand. Electro-conductive yarn is applied to a prototype printable soft gripper, and the proposed estimation method is verified experimentally. From the experimental results, the estimated grasping state from the resistance of the electro-conductive yarn coincides with the actual grasping state of the gripper. Our proposed method of using electro-conductive yarn was successful for estimating the grasping state of a printable soft gripper.

## Keywords

## Background

Currently, several millions commercially prepared box lunches per day are consumed in Japan [1]. Therefore, automation of the production of the box lunches is required. To produce box lunches, the handling of food using a robot hand must be realized [2, 3]. Hence, a printable soft gripper was developed for food handling which can grasp foods that are soft and easily deformed [4]. It is possible to use a 3D printer to easily produce the soft gripper. For handling of food materials, the estimation of grasping state is necessary. However, the sensing ability of the printable soft gripper to sensing is not discussed sufficiently in previous research [5, 6]. Bending of the printable soft gripper was successfully measured using a strain gage [7]. However, when using strain gages for measuring the bending of the printable soft gripper, the finger size of the gripper is limited by strain gage’s size and the production cost of gripper increases. There are some previous research about pressure sensing, deformation sensing and load sensing for the soft gripper or soft robotics. However, there is no discussion about sensor cost, size and estimation of grasping state [8–10].

In this research, we propose a novel method to estimate the grasping state of the printable soft gripper using electro-conductive yarn. Electro-conductive yarn is a very low cost conductive material, and the resistance of the strings is changed by stretching [11, 12]. Additionally, the sensor size can be determined by users.

In this paper, a concept regarding the estimation of grasping state using electro-conductive yarn is proposed. Then, the calibration method is presented. Finally, the proposed estimation method is applied to prototype printable soft gripper, and estimation result is verified by experiment.

## Estimation method for grasping state of a printable soft gripper

### Concept of a printable soft gripper using electro-conductive yarn

### Approximated model of the printable soft gripper for estimation

*x*,

*y*) is calculated by:

*n*-th link, the length of the offset link and the angle of the

*n*-th joint, respectively. For the case of a printable soft gripper, air pressure is applied to individual chambers uniformly. Therefore, each angle bends equally, if there are no other forces applied to the finger. In this paper,

*n*-th joint angle \(\theta _n\) is assumed as:

*x*,

*y*) is calculated by:

*R*and \(\theta = f(R)\) show the resistance of the electro-conductive yarn and the function of the relationship between the resistance of the electro-conductive yarn and the joint angle, respectively. The gripper has three fingers as shown in Fig. 4. The tip position of finger 2 \((x', y', z')\) and finger 3 \((x'', y'', z'')\) are calculated by:

### Estimation of approximate diameter of the grasping object

*D*is defined as shown in Fig. 5. The vector of fingertip position of finger 1 to center of grasping object \(\vec {a}\) is calculated as:

*u*and

*v*are decided by the following two equations:

*u*and

*v*which fulfill Eqs. (15)–(16). The diameter of grasping object

*D*is then calculated as:

*D*fulfills Eq. (18), the gripper is opened and it is ready to grasp. When the approximate diameter

*D*fulfill Eq. (19), the gripper succeeded to grasp the object. If the approximate diameter

*D*fulfills Eq. (20), there are no grasping object. It means that the gripper failed to grasp the object. Using these methods, grasping states of the gripper are estimated.

### Measuring method for resistance of the electro-conductive yarn

*R*is measured in 10 Hz using the circuit which shown in Fig. 6. The output voltage \(V_{\mathrm {out}}\) is measured by an AD converter; then, the resistance of the electro-conductive yarn is calculated as:

## Calibration method for estimation setup

### Calibration method

*m*-th order polynomial function:

*S*trials with different pressure values applied to the printable soft gripper; then, the resistance of the electro-conductive yarn at

*s*-time experiment \(R_s\) and the tip position of the finger at

*s*-time experiment \((x_s,y_s)\) are measured for each trial. The tip position of the finger from the resistance is estimated by:

*s*-th time experiment. The coefficients of the polynomial \(k_m\) are determined by minimizing the least squares of error about \((x_s,y_s)\) and \((x_{\mathrm{{es}}},y_{\mathrm{{es}}})\) as:

### Selection of polynomial’s order

In this subsection, the order of the polynomial function for Eq. (22) is selected. If the order of polynomial function is high, Eq. (22) shows a high degree of accuracy, while the time required to estimate the tip position will be longer. Therefore, the order of Eq. (22) should be select a low value. In this study, the tip position of the finger is estimated using several different polynomial orders. Then, the error of the estimated values, necessary time for calibration and necessary time for estimation of grasping state are compared.

The finger of the printable soft gripper using electro-conductive yarn, shown in Fig. 8, was used for the verification of the polynomial order. The electro-conductive yarn is connected to the AD converter of the MCU (STM32F401 Nucleo-64, ST microelectronics, Switzerland) based on the circuit shown in Fig. 6. The resistances of the electro-conductive yarn are calculated by Eq. (21).

First, the resistances of the electro-conductive yarn and the tip positions of finger are measured for calibration. In this study, each data point is measured seven times. The measured tip positions of finger are shown in Fig. 8 as blue dots, and the resistances of the electro-conductive yarn in each trial are shown by *R* in Fig. 8. Then, the order values of 1 through 5 are calculated to estimate the tip position. The estimated positions with each polynomial function are shown by the other dots in Fig. 8. Additionally, the average error of the estimated values is shown in Fig. 9. The trajectory of the fingertip is shown in bar line in Fig. 8. The trajectory of fingertip is not affected by the value of polynomial’s order because of the model shown in Eq. (3). The necessary time for calibration is shown in Fig. 10, and the necessary time for estimation of grasping state is shown in Fig. 11. To measure the necessary time for calibration, stopwatch timer function of MATLAB® is used. The resistances of the electro-conductive yarn for calibration are used for measuring necessary time for estimation of grasping state, and each resistance of electro-conductive yarn is assumed to equal value. The estimation is repeated seven times using resistances of the electro-conductive yarn for calibration, and total time for estimation is measured. In this measurement, time for communication is ignored.

## Experimental verification

In this section, the electro-conductive yarn is applied to the prototype printable soft gripper. Then, our proposed estimation method is experimentally verified. The prototype of the printable soft gripper using electro-conductive yarn is shown in Fig. 12. The base and fingers of the gripper are printed by a 3D printer (Objet350 Connex3, Stratasys, USA) which can print soft material. The gripper has three fingers, and each finger is fixed to the base at even intervals.

Each finger has electro-conductive yarn, and each resistance is measured by the AD converter of MCU. Additionally, these values are sent to PC where the functions of the relationship between the resistance of each electro-conductive yarn and joint angle are calibrated according to the method discussed in the previous section. The PC estimates the tip position of fingers using Eqs. (4)–(5); then, the estimated shape of fingers and tip position are displayed as Fig. 12. The estimated grasping state and the value of estimated diameter of grasping object are displayed, too. In this research, threshold values for estimation grasping state \(D_{\mathrm {grasp}}\) and \(D_{\mathrm {failed}}\) are defined as 70 and 30. The measuring sampling time of the resistance is 0.5 s, and approximated diameter of grasping object and tip position of fingers are uploaded in 0.5 s.

The first experiment verified about the case of succeeded grasping. In this experiment, the cylinder (diameter 53 mm) is used as the target object. The experiment result is shown in Fig. 13. The blue line, red dot line and gray dash-dotted line show the measured resistance values of the electro-conductive yarn. The yellow two-dot chain line shows estimated diameter of grasping object. The estimated diameter is less than 70 mm and larger than 30 mm after 21 s. Therefore, result of estimated grasping state showed that the gripper was grasping the object. It was succeeded to estimate actual grasping state of the gripper.

The second experiment verified about the case of failed grasping. In this experiment, the gripper closes without any object. The experiment result is shown in Fig. 14. The blue line, red dot line and gray dash-dotted line show the measured resistance values of the electro-conductive yarn. The yellow two-dot chain line shows estimated diameter of grasping object. The estimated diameter is less than 30 mm after 11 s. Therefore, result of estimated grasping state showed that the gripper failed to grasp the object. It was succeeded to estimate actual grasping state of the gripper.

The final experiment verified about the case of grasping food material. In this experiment, a bread sample as shown in Fig. 15 is used. It is made by soft material of which stiffness is as almost same as real one’s stiffness. In this experiment, the gripper grasps the object at first trial; then, the gripper closed without any object. The experiment result is shown in Fig. 16. The blue line, red dot line and gray dash-dotted line show the measured resistance values of the electro-conductive yarn. The yellow two-dot chain line shows estimated diameter of grasping object. The estimated diameter is less than 70 mm and larger than 30 mm between 31 and 42 s. Therefore, result of estimated grasping state showed that the gripper was grasping the object. After that, the estimated diameter is less than 30 mm between 53 and 61 s. Therefore, result of estimated grasping state showed that the gripper failed to grasp the object. It was succeeded to estimate actual grasping state of the gripper.

## Conclusion

In this paper, a novel method was presented for estimating the grasping state of a printable soft gripper using electro-conductive yarn. Electro-conductive yarn is a conductive material. The resistance of the electro-conductive yarn is changed by stretching the strings. This characteristic is used for estimating the fingertip positions of the printable soft gripper. It is less expensive than other sensors for measuring bending motion. Additionally, it is simple to apply and disassemble a finger. Electro-conductive yarn is applied to top surface of a printable soft gripper. When a printable soft gripper is utilized for grasping, the electro-conductive yarn extends. Then, the resistance of the electro-conductive yarn changes. In our proposed estimation method, the grasping state of the printable soft gripper is estimated from this resistance. The calibration method for the estimation setup is also proposed. Several types of polynomial functions are verified experimentally. Then, the estimation results are compared against the average error. From the comparison results, a linear equation is selected for the proposed calibration method. Finally, the electro-conductive yarn is applied to the prototype of a printable soft gripper, and our proposed estimation method is experimentally verified. From results of the experiment, the estimated grasping states from resistance values of the electro-conductive yarn were validated by the actual conditions of the gripper. Consequently, the proposed method using the electro-conductive yarn was successful for estimating the grasping state of the printable soft gripper. In this study, the estimation time is not optimized and the hysteresis effect is not solved. We will solve these problems, and the estimation speed will be increased in the next step of this research.

## Notes

## Declarations

### Authors' contributions

TM proposed the method and drafted the manuscript. ZW and SH supervised the study. All authors read and approved the final manuscript.

### Competing interests

The authors declare that they have no competing interests.

### Funding

This work was partially supported by MEXT Kakenhi 2686040, JSPS, Japan.

### Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

**Open Access**This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

## Authors’ Affiliations

## References

- Iwamasa H, Hirai S. Binding of food materials with a tension-sensitive elastic thread. In: Proceedings of IEEE international conference on robotics and automation, May 2015. Washington, 2015; pp. 4298–303.Google Scholar
- Li Y, Lee M. Applying vision guidance in robotic food handling. IEEE Robot Autom Mag. 1996;3(1):4–12.View ArticleGoogle Scholar
- Endo G, Otomo N. Development of a food handling gripper considering an appetizing presentation. In: Proceedings of IEEE international conference on robotics and automation, May 2016. Stockholm, 2016; pp. 4298–303.Google Scholar
- Wang Z, Chathuranga D, Hirai S. 3D printed soft gripper for automatic lunch box packing. In: Proceedings of IEEE international conference on robotics and biomimetics, Dec. 2016. Qingdao, 2016; pp. 503–8.Google Scholar
- Wang Z, Hirai S. Soft gripper dynamics using a line-segment model with an optimization-based parameter identification method. IEEE Robot Autom Lett. 2017;2(2):624–31.View ArticleGoogle Scholar
- Wang Z, Torigoe Y, Hirai S. A prestressed soft gripper: design, modeling, fabrication, and tests for food handling. IEEE Robot Autom Lett. 2017;2(4):1909–16.View ArticleGoogle Scholar
- Wang Z, Hirai S. A 3D printed soft gripper integrated with curvature sensor for studying soft grasping. In: Proceedings of IEEE/SICE international symposium on system integration, Dec. 2016. Sapporo, 2016; pp. 13–5.Google Scholar
- Takigami T, Oshima K, Hayakawa Y, Ito M. Application of self-sensing actuator to control of a soft-handling gripper. In: Proceedings of IEEE international conference on control applications, Sept. 1998. Trieste, 1998; pp. 902–6.Google Scholar
- Jin H, Wang W, Phone M, Nitish VT, Sunil LK, Hong L, Chen H. Hybrid tele-manipulation system using a sensorized 3-D-printed soft robotic gripper and a soft fabric-based haptic glove. IEEE Robot Autom Lett. 2017;2(2):880–7.View ArticleGoogle Scholar
- Hayakawa Y, Kawamura S. Sensing actuators using a pneumatic bellows system and its application to a soft gripper. In: Proceedings IEEE international conference on robotics and automation, May 1993. Atlanta, 1993; pp. 398–403.Google Scholar
- Ho V, Hirai S. Measuring McKibben actuator shrinkage using fiber sensor. In: Proceedings of the IEEE international symposium on robot and human interactive communication, Aug. 2015. Kobe, 2015; pp. 628–33.Google Scholar
- Wurdemann H, Sareh S, Shafti A, Noh Y, Faragasso A, Chathuranga D, Liu H, Hirai S, Althoefer K. Embedded electro-conductive yarn for shape sensing of soft robotic manipulators. In: Proceedings of annual international conference of the IEEE engineering in medicine and biology society, Aug. 2015. Milan, 2015; pp. 8026–9.Google Scholar