- Open Access
The FES-assisted control for a lower limb rehabilitation robot: simulation and experiment
Robotics and Biomimetics volume 1, Article number: 2 (2014)
To design a control strategy for iLeg, an exoskeleton robot developed for lower limb rehabilitation aiming at investigating the feasibility of integrating functional electrical stimulation (FES) with robot-based rehabilitation training, an FES-assisted training strategy combined with impedance control, has been proposed in this paper. Through impedance control, an active compliance of the robot is established, and the patient’s voluntary effort to accomplish the training task is inspired. During the training process, the patient’s related muscles are applied with FES which provides an extra assistance to the patient. The intensity of the FES is properly chosen in order to induce a desired active torque which is proportional to the voluntary effort extracted from the electromyography signals of the related muscles using back propagation neural networks. This kind of enhancement serves as a positive feedback which reminds the patient of the correct attempt to fulfill the desired motion. FES control is conducted by a combination of neural network-based feedforward controller and a PD feedback controller. Simulation conducted using Matlab and the experiment with a spinal cord injury subject and a healthy subject have shown satisfactory results which verify the feasibility of this control strategy.
2Background and literature review
Spinal cord injury (SCI) and stroke are the two main types of central nervous system injury which usually results in motor disorder such as paralysis and hemiparesis, cognitive dysfunction, as well as psychological problems. SCI is mainly caused by various kinds of accidents, while stroke is caused by an interruption of blood flow to the brain or an obstruction within a blood vessel in supplying blood to the brain ,. Rehabilitation is one of the prime treatments for SCI and stroke patients, aiming to provoke the motor plasticity and to actuate these patients to relearn the use of their limbs. According to the rehabilitation theory, the resulting sensory feedback of the patient is associated with the cortical changes that can bring recovery of functional movement during the rehabilitation process so that the functional deficits and the risk of consequential injuries can be minimized -.
Traditional rehabilitation is labor-intensive and requires several therapists to manually help the patient to perform training, especially for lower limb rehabilitation. Therefore, it imposes an enormous economic burden to any country’s health care system . Meanwhile, there are a number of factors which have been found to contribute to faster motor recovery, all of which have not been taken full advantage of due to the lack of rehabilitation services . Modern robotics technology has offered us a more convenient and efficient opportunity to carry out rehabilitation training, known as rehabilitation robot. Rehabilitation robot is a mechatronics system which could be used to replace the physical training effort of the therapists, allowing more intensive and repetitive motions . Since research has identified the treatment intensity as a critical element for successful therapeutic outcomes, the robotic-assisted rehabilitation is likely to increase the training effect ,. What is more, various kinds of sensors installed on the robot feed back the signals of interest, such as the force signal, electromyography (EMG) signal, and heart rate. Thereby, the states of the patient during training can be monitored. By measuring the force or EMG signal, it is possible for the robot to perceive the voluntary effort of the patient and to adjust the training pattern accordingly in order to actuate the participation of the patient ,.
Several training strategies for rehabilitation robot have been presented in recent years. These control strategies can be categorized into two types. The first one is the position-based passive training which is widely used for its simplicity. However, robot based on this training strategy only moves the patient along predefined, fixed trajectories, and the guidance provided by the robot is so strong that it suppresses the voluntary motor control of the patient . Therefore, this strategy is less likely to motivate the patient. The second one is the impedance-based active training. The rehabilitation robot designed for this type executes a task by amplifying human force or supplying the human operator with an assisting force ,. Under this type of control strategy, an active compliance environment between the patient and the robot is established, while the assistant level can be adjusted by the impedance parameters. When the movement of the patient deviates from the predefined trajectory, a restoring force is generated using an appropriately designed impedance and then applied to the patient . Unlike position-based training, impedance-based training is position error-tolerated, because research has emphasized that the kinematic errors generated during movement are a fundamental neural signal that drives motor adaptation .
On of the most commonly used technology for rehabilitation is the functional electrical stimulation (FES), which uses short electrical pulses to generate FES-induced contraction of the paralyzed muscles, and the level of the contraction can be controlled by modulating the intensity of FES , and the therapeutic effect of FES in rehabilitation is known to be increased when associated with a person’s voluntary effort . For this reason, some researchers has integrated FES into robotic-based rehabilitation to improve the training efficiency ,,, in which an extra actuator besides the motor of the robot is available (considering the muscle under FES as a ‘soft motor’). Therefore, the robot-generated assistance can be partially compensated by the FES-induced contraction of the muscle resulting in an increase of the muscle activity. If the level of FES assistance is regulated by the voluntary effort of the patient, a higher degree of functional recovery can be expected ,.
iLeg is a horizontal exoskeleton robot designed for lower limb rehabilitation. To develop a control strategy for iLeg, an FES-assisted training strategy combined with impedance control is introduced in this paper, aiming to achieve two goals. The first one is to create a compliance environment to inspire the voluntary effort of the patient, and the second one is to provide assistance through FES rather than purely through robot. Active compliance is guaranteed by impedance control in order to establish a soft interaction between the patient and the robot. The velocity of the movement depends on the measured voluntary effort. Basically, if no voluntary effort is measured, the rehabilitation robot only provides minimal assistance which is just sufficient to counterbalance the weight of the limb. The FES assistance, which is proportional to the patient’s voluntary effort, is applied to the patient. This kind of enhancement serves as a positive feedback which reminds the patient of the correct attempt to fulfill the desired motion. To ensure that the active torque induced by FES follows the desired torque calculated from the voluntary effort, a combination of an inverse model-based feedforward and a PD feedback controller is implemented to compose the FES controller.
The rest of the paper is organized as follows. In the ‘Methods’ section, the rehabilitation robot is described in detail; the dynamic model of the leg-robot hybrid system is introduced and analyzed, while the model of the FES-stimulated muscle is also given. Then the control strategy of both impedance control and FES control are proposed, and the methods used for estimating muscle torques by system identification process and the method used for extracting voluntary effort by EMG signals are also described. The simulation conducted using Matlab and experimental results are depicted in the ‘Results’ section. Finally, conclusions are drawn in the last section.
3Research design and methods
4.1 Model description
4.1.1 iLeg lower limb rehabilitation robot
iLeg is a horizontal exoskeleton lower limb rehabilitation robot designed by our institute. Considering that the movement of the human lower limbs in the sagittal plane is the basic movement form, and many other lower limbs rehabilitation robots such as Locomat and MotionMaker follow this principle, iLeg is also designed with three degrees of freedom (DOF) that can realize the movement of the hip joint, the knee joint, and the ankle joint in the sagittal plane for each side. The prototype of the iLeg is showed in Figure 1.
As it can be seen in Figure 2, the electrical control system of iLeg consists of the following main modules: a host PC, a motion control subsystem, an analog signal acquisition subsystem, a safe-security subsystem, an EMG acquisition subsystem, and a functional electrical stimulator. The motion control subsystem contains motion control card, motor drivers, and DC motors for each joint of both sides. The hip joint is driven by chain after a reduction ratio of 1:120. The knee joint is driven through harmonic reducer (1:188) and a timing belt transmission. The ankle joint is driven directly through timing belt transmission. Besides, both of the thigh length and the shank length are adjustable through DC motors to ensure perfect alignment of each joint. The acquisition of the torques and the interaction force between the human leg and iLeg are carried out through analog signal acquisition subsystem. This subsystem contains torque sensors equipped at each joint and force sensor installed at the pedal. The safe-security subsystem is responsible for monitoring whether each joint are working within their safety ranges. If a joint is exceeding the safety range, the corresponding limit switch will be triggered, and the brake of this joint will be turned on to prevent secondary damage to the patient. To extract the voluntary intention of the patient, an eight-channel self-made EMG acquisition subsystem is integrated. Since EMG signal contains most of its power in the frequency range of 5 to 500 Hz, the sampling rate of each channel is set to be 2 kHz. To enhance the muscle contraction during rehabilitation training, a functional electrical stimulator is also employed in iLeg. The self-made functional electrical stimulator has eight channels and is able to apply dual-phase current pulse to the patient’s muscle. Each channel of the stimulator can be controlled independently with pulse frequency of 0 to 100 Hz, pulse width of 0 to 1,000 µs and pulse amplitude of 0 to 100 mA. All these subsystems are connected to the host PC whose main tasks are system management and algorithm processing via PCI bus and universal serial bus (USB).
4.1.2 Kinematic and dynamic of human leg and iLeg
The simplified model of human leg and iLeg is shown in Figure 3. Since the ankle joint is fix at 90° during the training process and the joints of human leg and iLeg are well aligned, the leg-robot system can be considered as two parallel two-link plants. The patient’s foot is fastened to the pedal, and the physical interaction occurs at the endpoint. Gluteus maximus and quadriceps femoris are the two muscle groups stimulated by FES to generate active torques on the hip joint and the knee joint. In Figure 3, qi is the angle of joint i; , , and li represent the mass of the robot, the mass of the leg, and the length of link i, respectively. Fr2h and Fh2r denote the interaction forces between the robot and the human leg. The forward kinematics of the system can be calculated by the following:
Accordingly, the speed of the end-point in the Cartesian coordinate is determined by the differential kinematics equation:
where is the angular velocity in the joint space, and J is the Jacobian matrix represented as follows:
Inverse kinematics of the simplified model can be derived from the forward kinematics equation and expressed as follows:
In generalized form, the dynamic model of the robot system is expressed by the following:
where and represent the viscosity and friction of the robot; τh2r represents the external torque exert by human; M(q), , and G(q) are the inertia, Coriolis/centripetal, and gravity matrixes given as
where , li represent the mass and the length of link i. Similar to the robot dynamic, the dynamic model of human leg can be described as
where Mh(q), , and Gh(q) are the inertia matrix, the Coriolis/centripetal matrix, and the gravity vector of human leg, respectively. Their expressions are similar to those in the robot dynamic, but the only difference is that the masses of each robot link in (6) is replaced by the masses of human’ thigh and shank. and τhe(q) describe the passive viscous and passive elastic characters of the lower limb, which are described in detail in . Unlike robot dynamics, the human leg can be considered as driven by redundant actuators (muscle contraction and robot assistance). The muscle contraction contributes to τm in Equation 7, while τr2h represents the assistance from the robot, which can be measured by the force sensor attached on the end effector using the following equation:
where Fr2h is the force imposed to the leg due to interaction between human and robot, and J is the Jacobian matrix. By adding Equations 7 and 5, we can obtain the dynamic model of the leg-robot hybrid system which is represented as
where , and Mh(q), and Gh(q) are the inertia matrix, the Coriolis/centripetal matrix, and the gravity vector of the hybrid system, respectively. According to Equation 9, there are two types of inputs which contribute to the input torque of the system: the one from DC motor and the one from the muscle contraction.
4.1.3 FES-stimulated skeletal muscle
During the training stage, two human muscles (gluteus maximus and quadriceps femoris) will be stimulated to produce partial torques around the hip joint and the knee joint. Therefore, a biological model is needed to depict the muscle response to FES, i.e., how the FES delivered to the relative muscle is converted into an active moment at the joint. Figure 4 shows a biological model of FES-stimulated muscle developed by Doctor Riener which is used in this study ,. The active torque produced by the FES-induced muscle contraction is described as two parts, namely, activation dynamics and contraction dynamics, while the passive torque of the muscle is described as passive elastic and passive viscous properties . Note that the original model has two inputs for activation dynamics which are stimulation pulse width and frequency; however, for the sake of simplicity, we fix the stimulation frequency for each muscle constantly at 50 Hz while regulating the intensity of FES by controlling the pulse width of the stimulation using FES controller.
The active torque of FES-induced muscle contraction is the product of contraction dynamics and activation dynamics given as
In the contraction dynamics, four parts are involved, i.e., moment arm, ma, maximum isometric force Fmax, force-length relation ffl, and force-velocity relation ffv. The product of these four parts denotes the maximum torque of the stimulated muscle at certain joint angle and angular velocity. The force-length relation is calculated using
where is the muscle length normalized with respect to the optimal muscle length opt, and ε is a shape factor. The force-velocity relation is determined by
where is the muscle velocity normalized with respect to the maximum contraction velocity vm of the muscle. The muscle length and velocity can be calculated using joint angle, angular velocity, and moment arm of the muscle described in detail in . The activation dynamics determines how the motion unit is recruited by FES in the final form of aact. Basically, the activation dynamics is composed of four segments. They are the recruitment characteristic, the Calcium dynamic, the fatigue process, and a delay of about 25 ms. The recruitment characteristic shows the relationship between the FES pulse width and the percentage of the motor unit activated by FES, and it is given as
where d is the pulse width of FES, dthr and dsat denote pulse width values corresponding to threshold and saturation. The shape of the recruitment curve is describe using c1, c2, kthr, and ksat. af is introduced to represent the frequency characteristic which is a function of the stimulation frequency in . Since the stimulation frequency is fixed at 50 Hz, here af is a constant. Calcium dynamics presents the mechanism that calcium ion released from sarcoplasmic reticulum and is expressed using the following two-order linear relation:
where TCa is the time constant, and a denotes non-fatigue muscle activation. Fitness function is introduced to depict the effect of muscle fatigue and recovery phenomenon using the following first-order relation:
where fit is the fitness of the muscle, while fit min is the minimum fitness. Time constants for fatigue and recovery are given as Tfat and Trec. Final activation aact is the product of fitness fit and non-fatigue activation a with a constant time delay Tdel. After the maximum torque of the stimulated muscle at certain joint angle and angular velocity are being scaled by the activation aact, the active torque of the stimulated muscle can be obtained.
4.2 Control strategy
The control strategy contains two main parts, namely, the impedance control and FES control. The goal of the first one is to achieve certain desired active compliance on the robot, while the goal of the second one is to generate desired FES-induced torques around the joint by regulating the FES intensity. The architecture of the control strategy is shown in Figure 5.
4.2.1 Impedance control
The aim of an impedance controller is to establish a mass-damper-spring relationship between the position and the force so that an active compliance between the robot and the leg can be achieved -. The desired impedance relationship can be expressed as follows:
where Md, Bd, Kd are positive definite matrices representing the desired inertia, damping, and stiffness of the system, respectively, and , , xd are the references for the acceleration, the velocity, and the position of the end-effector in the Cartesian space, while , and x stand for the actual acceleration, velocity and position, respectively. Fext is the external force imposed on the end effector. In the case of our rehabilitation robot, Fext means Fm in Figure 5, which is the force produced by muscle contraction, either by voluntary-controlled contraction or by FES-induced contraction. Usually, the desired impedance is chosen to be a second-order linear equation, as in mass-spring-damper system; however, in majority of the kinds of rehabilitation exercises, the speed of the robot is relatively low, so the acceleration effect can be neglected ,, resulting Equation 16 to be degenerated to the following equation:
If the manipulator follows a speed reference given by
the rehabilitation robot will behave as described by Equation 17. The speed tracking task is achieved by a PI speed controller in the joint space given as
where, KP and KI are the proportional and integral gains of the speed controller. is the reference of the angular velocity given by , where J represents the Jacobian matrix.
The impedance control strategy is conducted in a leg press exercise, in which a predefined trajectory of the endpoint (the ankle joint of the patient) is predefined. The patient is encouraged to complete a leg press motion and is also expected to maintain his ankle on the predefined trajectory during his effort. is set to be zero in this control, so basically the rehabilitation robot behaves as a gravity canceler. If there is no muscular force measured, the robot does not assist the patient to move towards the target point. xd in Equation 18 is the desired position for the endpoint on the predefined trajectory at a specific time point, and xd is moving towards the target point at a constant speed, meaning a ‘virtual moving wall’ which is pushing the patient towards the target . A waiting window for delayed assistance is also employed, embodied by adding a modification factor to the stiffness component of the impedance control described in Equation 17. The factor mod is given by a sigmoid function expressed as follows:
where dis represents the distance between the actual and desired position at a specific time point; a, b define the shape of the sigmoid function. The task is error-tolerated, but if the endpoint deviates too far from the desired position, the patient will feel harder to maintain the incorrect effort, so he has to make a proper adjustment in order to accomplish the task. From the perspective of the patient, this impedance control provides a virtual channel with the predefined trajectory in its center, in which the motion is partially constrained in the desired direction.
4.2.2 FES control
Since the patient has insufficient voluntary contraction of his muscle, FES is implemented to enhance the contraction, aiming to assist the patient to accomplish the leg press task. To be more specific, the desired FES-induced force is proportional to the decomposed voluntary force whose direction is alongside with the direction of the predefined trajectory. Because this part of the voluntary force is considered as the ‘correct’ effort for the task, the decomposed voluntary force which is vertical to the predefined path is considered as the ‘incorrect’ effort and will not be enhanced. The voluntary force Fvol can be transferred from the voluntary contraction torque τvol, which is estimated by the EMG signals of the related muscle groups. The calculation of the desired FES-induced torque τdfesis given as
where J is the Jacobian matrix, and θ represents the angle of Fvol to the predefined trajectory.
As shown in Figure 5, the FES torque control is achieved with the combination of a feedforward controller and a feedback controller. An inverse model of the stimulated muscle and a PD controller are employed and serve as the feedforward controller and the feedback controller, respectively. The advantage of using the combination of these two controllers compared with only using one of them is significant. The delay and highly nonlinear characters of muscle response to FES are easy to cause oscillation when the FES is regulated merely by the feedback controller. On the other hand, the feedforward controller is incapable of dealing with disturbance and eliminating error ,.
A three-layer neural network is introduced to capture the nonlinear relation of the inverse model. For each stimulated muscle (gluteus maximus and quadriceps femoris), a three-layer back propagation (BP) neural network is constructed whose structure is shown in Figure 6. Since the inverse model of muscle requires joint angle, joint angular velocity, and desired torque to be the input, the first layer of neural network consists of three input neurons. The neuron in the output layer calculates the pulse width of the FES with the linear function. The weight matrixes between the input layer, the hidden layer, and the output layer are adjusted using back propagation algorithm.
The PD controller which serves as the feedback controller is defined as follows:
where d is the pulse width of the FES, and KP, KD are proportional and derivative gains of the feedback controller, respectively. e represents the error between desired torque calculated in (12) and the actual torque induced by FES.
4.3 FES-induced torque estimation
In the case of applying FES to a moving limb, it is hard to measure the actual active torque τfes induced by FES directly. So an estimation of τfes should be made. The total input torque of the leg-robot hybrid system which is the right side of Equation 9 can be rewritten as
That is to say, the torque caused by muscle contraction τm is considered as a combination of two parts: the one from voluntary-controlled contraction τvol and the one from FES-induced contraction τfes. Therefore, to acquire the value of τfes, the other three items have to be obtained. τr can be measured via torque sensors, and τvol can be predicted by the EMG signal. As for τtotal, an system identification process is adopted so that the estimation of τfes can be calculated from
4.3.1 Hybrid-activated torque
The first step to obtain the FES-induced torque is to calculate the muscle torque τm which is produced by muscle contraction either it is FES-induced or voluntary-controlled, so τm is considered as hybrid-activated torque. A system identification process is introduced to make an estimation of this hybrid-activated torque. We rewrite Equation 9 as
where is the 2×8 regression matrix associated with the 8×1 dynamic parameters χ. For the identification process, no force is applied on the robot , thus, τm=0 and
is given as
and χ is defined as
where I i is the inertia moment of the i th link; ksfi and kdfi are the Coulomb and viscous friction of the i th joint.
For identification, the motion states ( of each joint) and the torques measured by sensors should be obtained during the robot running on an exciting trajectory. Samplings are carried out at the time of t1,t2…t n so that an overdetermined equation is constructed as
where W is the observation matrix defined as
Thus, the dynamic parameters χ can be estimated using least square estimation method given by
To improve the accuracy of the estimation, the exciting trajectory should be optimized for the sufficient excitation of the hybrid system. In this study, finite Fourier series (FFS) is introduced to parameterized the exciting trajectory . For each joint, the position at time t is a sum of sine waves expressed as
where ωf defines the period of the exciting trajectory; N is the number of FFS; qi 0 is the initial position of the i th joint. The optimization of the exciting trajectory is carried out by choosing the proper a li ,b li for each joint so that the condition number of the observation matrix can be minimized. The condition number of the observation matrix represents the upper bound for input/output error. It directly affects the convergence rate and noise immunity of the identification experiment . This optimization problem can be solved using genetic algorithm (GA). During the GA optimization, variables a li ,b li are the decision variables which meet the constrain that the trajectory defined by them should not exceed the workspace of the robot, and the condition number of the observation matrix is chosen as the fitness function. The optimized exciting trajectory is shown in Figure 7.
The samples used for the identification are obtained by performing the exciting trajectory with the patient involved in the pre-training stage. The subject of this study is an SCI patient who has been injured in T11 for 16 months. The exciting trajectory is performed for five times. According to the method described above, the estimation of the dynamic parameters of the leg-robot hybrid system is achieved, which are given in Table 1.
An unoptimized FFS trajectory is utilized to validate the identification results. The comparison between the measured torques and the estimated torques is shown in Figure 8. Root mean square (RMS) error of the estimation torques for both exiting trajectory and validation trajectory is given in Table 2. Both Figure 8 and Table 2 have shown satisfactory results which prove that the proposed method is capable of estimating the muscle torques of the patient.
4.3.2 Voluntary torque
The second step to obtain the FES-induced torque is to calculate the voluntary-controlled muscle torque τvol. EMG signal is a weak electrical potential generated by the muscle cells when these cells are activated , so it has the potential to reflect the level of voluntary intention and can be used to estimate the joint angle or torque -. In this study, EMG signal is also introduced to achieve joint torque estimation. As depicted in the ‘FES-stimulated skeletal muscle’ subsection, the active torque is the product of the contraction dynamics and the activation of the muscle. If the activation is induced by FES, the activation can be calculated using Equations 13, 14, and 15; if the activation is voluntary-controlled, the EMG signal can be utilized as the index of the level of activation. The nonlinear relationship of the contraction dynamics of the muscle is approximated by BP neural networks. For the hip joint and the knee joint, there are six muscle groups involved. They are gluteus maximus (GM), iliopsoas (LP), biceps femoris short head (BFs), rectus femoris (RF), rectus lateralis (RL), and vastus medialis (VM).
We construct two independent neural networks for the torque estimation of the hip joint and the knee joint. The structures of these two networks are shown in Figure 9. Each BP neural network has three layers, and the weight matrixes between the input layer, the hidden layer, and the output layer are adjusted using back propagation algorithm. Note that these EMG signals which served as the inputs of the neural networks are root mean square (RMS) EMG signals defined as
where RMS (t) is the RMS EMG signal at time t; y(i) is the i th sample of the raw EMG signal; N is the length of sliding window which contains samples of 200 ms before time t.
The torques of the hip joint and the knee joint as well as the EMG signals are acquired during the robot performing the predefined trajectory, and at the same time, the subject makes random efforts. Ten groups of samples are collected, and leave-one-out cross validation process is carried out: nine groups of the samples are used for training and the rest for validation, then the data set for training and validation are changed; this procedure is executed ten times, which means that every group will be served as validation group for one time. The overall estimation error is the average error of each times.
Figure 10 shows the EMG signals and torques of the hip joint and the knee joint acquired during the subject making random efforts. The curves of the measured torques and the estimated torques on the hip joint and the knee joint are shown in Figure 11. The average RMS error is 0.8862 Nm for the hip joint and 1.3424 Nm for the knee joint. These errors are in an acceptable range, so the voluntary-controlled torque τvol can be estimated using EMG signals and the proposed BP neural networks.
5.1 Simulation results
The above control strategy is verified using Simulink toolbox of Matlab. The link lengths and the masses are set to be l1=0.5 m, l2=0.45 m, kg, kg, kg, and kg. The parameters to construct the simulation models of gluteus maximus and quadriceps femoris are chosen according to ,. For the leg press exercise, the patient is requested to accomplish the motion following a predefined trajectory substantially, and the predefined trajectory is a linear path with the start point set as (0.5, 0.1), and target point set as (0.8, 0) in the Cartesian space coordinates. The patient is encouraged to accomplish the task within about 10 s.
The PI parameters for the speed controller described in Equation 19 are set as KP=diag(500,500) and KI=diag(100,100). The stiffness and damping parameters in Equation 18 are set as Kd=diag(60,60) and Bd=diag(30,30). is set as zero, and xd is defined as
where t represents time, and θ is the angle of the desired path to the horizontal.
To simulate the voluntary effort of the patient, random voluntary torques around the hip joint and the knee joint are implemented in the simulation, which is shown in Figure 12. In real situation, voluntary torque has to be estimated by means of the EMG signals, however, for simplicity reason, this step has been skipped. Note that the voluntary effort of the patient starts at t=1 s, and withdrawals at t=6 s.
Figure 13a shows the actual trajectory of the endpoint during the leg press exercise. The color of each point on the trajectory represents the speed of the endpoint at the very position. Hotter color indicates a relatively higher speed, and cooler color indicates a relatively lower speed. Virtual channel is also visualized in Figure 13a, with the predefined path at the center of the channel. Figure 13b is the zoom-in view of the trajectory for the first 2 s. The muscular force which is the resultant force of voluntary force and FES-induced force is presented as a black arrow, pointing to the direction of the force, with the length denoting the strength. As the endpoint deviates from the predefined path, the component of force perpendicular to the path increases. This means the patient has to apply more force to counterbalance the ‘virtual force’ which drags the endpoint back to the predefined path according to the impedance mechanism, therefore reminding the patient of the correct direction of the excise. From the patient’s perspective, it is much easier to press his leg towards the target point than towards the incorrect direction. As voluntary effort withdraws at t=6 s, the endpoint stops at (0.74, 0.02). Since the position error is modified by the mod factor in Equation 20 whose parameters are set as a=−200, b=6, the robot does not assist immediately. However, once the distance between the desired position and the actual position increases to a certain degree, the robot assists the patient to complete the task. The angular speeds of the hip joint and the knee joint are shown in Figure 14. When muscular force is applied on the robot, the robot begins to move (after t=1 s); when it is withdrawn, the speed of the robot drops to zero (after t=6 s). Followed by a waiting of about 4 s, expecting the patient to make attempt again, however, in this simulation, if the patient does not take acting, the robot begins to assist and finally ‘drag’ the leg to reach the target point. The above results prove the first goal which is to create a compliance environment to inspire the voluntary effort of the patient is achieved.
The FES control is conducted first by determining the desired torque induced by FES. The idea is to amplify the voluntary effort towards the target point. Using Equation 21, the force component of the voluntary effort parallel to the predefined trajectory is calculated, amplified, and then translated to the desired active torque for FES control in joint space. The blue arrows in Figure 13b represent the desired active force expected being induced by FES. All of them point to the same direction, the direction of the target point. This indicates that the FES assistance is not only proportional to the voluntary effort but also provided in the correct direction. The blue dash line in Figure 13a shows the trajectory of the endpoint when the same voluntary effort is made, but this time, no FES assistance is applied. The comparison of these two trajectories verifies the contribution of FES-induced torque which assists the patient during the leg press task by enhance the ‘correct part’ of the voluntary effort.
The FES control contains two parts: feedforward control and feedback control. For the training of the neural network-based inverse muscle models, samples are collected at pre-training stage, in which the muscles are applied with FES of random intensity while the robot is running in the predefined trajectory. The pulse width d of the FES uniformly distributed on the interval [ 0 500] µs. Off-line training process is conducted with 5,014 sampling, and both neural networks for gluteus maximus and quadriceps femoris converge after 250 iterations with the mean square errors below 5.47 µs for gluteus maximus and 3.98 µs for the quadriceps femoris. The effectiveness of the inverse model is shown in Figure 15. Random desired active torque (0 to 3 Nm for quadriceps femoris and −3 to 0 Nm for gluteus maximus) is input into the inverse model when the robot is running on the predefined trajectory for validation, and the outputs are used to set the intensity of the FES which is applied on the muscles. The approximation of the profiles for desired torque and active torque in both Figure 15a,b shows that the inverse model is capable of outputting the proper pulse width for FES to generate the desired torque. As described in the former FES control section, is implemented as the estimation of actual active torque, and the error between τdfes and serves as the input of feedback controller described in Equation 22 with the PD parameter set as KP=diag(3,000;3,000),KD=diag(400,400). Figure 16 shows the desired torque τdfes and the estimated active torque produced by the muscle contraction response to FES. The green line is the pulse width calculated by the FES controller, and FES whose intensity depends on this pulse width is applied on the muscle to generate the desired active torque. The profiles of the red line and the blue line indicate that the error between the desired torque and the actual active torque is in an acceptable range which proves that the FES controller is capable of inducing desired active torque so that a precise assistance through FES can be delivered to the patient.
5.2 Experiment results
The proposed control strategy is also verified by the experiment conducted on iLeg lower limb rehabilitation robot. The method described in ‘FES-induced torque estimation’ subsection is utilized to obtain voluntary torque τvol and FES-induced torque τfes. An SCI subject (male, age 65) and a healthy subject (male, age 28) are invited to participate in the experiment. The SCI patient has been injured in T11 for 16 months, and he remains with partial muscle force. The speed control of the robot is carried out by the PID controller of the motor drivers. The stiffness and damping parameters in Equation 18 are set as Kd=diag(2,500;2,500) and Bd=diag(2,000;2,000). is set as zero. Considering that the SCI subject’s motion ranges of his lower limb are limited, we decrease the length of the predefined trajectory, and set the start point to be (0.5, 0.1) and the target point to be (0.7, 0).
At the pre-training stage, the tolerance of the subject applied with FES is tested. For each stimulated muscle, the pulse width of FES is firstly fixed at 700 μ s, and the amplitude of FES is increased from 15 mA until obvious muscle contraction being observed. Then the amplitude of the FES is fixed during training, and the intensity of FES is regulated by adjusting the pulse width through FES controller. To construct the BP neural networks which serve as the FES feedfoward controller, the muscles are applied with FES of random intensity while the robot running in the predefined trajectory. The pulse width d of the FES uniformly distributed on the interval [ 150 500] µs.
The effectiveness of the inverse model is shown in Figure 17. Random desired active torques (0 to 1.5 Nm for quadriceps femoris and −3.5 to 0 Nm for gluteus maximus) are input into the inverse model when the robot is running on the predefined trajectory, and the outputs are used to set the intensities of the FES applied on the muscles. Compared to the simulation results, the muscle delay is relatively serious and the results are not so satisfactory which reflects that the FES-induced muscle contraction is unstable. However, the error is acceptable and can be eliminated by the PD feedback controller.
Figure 18 shows the curves of voluntary torques estimated by EMG signals and the angular velocities of each joint. As the voluntary torques vary, the angular velocities of each joint change accordingly, which follows the principle of impedance control. The trajectory of the endpoint is shown in Figure 19. There are four obvious efforts represented by four red sections in Figure 19a and four peaks in the curve of angular velocity in Figure 18. As the same as in Figure 13b, the FES-assisted forces and voluntary forces are drawn as several arrows in Figure 19b from which the same conclusion can be drawn: the FES assistance is not only proportional to the voluntary effort but is also provided in the correct direction. The tracking performances of the FES controller which is the combination of a feedforward controller and a PD feedback controller are represented in Figure 20. Even though the tracking is not as precise as in the simulation, these results indicate the FES controller is capable of generating desired FES-induced torque to apply assistance to the patient.
One healthy subject is also involved in this experiment. However, during the training process, no FES assist is applied on the healthy subject, only the effect of the impedance control is validated. Figures 21 and 22 are the curves of the voluntary torques and the angular velocities of each joint, the trajectory of the endpoint, respectively. Besides the similar conclusion that we can obtain from Figures 18 and 19, we can also notice that the voluntary efforts are smoother compared with the effort made by the SCI subject, resulting a smooth trajectory of the endpoint.
The end-point trajectories of several trials for both the SCI subject and the healthy subject are drawn in Figure 23. The end-point trajectories of the healthy subject are much smoother than the end-point trajectories of the SCI subject, reflecting that the SCI subject’s controlling ability of his lower limb is insufficient.
Figure 24 represents the time consumption for 20 leg press trials. As we can see from Figure 24, due to lack of muscle strength, the average time consumption of the SCI subject is more than that of the healthy subject. We also notice that as the trial number increases, the time consumption decreases. This phenomenon indicates that through repetitive training, both subjects gradually adjust the patten of making effort so that the performance of the leg press exercise is improved.
In this paper, an FES-assisted training strategy combined with impedance control for the lower limb rehabilitation robot is presented and the controller used to accomplish this task is developed, aiming to achieve two goals. The first one is to create a compliance environment to inspire the voluntary effort of the patient, and the second one is to provide assistance through FES rather than purely through robot. Impedance control is ideal for establishing active compliance of the robot, and through the mechanism of impedance control, the patient has to make effort to accomplish the task rather than passively waiting the assistance from the robot so that it increases the participation of the patient’s voluntary effort. Two muscle groups are stimulated with FES to provide extra assistance to the patient during the training process. The intensity of the FES is properly chosen so as to induce the desired active torque which is proportional to the voluntary effort of the patient. The control of active torque of FES-stimulated muscle is achieved using the combination of a neural network-based feedforward controller and a PD feedback controller which have been proven to be competent for this task. The dynamic parameters of the leg-robot hybrid system are estimated using system identification method; the voluntary torques are also estimated according to the EMG signals acquired from the related muscle groups. These two methods are utilized to obtain the actual FES-induced torque so that the FES control can be accomplished. Both simulation conducted in Matlab and experiments conducted in iLeg reveal satisfactory results, from which the feasibility and effectiveness of the proposed control strategy are verified. In the future, more SCI and stroke subjects will be recruited to carry out a 3 to 6-month training session. During this follow up study, we will evaluate whether the proposed control strategy is capable of improving the rehabilitation effects.
biceps femoris long head
biceps femoris short head
degrees of freedom
functional electrical stimulation
root mean square
Marino R, Barros T, Biering-Sorensen F, Burns S, Donovan W: International standards for neurological classification of spinal cord injury. J Spinal Cord Med 2003, 26: 50–56.
Sims NR, Muyderman H: Mitochondria, oxidative metabolism and cell death in stroke. Biochim Biophys Acta - Molecular Basis of Disease 2010, 1802(1):80–91. 10.1016/j.bbadis.2009.09.003
Freeman C, Tong D, Meadmore K, Hughes AM, Rogers E, Burrideg J (2012) FES based rehabilitation of the upper limb using input output linearization and ILC. In: Proceedings of the 2012 American Control Conference, 4825–4830. [http://ieeexplore.ieee.org/Xplore/home.jsp].
Lo HS, Xie SQ: Exoskeleton robots for upper-limb rehabilitation: state of the art and future prospects. Med Eng Phys 2012, 34: 261–268. 10.1016/j.medengphy.2011.10.004
Diaz I, Gil JJ, Sanchez E: Lower-limb robotic rehabilitation: literature review and challenges. J Robot 2011, 2011: 1–10. 10.1155/2011/759764
Crespo LM, Reinkensmeyer DJ: Review of control strategies for robotic movement training after neurologic injury. J Neuroeng Rehabil 2009, 6: 20. 10.1186/1743-0003-6-20
Jung S, Hsia T: Robust neural force control scheme under uncertainties in robot dynamics and unknown environment. IEEE Trans Ind Electron 2000, 47(2):403–412. 10.1109/41.836356
Barreca S, Wolf S, Fasoli S, Bohannon R: Treatment interventions for the paretic upper limb of stroke survivors: a critical review. Neurorehabil Neural Repair 2003, 17(4):220–226. 10.1177/0888439003259415
Kwakkel G, Kollen BJ, Wagenaar RC: Therapy impact on functional recovery in stroke rehabilitation: a critical review of the literature. Physiotherapy 1999, 85(7):377–391. 10.1016/S0031-9406(05)67198-2
Fiering-Sorensen F, Andersen OT, Hansen SD: Functional neuromuscular stimulation controlled by surface electromyographic signals produced by volitional activation of the same muscle: adaptive removal of the muscle response from the recorded EMG-signal. IEEE Trans Rehabil Eng 1997, 5(2):195–206. 10.1109/86.593293
Giuffrida JP, Crago PE: Reciprocal EMG control of elbow extension by FES. IEEE Trans Neural Syst Rehabil Eng 2001, 9(4):338–345. 10.1109/7333.1000113
Duschau-Wicke A, von Zitzewitz J, Caprez A, Lunenburger L, Riener R: Path control: a method for patient-cooperative robot-aided gait rehabilitation. IEEE Trans Neural Syst Rehabil Eng 2010, 18: 38–48. 10.1109/TNSRE.2009.2033061
Kosuge K, Fujisawa Y, Fukuda T (1993) Mechanical system control with man-machine-environment interactions. In: Proceedings of the 1993 IEEE international conference on robotics and automation, 239–244. ., [http://ieeexplore.ieee.org/Xplore/home.jsp].
Tsumugiwa T, Yokogawa R, Hara K (2002) Variable impedance control based on estimation of human arm stiffness for human-robot cooperative calligraphic task. In: Proceedings of the IEEE international conference on robotics and automation, 644–650 [http://ieeexplore.ieee.org/Xplore/home.jsp].
Emken JL, Reinkensemeyer DJ: Robot-enhanced motor leaning: accelerating internal model formation during locomotion by transient dynamic amplification. IEEE Trans Neural Syst Rehabil Eng 2005, 13: 33–39. 10.1109/TNSRE.2004.843173
Lynch CL, Popovic MR: A comparison of closed-loop control algorithms for regulating electrically stimulated knee movements in individual with spinal cord injury. IEEE Trans Neural Syst Rehabil Eng 2012, 20(4):539–548. 10.1109/TNSRE.2012.2185065
Kroon JR, IJzerman MJ, Chae J, Lankhorst GJ, Zilvold G: Relation between stimulation characteristics and clinical outcome in studies using electrical stimulation to improve motor control of the upper extremity in stroke. J Rehabil Med 2005, 37: 65–74. 10.1080/16501970410024190
Metrailler P, Brodard R, Clavel R, Frischknecht R: Closed loop electrical muscle stimulation in spinal cord injured rehabilitation. Mediterr J Phys Rehabil Med 2006, 42(4):72–83.
Freeman CT, Hughes AM, Burridge JH, Chappell PH, Lewin PL, Rogers E: A robotic workstation for stroke rehabilitation of the upper extremity using FES. Med Eng Phys 2009, 31: 364–373. 10.1016/j.medengphy.2008.05.008
Rushton DN: Functional electrical stimulation and rehabilitation - an hypothesis. Med Eng Phys 2003, 25: 75–78. 10.1016/S1350-4533(02)00040-1
Riener R, Edrich T: Identification of passive elastic joint moments in the lower extremities. J Biomech 1999, 32: 539–544. 10.1016/S0021-9290(99)00009-3
Riener R, Fuhr T: Patient-driven control of FES-supported standing up: a simulation study. IEEE Trans Rehabil Eng 1998, 6(2):113–124. 10.1109/86.681177
Ferrarin M, Palazzo F, Riener R, Quintern J: Model-based control of FES-induced single joint movements. IEEE Trans Neural Syst Rehabil Eng 2001, 9(3):245–257. 10.1109/7333.948452
Almeida F, Lopes A, Abreu P: Force-impedance control: a new control strategy of robotic manipulators. In Recent advances in mechatronics. Springer, Singapore; 1999:126–137.
Anam K, Al-Jumaily AA: Active exoskeleton control systems: State of the art. Procedia Eng 2012, 41: 988–994. 10.1016/j.proeng.2012.07.273
Aguirre-Ollinger G, Colgate JE, Peshkin MA, Goswami A (2007) Active-impedance control of a lower-limb assistive exoskeleton. In: Proceedings of the IEEE 10th international conference on rehabilitation robotics, 188–195 [http://ieeexplore.ieee.org/Xplore/home.jsp].
Yang Y, Wang L, Tong J, Zhang L (2006) Arm rehabilitation robot impedance control and experimentation. In: Proceedings of the IEEE international conference on robotics and biomimetics, 914–918 [http://ieeexplore.ieee.org/Xplore/home.jsp].
Zhang L, Sun H, Li C (2010) Experiment study of impedance control on horizontal lower limbs rehabilitation robot. In: Proceedings of the 2010 IEEE international conference on information and automation, 1421–1425 [http://ieeexplore.ieee.org/Xplore/home.jsp] .
Lynch CL, Popovic MR: Functional electrical stimulation. Contr Syst Mag 2008, 28(2):40–50. 10.1109/MCS.2007.914689
Denève A, Moughamir S, Moughamir A, Zaytoon J: Control system design of a 3-DOF upper limbs rehabilitation robot. Comput Methods Programs Biomed 2008, 89(2):202–214. 10.1016/j.cmpb.2007.07.006
Swevers J, Ganseman C, Schutter JD, Brussel HV: Experimental robot identification using optimised periodic trajectories. Mech Syst Signal Process 1996, 10(5):561–577. 10.1006/mssp.1996.0039
Wu W, Zhu S, Wang X, Liu H: Closed-loop dynamic parameter identification of robot manipulators using modified fourier series. Int J Adv Robotic Syst 2012, 9: 561–577.
Kamen G, Gabriel DA: Essentials of electromyography. Human Kinetics, Champaign; 2010.
Sartori M, Reggiani M, Pagello E, Lloyd DG: Modeling the human knee for assistive technologies. IEEE Trans Biomed Eng 2012, 59(9):2642–2649. 10.1109/TBME.2012.2208746
Clancy EA, Liu L, Liu P, Moyer DVZ: Identification of constant-posture EMG–torque relationship about the elbow using nonlinear dynamic models. IEEE Trans Biomed Eng 2012, 59(1):205–212. 10.1109/TBME.2011.2170423
Clancy EA, Bouchard S, Rancourt D: Estimation and application of emg amplitude during dynamic contractions. IEEE Eng Med Biol 2001, 20(6):47–54. 10.1109/51.982275
Delp SL (1990) Surgery simulation: a computer graphics system to analyze and design musculoskeletal reconstructions of the lower limb. Ph.D. Dissertation.
This work was supported in part by the National Natural Science Foundation of China (Grants 61225017, 61175076) and the International S&T Cooperation Project of China (Grant 2011DFG13390).
The authors declare that they have no competing interests.
YC conceived the concept of the study, participated in acquisition and analysis of data, and drafted the manuscript. HJ participated in the development of the robot platform. LP participated in acquisition of data and made contributions to the revision of the draft. ZH made contributions to the revision of the draft. All authors read and approved the final manuscript.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.