Monday , May 29 2023

Design and Implementation of Robust Hybrid Control of Vision Based Underactuated Mechanical Nonminimum Phase Systems

Haoping WANG1, Christian VASSEUR2, Vladan KONCAR3, Afzal CHAMROO4, Nicolai CHRISTOV5
1,2,5 LAGIS CNRS FRE 3303, Université Lille 1 Sciences et Technologies, Bât. P2,
59655 Villeneuve d’Ascq, France
{, christian.vasseur, nicolai.christov}
9 Rue de l’Ermitage, BP 30329, 59056 Roubaix, France
4 LAII, Université Poitiers,
40 av. du Recteur Pineau, 86022 Poitiers, France

Abstract: This paper presents a vision based Cart-Inverted Pendulum (CIP) system under a hybrid feedback configuration: the continuous cart’s position measured by encoder and the delayed & sampled inverted pendulum’s upper coordinates, obtained from a visual sensor. The challenge here is to stabilize the CIP from a big inclined initial angle by using a low cost CCD camera. Under this scheme, we propose a hybrid control which consists in a Jumping-up (Bang-Bang) control and a two causal stabilization loops control: the first one (inner loop) realizes a linearization and the stabilization control of the pendulum based on an innovative Piecewise Continuous Reduced Order Luenberger Observer coupled with a linearization module, the second one (the outer loop) realizes a Lyapunov based control for the unstable internal system with lower dynamics than that of the pendulum. This hybrid control method is capable of balancing the CIP system within small cart’s displacement. Performances issues of the proposed method are illustrated by the experimental figures and videos.

Keywords: Visual servoing, underacturated mechanical systems, nonminimum phase systems, Lyapunov functions, piecewise continuous systems.

>>Full text
Haoping WANG, Christian VASSEUR, Vladan KONCAR, Afzal CHAMROO, Nicolai CHRISTOV, Design and Implementation of Robust Hybrid Control of Vision Based Underactuated Mechanical Nonminimum Phase SystemsStudies in Informatics and Control, ISSN 1220-1766, vol. 19 (1), pp. 35-44, 2010.

1. Introduction

During the last few years, there has been a considerable amount of interest in the control of vision based underactuated mechanical systems forced by fewer actuators than degrees of freedom, presents a challenging problem. The interest comes from the need of supervision in remote control especially via Internet based network, more flexible contactless wiring and improved signal/noise ratio. Various models of vision based underactuated mechanical control have been reported in attempt to improve the visual servoing’s performance.

Recalling [1] the visual servoing term is defined as using visual feedback to control a robot. For example visual (image based) features such as points, lines and regions can be used to enable the alignment of a manipulator/gripping mechanism with an object. Vision is a part of a control system providing feedback. However, traditionally visual sensing and manipulation are combined in an open-loop configuration, ‘looking’ and ‘moving’, or just for visualizations and animations purposes referring to pendulum control in remote control laboratory [2], [3]. Recently, visual supervision has been gradually combined in the closed control loop particularly for cart-inverted pendulum control such as in [4], [5]. Unfortunately there is no real successful application reported on controlling the cart’s position and pendulum’s angle by visual servoing till now. A fuzzy-logic based controller was reported in [6], but only for controlling a rotary pendulum near the unstable equilibrium zone not exceeding ±5°. For larger deviations, the system turned out to be too slow to compensate. This control was limited in time on a few seconds in keeping the pendulum upright. In [7] a just-in-time human simulated method was developed to stabilize a two-link Direct Drive Arm-pendulum system. The direction of the pendulum movement is restricted on tangential plane for the trajectory of the tip of second link. This human learning and memory based fuzzy control can stabilize the inverted pendulum only for seconds ( 16 s) and with larger angular position oscillations ±26°, just like humans.

Analyzing the difficulties of previous vision based research works related to CIP control; it seemed that the camera signal has not been sufficiently exploited. The problem is that these sensors often deliver sampled and delayed signals due to their digital nature and computation-transfer time (image processing) respectively. Our challenge here is to consider the low cost CCD cameras as contact-less pendulum sensor to stabilize the CIP jumping from a big angular position with a big time delay.

Our efforts have been focused on the development of an accurate observer using the theory of Piecewise Continuous Systems (PCS) [8]. This kind of systems are continuous controlled hybrid systems with independent switching and controlled input [8], [9]. Considering the sampled delayed camera’s measurements (pendulum’s angular position) as autonomous switching and controlled impulse, we estimate the present continuous pendulum’s angular position and angular speed.

With the improved pendulum’s angular position and the estimated angular speed, we can construct our control methods. The research work presented here is an extension and development of the preceding works [8], [9], [10], [11].

The paper is organized as follows: sections 2, 3 and 4 present the description and modelling of the real vision based CIP system, particularly the TSAI calibration method and the way to calculate the delayed and sampled pendulum’s angular position. In section 5 a hybrid control consisting of the Jumping-up control and the two causal stabilization loops under a logic-based switch mechanism is proposed. A Piecewise Continuous Reduced Order Luenberger Observer (PCROLO) is also developed. Simulation and experimental results are given in section 6.


  1. HUTCHINSON, S., G. D. HAGER, P. I. CORKE, A Tutorial on Visual Servo Control, IEEE Trans. on Robotics and Automation, Vol. 12(5), 1996, pp. 651-670.
  2. ARMANDO, A. R., P. M. RICHARD, C. OGUZHAN, D. THANATE, Description of a Modelling, Simulation, Animation, and Real-tile Control (MoSART) Environment for a Class of Electromechanical Systems, IEEE Trans. on Education, Vol. 48(3), 2005, pp. 359-374.
  3. SANCHEZ, J., S. DORMIDO, R. PASTOR, F. MORILLA, A Java / Matlab-based Environment for Remote Control System Laboratories: Illustrated with an Inverted Pendulum, IEEE Trans. on Education, Vol. 47(3), 2004, pp. 321-329.
  4. ESPINOZA-QUESADA, E. S., L. E. RAMOS-VELASCO, Vision Based control of an Underactuated System Using a Reduced Observer, Proc. of Electronics, Robotics and Automotive Mechanics Conf., Vol. 1, Sept. 2006, pp. 9-14.
  5. WENZEL, L., N. VAZQUEZ, D. NAIR, R. JAMAL, Computer Vision Based Inverted Pendulum, Proc. 17th IEEE Instrumentation and Measurement Tech. Conf.. Vol. 3, pp.1319-1323, 2000.
  6. MAGANA, M. E., F. HOLZAPFEL, Fuzzy-logic Control of an Inverted Pendulum with Vision Feedback, IEEE Trans. on Education, Vol. 41(2), 1998, pp. 165-170.
  7. FUKUDA, K. I., S. USHIDA, K. DEGUCHI, Just-in-time Control Image-based Inverted Pendulums with a Time-delay, Proc. SICE-ICASE International Joint Conf., Busan, Korea, October 2006, pp. 4016-4021.
  8. KONCAR, V., C. VASSEUR, Control of Linear Systems Using Piecewise Continuous Systems, IEE Control Theory & Applications, Vol. 150(6), 2003, pp. 565-576.
  9. CHAMROO, A., I. SIMEONOV, C. VASSEUR, N. CHRISTOV, On the Piecewise Continuous Control of Methane Fermentation Processes, Studies in Informatics and Control, Vol. 17(2), 2008, pp. 181-188.
  10. WANG, H. P., C. VASSEUR, A. CHAMROO, V. KONCAR, Sampled Tracking for Delayed Systems Using Piecewise Functioning Controller, Proc. 4th IEEE Conf. on Computational Engineering in Systems Applications, Beijing, Oct. 2006, Vol. 2, pp. 1326-1333.
  11. WANG, H. P., C. VASSEUR, A. CHAMROO, V. KONCAR, Hybrid Control for Vision Based Cart-inverted Pendulum System, Proc. of the American Control Conf., Seattle, June 2008.
  12. HEIKKILA, J., O. SILVEN, A Four-step Camera Calibration Procedure with Implicit Image Correction, Proc. of IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, June 1997, pp.1106-1112.
  13. CHEN, L., R. SMITH, Closed-loop Model Validation for an Inverted Pendulum Experiment via a Linear Matrix Inequality Approach, Proc. of the 36th CDC, San Diego, Dec. 1997, pp. 2565-2566.
  14. DELEY, D. W., Controlling an Inverted Pendulum: Example of a Digital Feedback Control System, available:, January 2007.
  15. GUEMGHAR, K., B. SRINIVASAN, PH. MULLHAUPT, D. BONVIN, Analysis of Cascade Structure with Predictive Control and Feedback Linearization, IEE Control Theory & Applications, Vol. 152(3), 2005, pp. 317-324.
  16. ASTROM, K. J., K. FURUTA, Swinging Up a Pendulum by Energy Control, Automatica, Vol. 36, 2000, pp. 287-295.
  17. BUGEJA, M., Non-linear Swing-up and Stabilizing Control of an Inverted Pendulum System, Proc. of. EUROCON, Ljubljana, 2003.
  18. CHATTERJEE, D., A. PATRA, H. JOGLEKAR, Swing-up and Stabilization of a Cart-pendulum System Under Restricted Cart Track Length, System and Control Letters, Vol. 47(4), 2002, pp. 355-364.
  19. SPONG, M. W., Energy Based Control of a Class of Underactuated Mechanical Systems, Proc. 13th IFAC World Congress, Vol. F, July 1996, pp. 431-436.
  20. NUNDRAKWANG, S., T. BENJANARASUTH, J. NGAMWIWIT, N. KOMINE, Hybrid Controller for Swinging Up Inverted Pendulum System, Proc. of the 5th International Conf. on Information, Communications and Signal, Dec. 2005, pp. 488-492.
  21. ISIDORI, A., Nonlinear Control Systems, Springer, Third edition, 1994.