In day to day life there are many different kinds of pointing devices for interaction between human and computer. One of the most developed pointing devices is the mouse. Also traditional input devices are mostly wired devices, except for some Bluetooth enabled ones. In this paper, we propose and develop an effective color tracking method based on a simple color classification i.e. Red, Blue, Green. We can use single piece of paper to handle mouse operation when user move his or her hand on piece of paper the mouse pointer will ne move on screen. This paper includes two major procedure training and tracking. In training procedure the user specifies a color distribution, the training data will be classified into several color cluster using randomized list structure and in color tracking procedure, the color will be segmented in real-time form the background and advantages of this procedure or paper is, It is fast because the image segmentation algorithm is automatically performed on a small region surrounding the hand.It is robust under different lighting condition. To additional control we can use microphone to handle the mouse operation i.e. left, right button. This proposed method has good potentials in many real application, such as virtual reality.