The vision based cursor control using the hand gesture system is developed in the Python language, using the OpenCV library. The system was able to control the movement of a cursor by tracking the user’s hand. Cursor functions were performed by using different hand gestures. The system has the potential of being a viable replacement for the computer mouse, however due to the constraints encountered; it cannot completely replace the computer mouse. The major constraint of the system is that it must be operated in a well lit room. It was difficult to control the cursor for precise cursor movements, since the cursor was unstable. All of the objectives of the project were completed with satisfactory results.