The main aim of the project is to implement a system where devices will be controlled by using the gestures. gestures are the hand gestures of the physically challenged person. the gestures are captured using the kinect camera which is connected to the computer. the camera is interfaced using the matlab software. the hand gestures are considered for controlling the devices such as fan, tv, lights, fridge etc. gestures are saved in the database using the offline process. our project helps in assisting the physically impaired, bedridden patients and also for deaf peoples to get their things/work done by controlling devices of their own interest according to their convenience without anyone’s help. the monitoring of patients and disabled persons have always been a major concern in hospitals and homes. various research works have been done to develop healthcare systems to ensure the safety of elderly people at home. in this project, we propose a monitoring system based on kinect sensors to control and monitor elderly people into a smart house. the system recognizes gestures and communicates them through a network.