gyti.techpedia@sristi.org
Gesture Control Telepresence Robot Or
Project Description :

Introduction nowadays, robots are increasingly being integrated into working tasks to replace humans especially to perform the repetitive task. in general, robotics can be divided into two areas, industrial and service robotics. international federation of robotics (ifr) defines a service robot as a robot which operates semi- or fully autonomously to perform services useful to the wellbeing of humans and equipment, excluding manufacturing operations. these robots are currently used in many fields of applications including office, military tasks, hospital operations, dangerous environment and agriculture. besides, it might be difficult or dangerous for humans to do some specific tasks like picking up explosive chemicals, defusing bombs or in worst case scenario to pick and place the bomb somewhere for containment and for repeated pick and place action in industries. therefore a robot can be replaced human to do work. the concept of this project is to build a custom telepresence robot. this robot provides two-way audio and video conferencing capability over an internet connection, and is replicate i.e. mimic the human movement. this allows a telepresence user to explore and interact with a remote environment through the robot as if they were physically present. the majority of robots in use today are controlled using limited and complicated set of controlling unit such as switches, relay logic and at the most it is a pc controlled. however, these techniques has various disadvantages, viz. complex, less ease, requires training, etc. as a result, the demand for gesture-controlled applications, process and robots are increasing nowadays. it has the biggest advantage that is easier to control and hardly requires any training. our project aims on gesture-based method of controlling a robot. humans are able to produce various types of gestures. we are using the motion of the hand (gestures)-fingers, elbow and wrist as the input for commanding the robot at a distance. a robot is a device that to an extent mimics human behavior. development of a robot for defense and industrial purposes is the need of the hour to strengthen the security and economy of any nation. thus, our project is a humble step in this direction. without risking human life or limb, robots can replace humans in some hazardous duty service. for example bomb disposal, operation in chemical industry, inflammable areas, etc. typically these robots resemble armored tanks and are guided remotely by personnel through its gestures. thus, mimics human gestures or behaviors. similar robots can help in machining in hazardous areas or cleaning up the toxic waste. in this way our robot can maneuver over different terrains, can be commanded through gestures and can mimic human behavior. telepresence is a technology that allows a person to observe and interact with a remote environment. a computer is used to display a live video stream from the remote location, allowing a user to examine the surroundings. likewise, audio and other environmental parameters are transmitted to enhance the telepresence experience. some telepresence solutions, such as the one that we are developing, are mounted to a mobile robot platform to provide movement freedom for the user. there are many emerging uses of a telepresence system today. some of the uses include telesurgery, tele-lecturing, tele-working in dangerous avenues such as nuclear scrubbing and deep ocean exploration. in a more common scenario, users can use telepresence systems to communicate and interact with family and friends across the world. a robot is a reprogrammable, multifunctional manipulator designed to move materials, parts, tools or specialized devices through variable programmed motions for the performance of a variety of tasks. basically a robot consists of a mechanical structure, such as a wheeled platform, arm, or other construction, capable of interacting with its environment and sensors to sense the environment and give useful feedback to the device. systems to process sensory input in the context of the current situation and instruct the device to perform actions in response to the situation. surveillance robot is to recognize and detect motion automatically around a robot's environment. the robot design has been partitioned into sensor, control, and planning subsystems. robotic surveillance appliance is built on a moving platform designed for surveillance and security tasks. this robot can be operated in “remote eyes” or “automatic trip” modes. this means it can be steered remotely by a human watchman as a moving surveillance camera or it can drive autonomously along an undefined route, detecting all inconsistencies in the video input. secret surveillance in tightly constrained spaces is demanded in many military and civilian activities, such as cave-in enemy raids and indoor hostage rescue missions. robot may be used because they are faster than people at carrying out tasks. this is because a robot is really a mechanism which is controlled by a computer. some robots actually move more quickly than we can, so they can carry out a task such as picking up and inserting items, more quickly. review of literature there are various ways in which a robotic arm may be controlled. in the past there have been many researchers working to control robotic arm through computer terminals, joysticks, even interfacing them with the internet so they can be controlled from anywhere in the world. usually most of the robotic arms are controlled by a central controller which makes uses of values taken in from the terminal that are entered by the user at the terminal to move the arm to a particular coordinates in space. this makes the control very difficult as the control values of the motors are very difficult to predict to achieve a particular movement. this is easily achieved by our project. this project represents a simple motion sensor controlled robotic arm using atmega328 powered embedded system as the core of this robot. the robot does not require training because the robotic arm is fully controlled by the user gesture operated: the gesture control telepresence robot is entirely controlled via flex sensors mounted on fingers using a glove and an mpu installed on the wrist of the personnel. the user will be able to interface the real world to the digital world. thus, the user will be able to command the robot through his gestures preformed in real world. the tilting of the other hand’s wrist in the respective direction will operate the movement of the robot. microcontroller based: the analog signals from the flex sensors and motion sensors are given to the microcontroller. the integrated adc of microcontroller maps these analog signals into digital signals, which can be sent through zigbee over a communication channel. in our project we intend to use atmega328 microcontroller for performing and controlling all the operations. also the arduino platform makes it easy for the hardware and software integration. wireless control: the commands specified by the user through his gestures, i.e., the controlling signals from the microcontroller are given to a transceiver zigbee module for transmission. it creates a personal area network between the two modules for communication. applications • military applications: with the help of virtual reality glasses to analyze the war field and with the help of various sensors, radars, this robot can serve as extreme war machine on the war field. also as it can be controlled from a remote location we can save our soldier’s priceless life. • bomb diffusing: this robot can be used handle difficult situations such as diffusing bomb, where a bomb diffusing kit will be mounted instead of the current animatronics hand. also this bot can be used to deal with the terrorist holding hostages. • daily life/general applications this project can be modified according to the need for the society. for example for old age peoples and physically disabled peoples this bot can be very helpful as it will be controlled by their own relatives to complete their needs such as serving water, food, medicine, etc. • buisness applications: also this project can be used in small and large business where as per the application the the modifications will be done to handle number of manipulators at a time. • telerobotics for space : with the exception of the apollo program most space exploration has been conducted with telerobotic space probes. most space-based astronomy, for example, has been conducted with telerobotic telescopes. the russian lunokhod-1 mission, for example, put a remotely driven rover on the moon, which was driven in real time (with a 2.5-second lightspeed time delay) by human operators on the ground. robotic planetary exploration programs use spacecraft that are programmed by humans at ground stations, essentially achieving a long-time-delay form of telerobotic operation. recent noteworthy examples include the mars exploration rovers (mer) and the curiosity rover. in the case of the mer mission, the spacecraft and the rover operated on stored programs, with the rover drivers on the ground programming each day's operation. the international space station(iss) uses a two-armed telemanipulator called dextre. more recently, a humanoid robot robonaut[3] has been added to the space station for telerobotic experiments. • marine applications : marine remotely operated vehicles (rovs) are widely used to work in water too deep or too dangerous for divers. they repair offshore oil platforms and attach cables to sunken ships to hoist them. they are usually attached by a tether to a control center on a surface ship. the wreck of the titanic was explored by an rov, as well as by a crew-operated vessel. • telemedicine : additionally, a lot of telerobotic research is being done in the field of medical devices, and minimally invasive surgical systems. with a robotic surgery system, a surgeon can work inside the body through tiny holes just big enough for the manipulator, with no need to open up the chest cavity to allow hands inside. • other telerobotic applications : remote manipulators are used to handle radioactive materials. telerobotics has been used in installation art pieces; telegarden is an example of a project where a robot was operated by users through the web. future scope • future efforts could be to make it flyable or swimmable if possible (from one place to another). • information about the fire and any other accidents. • there are many future potential research options with this completed prototype. a possible research direction would be to automate the system as an intelligent guide robot or using it as a mobile kiosk to assist humans. • future improvements for the robot involve upgrading the web user interface (ui) credential system to provide better security, and augmenting the robot arm with better motors for increased lifting strength and robustness. • if we mounted pressure sensor on the fingers of the robotic arm we can detect the touch sense and if we send this signal back to the transmitter and recreate the equal pressure using pressure tubes then we can actually feel that we are touching or holding form remote location. • also if we integrate the above system with google glass or microsoft hololens we can turn the virtual reality into a real reality. • the nasa is developing the same robot and if we sent this robot on planets like mars we can actually feel that we are on mars. conclusion • the objectives of this project has been achieved which was developing the hardware and software for an motion sensor controlled robotic arm. from observation that has been made, it clearly shows that its movement is precise, accurate, and is easy to control and user friendly to use. • the robotic arm has been developed successfully as the movement of the robot can be controlled precisely. this robotic arm control method is expected to overcome the problem such as placing or picking object that away from the user, pick and place hazardous object in a very fast and easy manner. • the proposed system is superior to other existing robots due to the use of sensors that are cheaper and easily available. it is not feasible for rescue personnel to individually visit the site (war field, earthquake-stricken area, mines etc) and check who is alive and who needs rescue.

 
Other Photos :
 

No Updates

 
Project Details :
  • Date : Jan 08,2016
  • Innovator : Tushar Vijay Borhade
  • Guide Name : Yogesh Borhade
  • College : B.R. Harne College of Engineering and Technology
  • University : Mumbai University
  • Submission Year : 2016
  • Category : Electronics, Communications & related fields
Share Project :