iPresence Co., Ltd., a system integrator that provides communication robots throughout Japan, has its own development department. For example, weDeveloped additional features to the system of telepresence avatar robot temiWe are developing additional functions to meet customer requests that cannot be achieved with existing products alone. In addition, our consultants and development department staff work together to provide total support, from proposals to development and implementation support, to help our customers achieve their goals.

This time, the development department of iPresence Co., Ltd. will take advantage of its rich experience and knowledge of image processing technology and robot system development technology in the field of digital twins.Success story of being involved in the development of robot systems of other companiesI will introduce you.

      ＼Can such functions be added to Telerobot? /

Developed a remote control system for welding FA robots that "anyone can weld"! (Case study: Takamaru Industries Co., Ltd.)

1963Takamaru Kogyo Co., Ltd., a long-established robot system integrator founded inGeneral operation of industrial robotsPCI have been aiming for many years to develop a system that anyone can easily use remotely.

It was discussed in the pastResearchers of remote-controlled robotsResearching robots that do not have the primary purpose of increasing efficiency or saving labor, but instead utilize robots as devices that supplement various skills.has beenHe was impressed and said, ``This is a development that is suitable for small and medium-sized enterprises that have challenges such as securing skilled workers, passing on technical skills, and breaking away from 3K operations.''"Future robots should be remotely controlled."With this in mind, we have been working on this development for many years, with an eye toward fields that require skills such as welding*, precision drilling, and painting work.
*Welding: A processing method that joins metals together by melting them and then solidifying them again.

 

Even if you are not a skilled person,Development of a remote robot operation system that anyone can weld withiPresence Co., Ltd. CTO Ota participates in the project

As the first step in developing a remote robot operation system, Takamaru Industries Co., Ltd. began developing a welding robot. We launched the current development project in 2020 to develop a remote robot operation system that allows anyone to weld*, even if they are not a skilled worker. Under project leader Yasuyuki Takamaru of Takamaru Industries Co., Ltd., together with the Sugimoto Laboratory and Hideo Saito Laboratory of Keio University's Faculty of Science and Technology, who were researching augmented reality technology and free viewpoint synthesis technology.iPresence Inc., which has a track record of developing robot systems and digital twins, will be in charge of research and development centered on remote control of real robots.

[iPresence Co., Ltd. Takahiro Ota CTO (Director, Technology Supervisor)] Has extensive knowledge of image processing technology necessary for robot systems and digital twin development.

Takahiro Ota, CTO (Director and Chief Technology Officer) of iPresence Inc., will be in charge of system development, and members of Keio University's Faculty of Science and Technology's Sugimoto Laboratory and Hideo Saito Laboratory will develop robot coordinate systems and digital twins in the real environment. They provided technical support for superimposing the camera coordinate system above. Then, industrial robots can be developed by utilizing software from existing industrial robot manufacturers.Development began with the goal of ``remotely*, anyone can easily operate it, and it can serve as a supplement to various skills.''.
*What is remote? This time, we assume that the remote control will be performed from the office of Takamaru Kogyo Co., Ltd.

Click here for detailed profile>Takahiro Ota CTO

Conventional industrial robot operation software requires operation by a skilled person.

“Teaching” is required to make industrial robots perform work. Teaching is "instructing and storing information in order for a robot to perform a task," and is the process of setting, changing, or checking the order, position, and speed of a robot's movements. The equipment is different. There are several methods of teaching that are in practical use, such as direct and offline, but none of them areBecause teaching work using real robots is dangerous, there were some steps that required technicians who had taken special robot safety training to perform the work.

Work that would normally be done by technicians on site can now be done by non-technical workers remotely by operating industrial robots!

In order for non-technical personnel to operate industrial robots from remote locations, this project created a digital twin space that connects to the teaching software of each industrial robot manufacturer. In this digital twin space, real-time images of the industrial robot and the welding target at the actual site are displayed, and each teaching software is automatically synthesized. Operate the industrial robot to the desired point by dragging the mouse, and if there are no problems, have the robot at the site perform the same action. The staff at the office areBy remotely controlling the robot in this digital twin space, it is now possible to weld using an actual robot.

As a result, even office staff with no welding experience can now perform remote welding using the office computer and display after practicing for a day or two.We have developed a new function for industrial robots that allows even people with no welding experience to perform high-quality welding work using a PC in a safe office with intuitive and simple operations.

Developed a digital twin that connects on-site operating robots and remote locations (offices)!

Development point 1: Robots from different manufacturers can work with the same operation! eachConnect the digital twin to the teaching software provided by the manufacturer for remote control

Takamaru Industries Co., Ltd., as an industrial robot system integrator, handles robots from many manufacturers. This time, we have built a digital twin space for remote control of robots that can be connected to teaching software provided by robot manufacturers.However, rather than being compatible with one manufacturer's software, it is possible to work by being compatible with a wide range of manufacturers' software. We have succeeded in reducing learning costs for students.

 

Development point 2: Realize a highly accurate remote-controlled digital twin environment that is reflected in real time! Work as smoothly as if you were there

Until now, remote work using industrial robots has always been plagued with precision issues. With existing robot simulators provided by manufacturers, it is difficult to know whether the robot is actually touching the object to be welded, which sometimes requires checking on-site.

Real-time synthesis of robot-view camera images and teaching software

To compensate for this, we have placed many robot-viewing cameras on site. By combining images sent in real time with robot teaching software, we were able to correct position information and successfully construct a digital twin space that enables highly accurate remote work. This space is displayed in real-time, overlaid with precisely scaled images sent from cameras installed at the actual work site. Welding work in remote locations is now possible as smoothly as if you were actually there.

[People introduced in this article]
Takamaru Industries Co., Ltd.:https://www.takamaru.com/
Sugimoto Laboratory, Faculty of Science and Technology, Keio University:https://im-lab.net/
Hideo Saito Laboratory, Faculty of Science and Technology, Keio University:http://www.hvrl.ics.keio.ac.jp/

      ＼I want to use it in my company with additional functions／

Telepresence avatar robot expands its field of activity with digital twin technology

Telepresence avatar robots will be able to expand their field of use by making full use of this digital twin technology. For example, by implementing robot simulation as a preliminary step to remote control, new possibilities are opening up to increase safety and efficiency even in complex on-site situations. For example, it can be used with confidence even in narrow spaces or complex moving environments.

This technological research, which overcomes physical distance and seamlessly connects the real and virtual worlds, has led to significant efficiency gains and improved work accuracy in industry. iPresence will continue to conduct research and development and pursue advanced technology.