Hello All!
I am a University student attending Florida International University and am working on my Master Thesis for Architecture. My thesis is about integrating an object detection algorithm, that I have trained to detect bolts, nails, screws, and pliers, (that uses a webcam for input) into the robot. The proof of concept experiment that I want to conduct is to use the webcam to detect one of these items that I put in front of the robot and have the robot write down the name of the object in front of it. This requires a real time interaction with the robot and the camera. All my research has indicated that I need to use Kuka RSI in order to do this in real time.
Although I am able to find some information about the results of using Kuka RSI, I can find little relevant info on how to set it up and how to integrate the webcam (the rest of the programming I have to figure out).
I have two questions. First, is it possible to do this? I know that kuka uses KRL exclusively but I want to investigate if there is a work around for this that I can feed in the proper information to the robot. My initial idea is to some how create a Cartesian plane that is internalized with in the object recognition algorithm that correlates to a base for the robot. Then I would have to figure out how to relay the coordinates of an object to the robot so it can interpret in real time where the item is and execute a command. What I have planned is to have the robot move in front of the object and spell the items name out.
My second question is, If this is possible, How can I go about doing this and using RSI to initiate a real time feedback look that can understand the coordinates of these items and execute a command.
The robot that I am using is a KR10 R1100 with a KRC4 Compact controller. KS V8.3.290 or V8.3.32 (Not sure I have included a picture because it says both), I have also included a picture of the installed options.
Fortunately enough when we ordered it we selected the RSI package and it is pre-installed on the robot controller. The farthest point that I have been able to get to is installing WorkVisual 4.0 and extracting the necessary files from the controller which is used to install on WorkVisual. I followed the instructions on the manual to install RSIVisual on my computer but when I went to Extras and Option Package Management it did not show anything at all.
Also PanicMode, if you are reading this, thank you for all the help that this forum has provided to me in the past with all my setup and questions, I know that you have a section to post manuals and I have many that Kuka has given me but I think the most interesting one which I haven't seen on the forum is the Kuka RSI 3.3.3 manual, what would be the best way of giving it to you so it can be posted in the manuals section?
Thank you very much in advance,
- Jtube