1. Home
    1. Dashboard
    2. Search
  2. Forum
    1. Unresolved Threads
    2. Members
      1. Recent Activities
      2. Users Online
      3. Team Members
      4. Search Members
      5. Trophys
  3. Articles
  4. Blog
  5. Videos
  6. Jobs
  7. Shop
    1. Orders
  • Login or register
  • Search
This Thread
  • Everywhere
  • This Thread
  • This Forum
  • Articles
  • Pages
  • Forum
  • Blog Articles
  • Products
  • More Options
  1. Robotforum - Support and discussion community for industrial robots and cobots
  2. Forum
  3. Industrial Robot Support and Discussion Center
  4. KUKA Robot Forum
Your browser does not support videos RoboDK Software for simulation and programming
Visit our Mainsponsor
IRBCAM
Robotics Channel
Robotics Training
Advertise in robotics
Sponsored Ads

KUKA VisionTech in Simulation

  • desertgiant
  • January 24, 2024 at 5:11 PM
  • Thread is Resolved
  • desertgiant
    Reactions Received
    2
    Trophies
    1
    Posts
    51
    • January 24, 2024 at 5:11 PM
    • #1

    Hello Everyone

    Has anyone successfully simulated a Vision Application and the VisionTech software inside simulation environment ?

    This means no real camera will be used but a vision sensor from simulation env will be capturing images and this image will be further processed by the kuka visiontech algorithm in real time from the office PC which brings close to reality in digital twin.

    KUKA KRC5 controller.

    Thanks in Advance.

  • panic mode
    Reactions Received
    1,280
    Trophies
    11
    Posts
    13,088
    • January 24, 2024 at 8:00 PM
    • #2

    vision system is normally integrated with the robot either using some sort of fieldbus or EthernetKRL. if your simulation is done in KUKA OfflinePC, you can get both of them work.

    of you are using OfficeLite, fieldbuses are not supported but you can still get vision system integrated using EthernetKRL.

    but... it really does not matter how your vision processes or deliver data, it is the test results that matter. and those can be simulated too - for example entered though file or hard coded or loaded from an array...

    1) read pinned topic: READ FIRST...

    2) if you have an issue with robot, post question in the correct forum section... do NOT contact me directly

    3) read 1 and 2

  • desertgiant
    Reactions Received
    2
    Trophies
    1
    Posts
    51
    • January 25, 2024 at 11:42 AM
    • #3

    Do I need any additional interface like the Y200 ?

    Because I have to somehow tell the KUKA Office PC that what it gets on KONI Port is not from a camera (Basler or Baumer) but from a simulated port.

    Also when I look at the drop down box in the tools configuration page under VisioTech -> Task Configuration, it always looks for the missing camera.

  • panic mode
    Reactions Received
    1,280
    Trophies
    11
    Posts
    13,088
    • January 25, 2024 at 2:41 PM
    • #4

    why?

    if you are not really using vision system but rather SIMULATING it... well... you need to replace relevant program parts with something that SIMULATES interaction with the vision system. this is something you need to make.

    example for VT3.1

    Code
    INI
    
    PTP HOME Vel= 100% DEFAULT
    
    PTP P1 Vel=100% PDAT1 Tool[1]: Gripper BASE[3]
    
    IF SIM_VT_OFF THEN
      ; do things as usual ...
      VT.TRIGGER 2Dfix_relative 
      VT.WAITFORRESULT 2Dfix_relative
      VT.SETTARGETBASE CalibrationBase=Base[1]:CalibBase TargetBase=Base[2]:PartBase 
    ELSE
      ; run simulation ...
      MsgNotify("Simulating vision, Set $FLAG[1] to trigger it")
      $FLAG[1]=FALSE
      WAIT FOR $FLAG[1]
      MsgNotify("Simulating vision, trigger sensed")
      WAIT SEC 3 ; give yourself time if needed
      BASE_DATA[2] = {X ..., Y ... }
    ENDIF
    
    PTP P1 Vel=100% PDAT1 Tool[1]:Gripper BASE[2]:PartBase
    PTP P2 Vel=100% PDAT2 Tool[1]:Gripper BASE[2]:PartBase
    
    PTP HOME Vel= 100% DEFAULT
    Display More

    And would you believe it ... no KONI or camera or anything needed. things got SIMULATED.

    1) read pinned topic: READ FIRST...

    2) if you have an issue with robot, post question in the correct forum section... do NOT contact me directly

    3) read 1 and 2

  • desertgiant
    Reactions Received
    2
    Trophies
    1
    Posts
    51
    • January 25, 2024 at 5:04 PM
    • #5

    Thanks for the reply.

    That is one possible and the best solution. The simulation software can communicate the actual position of the part to the robot and robot bypasses the vision callings in the simulation mode and use the frame to internally calculate its trajectory.

    However the customer is pressing to use the same kuka software and wants to have the same behaviour in simulation like in real world.

    The simulation software can stream the images to a specific port.

    KUKA Office PC should be capturing this stream and make the KUKA KRL library think the stream is from a real camera and process further.

    I am interested to know how such a solution can be solved with kuka and if there will be additional interfaces like the Y200 will be needed.

  • panic mode
    Reactions Received
    1,280
    Trophies
    11
    Posts
    13,088
    • January 25, 2024 at 5:47 PM
    • #6

    so you want to simulate something but do not know how things work and what part exactly you need to simulate.

    Quote from desertgiant

    The simulation software can stream the images to a specific port.

    it can? you have this part working?

    or you mean it could (eventually... if someone knew what to send, when, in what format, to what port etc.). that would be simulation of a camera.

    or you man just sharing folder and letting external application drop a file?

    Quote from desertgiant

    KUKA Office PC should be capturing this stream and make the KUKA KRL library think the stream is from a real camera and process further.

    As i recall VisionTech is an option from KUKA and it is really only a front end. It waits for trigger, then sends it to Baumer camera connected to KONI port. Which then returns image to KRC. Then the image is processed by VisionPro running on KRC. Then result of the VisionPro is communicated to robot program through EthernetKRL. This is probably done using Cognex SDK (Vidi).

    Getting Started

    this is meant to be done in programming language like C#. same language could be used to communicate with the robot (sense trigger, return results). normally communication would be done through EthernetKRL but you can use whatever you are familiar with.

    1) read pinned topic: READ FIRST...

    2) if you have an issue with robot, post question in the correct forum section... do NOT contact me directly

    3) read 1 and 2

  • panic mode
    Reactions Received
    1,280
    Trophies
    11
    Posts
    13,088
    • January 26, 2024 at 6:45 AM
    • #7

    But there are of course other ways. One approach may be to check if visionpro supports command line parameters. That makes front end easy. The only thing left is to send value to KRC.

    Another way is for more stubborn applications. This works even if the target app does not expose API or have SDK. It means using windows to interact with target app. But depending on target app user interface, this can be quite clunky. like a wizard.

    1) read pinned topic: READ FIRST...

    2) if you have an issue with robot, post question in the correct forum section... do NOT contact me directly

    3) read 1 and 2

  • desertgiant
    Reactions Received
    2
    Trophies
    1
    Posts
    51
    • February 6, 2024 at 1:42 PM
    • #8

    Was in contact with KUKA. They informed simulation of camera with reading image from folder is possible as they did it before for testing purposes. But this feature is strictly limited to Office PC.

  • desertgiant
    Reactions Received
    2
    Trophies
    1
    Posts
    51
    • February 22, 2024 at 4:05 PM
    • #9

    After a few hustle the digital twin to the real robot with vision was established using the KUKA Office PC.

    the simulated version of the camera here does not support calibration as done through KUKA VIsionTech HMI, hence the real calibration file from the KRC controller must be used.

    When the image written to the Office PC is similar in dimension and pixel to the actual picture from camera the digital version can imitate the real robot movement.

    The quality of the robot accuracy and repeatability in the digital world depends on how similar the image in digital world is to the real image captured from camera.

Advertising from our partners

IRBCAM
Robotics Channel
Robotics Training
Advertise in robotics
Advertise in Robotics
Advertise in Robotics

Job Postings

  • Anyware Robotics is hiring!

    yzhou377 February 23, 2025 at 4:54 AM
  • How to see your Job Posting (search or recruit) here in Robot-Forum.com

    Werner Hampel November 18, 2021 at 3:44 PM
Your browser does not support videos RoboDK Software for simulation and programming

Tag Cloud

  • abb
  • Backup
  • calibration
  • Communication
  • CRX
  • DCS
  • dx100
  • dx200
  • error
  • Ethernet
  • Ethernet IP
  • external axis
  • Fanuc
  • help
  • hmi
  • I/O
  • irc5
  • IRVIsion
  • karel
  • kawasaki
  • KRC2
  • KRC4
  • KRC 4
  • KRL
  • KUKA
  • motoman
  • Offset
  • PLC
  • PROFINET
  • Program
  • Programming
  • RAPID
  • robodk
  • roboguide
  • robot
  • robotstudio
  • RSI
  • safety
  • Siemens
  • simulation
  • SPEED
  • staubli
  • tcp
  • TCP/IP
  • teach pendant
  • vision
  • Welding
  • workvisual
  • yaskawa
  • YRC1000

Thread Tag Cloud

  • abb
  • Backup
  • calibration
  • Communication
  • CRX
  • DCS
  • dx100
  • dx200
  • error
  • Ethernet
  • Ethernet IP
  • external axis
  • Fanuc
  • help
  • hmi
  • I/O
  • irc5
  • IRVIsion
  • karel
  • kawasaki
  • KRC2
  • KRC4
  • KRC 4
  • KRL
  • KUKA
  • motoman
  • Offset
  • PLC
  • PROFINET
  • Program
  • Programming
  • RAPID
  • robodk
  • roboguide
  • robot
  • robotstudio
  • RSI
  • safety
  • Siemens
  • simulation
  • SPEED
  • staubli
  • tcp
  • TCP/IP
  • teach pendant
  • vision
  • Welding
  • workvisual
  • yaskawa
  • YRC1000

Tags

  • simulation
  • VisionTech
  1. Privacy Policy
  2. Legal Notice
Powered by WoltLab Suite™
As a registered Member:
* You will see no Google advertising
* You can translate posts into your local language
* You can ask questions or help the community with your knowledge
* You can thank the authors for their help
* You can receive notifications of replies or new topics on request
* We do not sell your data - we promise

JOIN OUR GREAT ROBOTICS COMMUNITY.
Don’t have an account yet? Register yourself now and be a part of our community!
Register Yourself Lost Password
Robotforum - Support and discussion community for industrial robots and cobots in the WSC-Connect App on Google Play
Robotforum - Support and discussion community for industrial robots and cobots in the WSC-Connect App on the App Store
Download