Robotics and Semantic Systems

Computer Science | LTH | Lund University

Denna sida på svenska This page in English



We are interested mostly in Autonomous and Intelligent Robotic Systems for manufacturing, as developed in the EU projects TAPAS, CARLOS, Stamina and Scalable 4.0, SME Robotics, SaraFun, and others.

All of our work is based on robot skills, including the necessary low- and high-level reasoning and sensing.


Checkout out below:


For questions, please contact Volker Krueger

Robot Skills

Robot skills are building blocks out of which robots programs are made. The building blocks can be selected automatically through providing a task goal, or they can be selected by hand.



  • Skills are high-level functions like pick, place, push, drive_to, etc.
  • Skills have their own sensing capabilities build in.
  • For example a "pick(piston)" does the following
  1. query the knowledge database (KIF) what a "piston" is. 
  2. The KIF provides a CAD model and possibly additional information.
  3. The skill uses its 3D sensing capabilities to a) locate the Piston based on the CAD information, and b) compute the object pose.
  4. queries the KIF on how to pick the object
  5. the KIF provides pre-grasp and grasping strategy for the available gripper
  6. The skill validates preconditions for picking: 1) gripper is empty, 2) object is reachable
  7. if preconditions are satisfied, the picking is executed
  8. after execution, the robot validates post conditions: 1) gripper not empty, 2) object not at its original location.

Using pre- and post-conditions, we can use PDDL and STRIPS-like planners to find a skill sequence for a given task goal. If pre-conditions fail (e.g., object NOT reachable), the planner can replan to find an alternative skill sequence.


  1. Volker Krueger, Francesco Rovida, Bjarne Grossmann, Ronald Petrick, Matthew Crosby, Arnaud Charzoule, German Martin Garcia, Sven Behnke, Cesar Toscano, Germano Veiga, Testing the vertical and cyber-physical integration of cognitive robots in manufacturing, Robotics and Computer-Integrated Manufacturing, Volume 57, 2019, Pages 213-229
  2. V. Krueger et al., "A Vertical and Cyber–Physical Integration of Cognitive Robots in Manufacturing," in Proceedings of the IEEE, vol. 104, no. 5, pp. 1114-1127, May 2016.
  3. Mikkel Rath Pedersen, Lazaros Nalpantidis, Rasmus Skovgaard Andersen, Casper Schou, Simon Bøgh, Volker Krüger, Ole Madsen, Robot skills for manufacturing: From concept to industrial deployment, Robotics and Computer-Integrated Manufacturing, Volume 37, 2016, Pages 282-291

Movement Generators and Behavioral Trees for Modelling Skills

Task level programming based on skills has often been proposed as a mean to decrease programming complexity of industrial robots. Several models are based on encapsulating complex motions into self-contained primitive blocks. A semantic skill is then defined as a deterministic sequence of these primitives. A major limitation is that existing frameworks do not support the coordination of concurrent motion primitives with possible interference. This decreases their reusability and scalability in unstructured environments where a dynamic and reactive adaptation of motions is often required. This paper presents a novel framework that generates adaptive behaviors by modeling skills as concurrent motion primitives activated dynamically when conditions trigger. The approach exploits the additive property of motion generators to superpose multiple contributions. We demonstrate the applicability on a real assembly use-case and discuss the gained benefits.


F. Rovida, D. Wuthier, B. Grossmann, M. Fumagalli and V. Krüger, "Motion Generators Combined with Behavior Trees: A Novel Approach to Skill Modelling," 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, 2018, pp. 5964-5971.



ARIAC Competition

We have participated in the 2018 Agile Robotics for Industrial Automation Competition (ARIAC) with my old group at Aalborg University, and we have finished third by using SkiRoS, or Skills for Robot Systems software.

Tasks were

  • Failure identification and recovery
  • Automated planning
  • Fixtureless environment
  • Plug and play robots
  • autonomously completing kitting order fulfilment tasks,

various agility challenges were:

  1. Failing suction grippers
  2. Reception of updated/high-priority orders
  3. Notification of faulty products
  4. Products requested flipped from their original positioning
  5. Failing sensors (“blackout”)
Page Manager: