Affordance imitation
Modules
This is the general architecture currently under development
Ports and communication
The interface between modules is under development. The current version (subject to changes as we refine it) is as follows:
- Behavior to AttentionSelection -> vocabs "on" / "off"
- Behavior to Query -> vocabs "on" / "off"
We should add some kind of context to the on command (imitation or learning being the very basic).
- Query to Behavior -> "end" / "q"
- Query to Effect Detector. The main objective of this port is to start the tracker at the object of interest. We need to send at least:
- position (x,y) within the image
- size (h,w)
- color histogrambs
- saturation parameters
ok &= port_behavior_out.open("/demoAffv2/behavior:o");
ok &= port_eff.open("/demoAffv2/effect"); ok &= port_sync.open("/demoAffv2/synccamshift"); ok &= port_descriptor.open("/demoAffv2/objsdesc"); ok &= port_askobj.open("/demoAffv2/"); ok &= port_primitives.open("/demoAffv2/motioncmd"); ok &= port_gaze.open("/demoAffv2/gazecmd"); ok &= port_output.open("/demoAffv2/out"); ok &= port_emotions.open("/demoAffv2/out");