An interface between Piqle and RL_glue2 is directly available from the Sourceforge download page.

To use it inside the rl2008 competition software :

• Uncompress PiqleRL_glue2.tgz in the 'agents' directory
• use :
  • make clean
  • make -f Make_PiqleXXX
  • bash run PiqleXXX.bash
  (where XXX stands for the version of Piqle's learner you want to use) as described in the rl_glue documentation

At this time, only discrete actions can be handled.

Three example agents are provided :

• PiqleAgent : A Watkins TD(lambda) learner using a NN for storing information
• PiqleAgentTiling : a more efficient TDFA learner (at least for Mountain Car), which saves the learner on a regular base.
• PiqleAgentTilingRead : the same as above, except that it begins by loading a previously saved learner.

The learner seems to be very sensitive to initial parameters, so please if you find interesting parameter settings, let us know about them !

For further information about learners and their parameters, please refer to the documentation, or ask me directly : Francesco.De-Comite at univ-lille1.fr

CSS adapted from Andreas Viklund