Recent Posts

  1. Semirings and weighted automata

    A semiring is a structure which satisfiesthe following conditions is a commutative monoid in which is anassociati...

  2. Do skillful behaviors only exist in the eye of the observer ?

    I am sometimes calling into question the idea of skill acquisition in itsdominant representationalist view. In AI the...

  3. Upcoming Conferences on AI and Machine Learning

    Quebec city will be the host of an astonishing number of key conferences in AI and ML this year.I have compiled them ...

  4. Machine Learning and Data Crunching at Pycon

    Pycon is taking place in Montreal next year from April 9 to 17. Here are a few talks related to machine learning and ...

  5. Temporal and Spatial Components of Motor Skills Learning in Birdsong

    They say that if all you have is a hammer, everything looks like a nail.I have to admit: my hammer for Hierachical Re...

  6. A Fresh Perspective on HRL with Mixture of Options

    Recent work by Daniel, Neumann & Peters (2012) as well assimilar independent research by Thomas & Barto (2012...

  7. The Ubiquitous RL Agent Interaction Diagram in Tikz

    It is present in almost all of the presentation about Reinforcement Learning.I’m talking here about the Agent-Environ...

  8. Konidaris' Pinball Domain now Available in Python

    As part of my Master’s thesis, I implemented George Konidaris’ Pinball domain for reinforcement Learning.Konidaris ha...

  9. Bringing A Virtual Box Machine To The Physical World Over The Network

    On the target machinePrior to the following, you would first need to create and boot from a USB stick any sort of lin...

  10. Asynchronous Timer Expiry Notification

    In some recent TCP experiment that I carried in the user space, I faced the problem of generating relatively precise ...

  11. Applying A Function To Every Row Or Column Of A Matrix In Matlab

    Sure we have arrayfun, but it applies a function every element of a matrix. What if we want to compute the sum over e...

  12. Indexing Diagonal Matrix Elements In Matlab

    I have came across this problem very often, but always ended up solving it in a different way each time. Here is what...