
Semirings and weighted automata
A semiring is a structure which satisfiesthe following conditions is a commutative monoid in which is anassociati...

Do skillful behaviors only exist in the eye of the observer ?
I am sometimes calling into question the idea of skill acquisition in itsdominant representationalist view. In AI the...

Upcoming Conferences on AI and Machine Learning
Quebec city will be the host of an astonishing number of key conferences in AI and ML this year.I have compiled them ...

Machine Learning and Data Crunching at Pycon
Pycon is taking place in Montreal next year from April 9 to 17. Here are a few talks related to machine learning and ...

Temporal and Spatial Components of Motor Skills Learning in Birdsong
They say that if all you have is a hammer, everything looks like a nail.I have to admit: my hammer for Hierachical Re...

A Fresh Perspective on HRL with Mixture of Options
Recent work by Daniel, Neumann & Peters (2012) as well assimilar independent research by Thomas & Barto (2012...

The Ubiquitous RL Agent Interaction Diagram in Tikz
It is present in almost all of the presentation about Reinforcement Learning.I’m talking here about the AgentEnviron...

Konidaris' Pinball Domain now Available in Python
As part of my Master’s thesis, I implemented George Konidaris’ Pinball domain for reinforcement Learning.Konidaris ha...

Bringing A Virtual Box Machine To The Physical World Over The Network
On the target machinePrior to the following, you would first need to create and boot from a USB stick any sort of lin...

Asynchronous Timer Expiry Notification
In some recent TCP experiment that I carried in the user space, I faced the problem of generating relatively precise ...

Applying A Function To Every Row Or Column Of A Matrix In Matlab
Sure we have arrayfun, but it applies a function every element of a matrix. What if we want to compute the sum over e...

Indexing Diagonal Matrix Elements In Matlab
I have came across this problem very often, but always ended up solving it in a different way each time. Here is what...