yeah you have to go into face normal mode; alt-rightclick on any face in the world (I like to use
this) will select that face's normal (direction) as the direction for displacement painting, and then you can paint your displacement in that direction.