Yes. BRB p. 97: "A character is normally permitted to join units of infantry, beasts, cavalry, monstrous infantry, monstrous beasts or monstrous cavalry."
Usually, a WP is better placed in another unit, as he cannot benefit from the "Look out, Sir" rule with DGKs, and his Righteous Fury does not affect mounts any longer.