Twilight

I think its fine at around six or so if the horse is small and the child is taught properly how to ride.

There should always be supervision however, and the horse should be very gentle and accustomed to kids