The short answer: Yes!

Even if your horse has 0 stars, having a dirt preference is still la big advantage for any dirt race.