These can most often be found on plains. Their usefulness as transportation has made them valuable since ancient times.
That said, wild horses do tend to get spook and run off when approached, so if you're looking to snag one, it's best to sneak up on it.