Most people who are considered "Latin American" are those who speak derivatives of Vulgar Latin, and therefore speak a variety of Latin.
Of course, that definition would include French Americans as "Latin Americans", so no matter how you slice it, calling people "Latin Americans" is just an arbitrary and perhaps subtly racist way to differentiate "furr'ners" from white people.