That seems like a likely explanation, although the island where I dive attracts very affluent tourists and there are effectively no Americans there either.

Were most of the people you met tourists or living in Malaysia?