No individual anonymous participant can influence the prices and therefore you really can speculate in the market without paying attention to morality. That's one of the positive features of markets. That's why they function.