Studies show American students are becoming less proficient in math. Experts say we should have seen this coming, but nobody could put 2 and 2 together.