You can't wait forever for an audience to get the joke, but you should give them at least two seconds to join in before you go on to the next one.