In really fancy restaurants they never point to the bathroom, they just gesture toward the bathroom or they'll lead you to the bathroom. The fancier the restaurant, the less pointing there is.