It is not sex per se - your identification with the body is the impediment to your spiritual growth.