There is no reason to believe that the Holy Spirit ever leaves awakened sinners, only as they leave the truth of God for some error or sin.