I want to spend more time with my family, but I'm not sure they want to spend more time with me.
or simply: