My parents' house versus my house provides nearly this exact scenario, with my parents' being bigger but more remote and mine being in a neighborhood I really like. Having experienced both, I would absolutely stay where I am if I had the choice. Being close to my neighbors, friends, and activities is more important to me than extra size/niceness.