Ledger is just physical device that interfaces with the blockchain network of the token you hold, your seed phrases would get you back into your ledger live on another physical ledger device. If your family has your seed phrases they can get back into ledger live and send it from your wallet to an exchange to sell it.