Duress passwords are a known tactic. If an attacker thinks you use them, they have the incentive to beat them out of you. You'll find real world examples of this in Jameson Lopp's Known Physical Bitcoin Attacks Best to not have unilateral control of your funds and be ready to prove this to your attacker.