One thing to be cautious about, along the same lines of using a motor kill switch or one of the new electronic proximity-sensing kill switches to stop the vessel’s engine if you fall overboard. Your trolling motor has the ability to either propel your boat (sometimes at a respectable speed) or keep it stationary in a moving current. If you were to fall overboard while using the trolling motor to move around, or fall into a current that your TM is stemming, you run the risk of the boat moving away from you/you moving away from the boat. It’s a much slower speed than when using the outboard, but even catching up to a boat that’s only moving 2kts is much harder than you’d think it would be. Most people aren’t going to be able to swim at 2kts for any significant amount of time, especially wearing heavy winter fishing gear, with an inflated life vest, in cold water, etc. If the remote is around your neck, you can at least stop the motor so that the boat will drift with you in the current; you might even be able to steer it back to come pick you up! If it’s sitting on the console, however, you’re not going to have that option.
I get not liking it around your neck, but having it in a pocket, or clipped to your life vest, might not be a bad idea.