Personally I keep mine with me 24/7. It maybe ok to have keys hidden away in another room. But if your house gets turned over by a crim and they find the keys, it maybe a bit hard to explain to the locals that your guns have been taken from a locked safe because they found the keys.
Be on the "safe" side and keep them with you at all times.