You don't have to keep him in the crate all the time, but if you aren't going to be paying attention to him, aka playing, feeding, or some other activity, it's usually best. Because it only takes a few seconds to decide to go potty and you need to be supervigilant for the signs (sniffing around, mostly). So, not all the time, but if you are doing something where you can't pay attention like cooking dinner, it is probably best to crate him. Good luck!!!