I went through the same process. As a fellow Canadian, I think black is the right choice. I'd rather be warm than cold is one reason. The other is trying to stay clean. Almost every rider I see with light or bright colours are grimy looking. Black won't be any cleaner, but it makes the dirt invisible.
We find the same with our snowmobile gear. I agree that visibility is the trade off, but that can be addressed with lighting on your bike if that is a concern.