We decorate the outside (lightly) somewhere between Thanksgiving and New Years (and it comes down sometime between New Years and Halloween)
We decorate the inside about a week before Christmas and have it all down on New Years day.
No reason to make the agony any longer than it needs to be