I was there last year the week of Veteran's Day. We went on Monday and Tuesday and the parks were very empty. It was wonderful, even with an occasional light rain. We wore sweatshirts, but no coats, and had ponchos when needed.
By the end of the week, on the day before Veteran's Day, we noticed that lines for the park and in Downtown Disney were quite long. We weren't going to the parks on those days, because we were attending a conference. However, I was definately surprised at the difference in crowds. On the Veteran's Day weekend, it looked like the busy summer months.
We are going this year Nov. 6-11, and we are purposely leaving on the 11th. to avoid most of the crowds. Probably, the 9 and 10th. won't be so bad for you, but the 11th. and then the weekend might be more than you want to deal with, if you have a choice or can adjust your days.