In terms of actual numbers, no. Our new house and our former house are essentially the same size (only 30 sq ft different).
Relatively speaking, yes. In our old neighborhood in the Seattle area, our house was average size. Here in our new neighborhood, we have the 2nd smallest house. I had hoped to downsize, but that would have meant a condo or garden home. That is what happens when you move to the "Everything is bigger in" state.
In between houses, we downsized big-time, to a 1BR apt where we not only lived but DH had his office there too.
cschin4, you may enjoy this book:
Amazon.com: Downsizing Your Home with Style: Living Well In a Smaller Space (9780061170973): Lauri Ward: Books