Yes, it usually ends up making the most sense to just collect the stamps of your home country, since that's where they are the most plentiful.

Interestingly enough, I ended up with a lot of Australian stamps because my Godmother was Australian. Still have quite a few of them.