I am not personally worried much, though I think that may say as much about my temperament as it does about Trump. I'm incredibly worried on behalf of other people, though. And I feel sick about what kind of a world my son is going to inherit.
My only personal/selfish concern is that Trump will ruin the economy just as we are retiring, and our savings will disappear, leaving us broke, old and with no job possibilities. That's not anywhere close to happening right now, of course. And I don't fret about it much, because it probably won't happen and if it does, well...then we'll just have to cope like everyone else.
I guess things could get so bad that people with our history (between Indonesia and Egypt, we've spent over 2 decades in predominantly Islamic countries) are banned/harrassed somehow, but even in my wildest dreams I can't see that happening.