Your people are past the peak of their prime. Social & economical decay has begun to set in. The government seems to have become self-perpetuating and careless to the people's needs. Previously common civil liberties and services are disappearing.
Well-to-Do: These are the upper end of the middle or merchant class in Barbarian and Civilized cultures. They typically own larger homes, have a household servant (a cook and/or a maid), have private transportation, and sometimes travel abroad.
Rivalry: A rival to you or your family cause upheaval forcing you to relocate possibly to a far distant land. (Work with your DM to detirmine the details)