No significant societal gains, either technological, sociological or artistic are being made, or have been made in recent memory. Your culture has remained essentially as it is for generations. Rulers tend to emphasise maintaining the status quo.
Destitute: These people are considered the dregs of society. They own no property, and may have no fixed home. Some perform no real work and are often unemployable. Others are in bond to a master and live at his whim.
Other Relations: You were raised by a distant relative such as a Great Aunt/Uncle, Great Grandparent, Cousins or someone that claims to be a relation but has suspicious origins.
Civil Strife! Conflict broke out during your youth causing social upheaval, your family was involved in the conflict (Work with your DM to detirmine your families involvement)