The followers of an unheard-of-god from another land followed omens that led them to you. The omens indicate that you are to be the mate of an avatar (earthly incarnation) of their god. You disagree but are still harassed by the god's followers.
Rivalry: A rival to you or your family cause upheaval forcing you to relocate possibly to a far distant land. (Work with your DM to detirmine the details)
As an adult you joined a rebellion against the local ruler, if successful you are outlawed, if it failed you escape, with only friends and family knowing your involvement. (Work with your DM to detirmine the details)