Reading the handbook I found out that the adventure starts not from that point u once left and saved but from the town you have reached.