(deyim) If somebody tells you to cast your mind back on something, they want you to think about something that happened in the past, but which you might not remember very well, and to try to remember as much as possible
Be careful of the people around you, making certain that they do nothing to harm you: "I have to watch my back at work - there are a lot of people who would like my job."