by someone's side
• close to someone, especially so as to give them comfort or moral support.
• "a stepson who stayed by your side when your own son deserted you"
on one's side
• operating to one's advantage.
• "now that he had time on his side, Tom relaxed a little"