err on the side of caution
• take a comparatively safe course of action when presented with a choice.
• "it is better for a doctor to err on the side of caution and follow the most restrictive view of the law"
err on the side of
• display more rather than less of (a specified quality) in one's actions.
• "it is better to err on the side of caution"