The actor also insisted that while we should be careful, we should also "live our lives"