Whitney Port's Husband Admits His Concern Over Her Weight Was Aesthetic