The stars of "Modern Family" really disappointed this year ... but they weren't alone!