Why Hilary Duff Now Feels More Comfortable Saying ‘No’