Yes, you could very well lose connectivity. The problem with not updating the entries is that issues can occur if some IP destinations are blocked while others are not. This could manifest itself as either a complete loss of service or intermittent loss of service.