Can I disable Agent Assistance in Collaborate chat?

Yes. To disable Agent Assistance access for a user, remove the permission Chat > Agentassistance > Access from the user’s role.