If an RA agent leaves the company, do I have to delete this RA agent immediately?

You can remove an RA agent by clicking the “Delete agent” button in the RA admin portal's RA agent entry.