If you want to close a case, go on the Case Info tab and click the Close Case button:
Enter information for Outcome and Date Closed then click Save:
Closing a case (when no other cases are open for the same claim number) means that you will no longer receive updates from CAC about it.