As far as I understand, you can't just close the case with the current Merge. It just takes the files/messages from the case being merged, sends it to the case you are merging to, and deletes the former record. I was thinking of replacing the action all together, creating a Suitelet that sets a case status to closed, and sends a message to the client with their new case number (number of the case merged to).