Is there a way to customize the task email alert that is sent? I would like to add the link(s) to the attachments that are included in the task.

You should look into system email templates. Setup > Company > Email > System Email Template