I don't believe the address table is accessible on it's own. Your code sample looks like it's loading the customer and then finding the address to remove. That is on the right track, keep going with it.