I suspect the problem needs to be solved with Criteria so that the summarized results are actually filtered out; more layers of grouping doesn't seem to actually hide the summarized results from the Workflow condition. Those individual results rolled up into the summary are still considered part of the results, and so the workflow triggers.