Strange, I know I've seen weird inconsistencies with them in the past but I thought that was more to do with them stacking vertically rather than displaying the in the same row horizontally (but still all the same column). Maybe try setting the first field in each group as 'Column Break' so it doesn't try to impose its own breaks on it?