It sounds like you have not actually executed the merge to a new document,
but are just saving the mailmerge main document with a preview of the
results.

Best thing to do is enable the Mail Merge toolbar by selecting Toolbars from
the View menu and checking the Mail Merge item.  On the right hand end of
that toolbar is a button to execute the merge to a new document.  Do that
and then save the new document.