You could remove it to the specific templates?

For this to truely work, you will need application events.
You need to detect when a document is created/opened, then you need to check
the attached template, if it belongs to your list, display the toolbar,
otherwise hide it. Then, becasue a user may work with many documents at once,
all based, maybe, on different templates, you also need to detect when the
user changes from document to document and display/hide the toolbar as
appropriate. I have done something like this in the past and I can assure you
that it is not trivial. For someone who has experience with VBA and
Application events, it is not difficult, but it does take some time as a fair
amount of code has to be written and checked.

If you are a VBA beginner, this is quite a challenge! In any case, since you
need to go through Application Events, you may want to find out about them,
start here:
  http://word.mvps.org/faqs/macrosvba/AppClassEvents.htm

Hi Matthias

Both Graham and Jean-Guy have given you parts of the answer, but they have
complicated things a bit.

Proceed as follows:

For each template whose documents you want to display to the toolbar, copy
the toolbar from your global template to the document template.

When you have done this, delete the toolbar from your global template.

The toolbar will now only be visible when a document based on one of those
individual templates is active. The buttons will work as normal, provided
that the global template is loaded as an add-in. The best way to do that is
for the global template to be put in the startup folder so it is loaded when
Word is started.

That really is all there is to it.

You can then if you wish customise the toolbar for each individual template,
removing buttons that aren't needed for that document type.