While tag libraries in the Web Project View may be expanded by the Context Menu->Expand, there is no expand button by default (see screenshot-1.png).
I am not sure is it a bug or a feature, but anyway Eclipse has a control (plus sign [+]) to expand nodes and we should not force users to use the context menu for this action.