I would not say doing more becaome irritating at all... just that to box a lower gear bard wont be much help at all. Like you said boting a bard is easy...boxing one takes some work to get to where it can acctually help. The difference in boting and boxing I am trying to say is boting is just haveing around to augment the group with buffs and such but boxing would be making it part of the group to actually do something.
Without gear your going to basically be boting the bard with maybe doing a few pulls with it but if you get it geared up you could pull some stuff just going to be tough. Again try it out see what you can do before you put work into it and figure out if you like it. Your not going to be able to tank/heal something that will give you decent xp as dps will be low and very mana entensive.. cant slow right off the bat otherwise bard looses agro...shaman heals are nice and all but... not a cleric or druid quite so little low on healing there then bards arent very good tanks either as far as mitigation goes. From what i have see clerics and bards are just about equal in mitigation but bards look for more defensive stuff so go up a little.