It'll require the attributes and statistics being recalculated every time a character is used, which isn't great. Can't exactly avoid it though: moving and changing weapon are both likely to alter them, and people rarely attack without doing one or the other.
Since it's applied to all damage types, 'base' defense points are much more valuable than defense points that are only applied when facing a specific element.