Would this cause more lag than having all handlers in a single class and only registering a single file?
For the same plugin, more than one listener at the same priority of the same event, not too good. But if it is necessary for you, say, if you are doing something like sub-plugins (ref: https://github.com/LegionPE/LegionPE-Eta look at the games namespace), it can be appropriate.