The second of those lines can be parsed two different ways; the key difference is "is breaking," which could be either a linking verb and a gerund or a present progressive verb. The different grammatical structures create different meanings for the line. Parsed as a linking verb and a gerund, "breaking my heart" is the "fault." That line could be rendered as "This fault = breaking my heart." Parsed as a present progressive verb though, the fault itself isn't named*; the significance is only that it's affecting the speaker/singer. As a simple present tense (instead of progressive), it could be rendered as "This fault breaks my heart."
I think the second parsing (as a present progressive) has a slight advantage in that it doesn't specifically name the fault, almost as if the singer/speaker doesn't want to deal with it. Instead of naming the fault, a few positive qualities are mentioned in the immediately-preceding lines:
You have two beautiful eyes
Eyes that I idolize
You have such charms in your tressesI also mention this so I can point out the almost-palindromic assonance with "eyes"/"-ize" and "I"/"i-" in "Eyes that I idolize."
Two perfect arms for caresses
---
*I should note that it isn't named in that section. The fault itself seems to be in the title and the first lines: "Too many irons in the fire / And there's too many loves you desire."