Family Drama 2 weeks before the wedding

So to start off, I decided to have an intimate ceremony with about 20 people to begin with and then a reception for the rest of my family later on. My guests got mad that I was only inviting just them, so I then compromised to have plus ones. I had an exception though: my dad was not allowed to bring his gf. She had been telling me lies about how he was beating her and doing drugs for months, and it was clearly a lie because my dad usually works 24/7, and he couldn’t hold a job if he was doing things like that. He does have a past with addiction and abuse, so I believed her for a while. However, when I realized this wasn’t true, I told my dad about it, and he just told me to overlook it. A few weeks later I told him I wasn’t comfortable with her being at my wedding, so he went off on me and I blocked him. He has gone off on me several times and we’ve always had a bad relationship. He’s always been extremely emotionally and verbally abusive. Since then, me and fiancé were kicked out of our house by our aunt who is now not coming to the wedding, my sister went off because I asked if she’d be okay if I had a child free wedding (just asked) and she’s not coming, and now my grandparents are taking my dads side even though they’ve read the messages he’s sent me and they’re not coming. I’ve compromised a lot, but there are some things I really don’t want to. This was supposed to be just for people I felt close to to witness our marriage. Now everyone’s mad that I want to have a small, peaceful wedding. How do I deal with this? I’m getting ready to call it off and just elope.