His family are blaming me they aren't invited

His family is mad they aren't invited and blaming me. First off, He has adult children..his second marriage my first.
We choose to have a small wedding (50 people only including vendors with 8 parking spots) we made a big list then condensed it down to the spots we have left. His adopted daughter and I never have gotten along, but I left her in our maybe list. Then asked him if he had any family he wanted to invite he said his Aunt. He called her and she said she could come and he chose not to in this day because she'll (cause drama) his words not mine. Before invuwhere sent out I kept asking him.. anyone else anyone else. He said no but choose to invite his 3 best friends, their spouse and his son. He told me the rest are mine if I want them. Invites sent out, we did out engagement pics over the weekend and here comes the drama from his extended family and his daughter.... even his ex wife because of his daughter. His Aunt we asked who said no said he needed to invite his family, his cousin called cussed him out. His daughter mad. Hit freaking mess and blaming me for it when I left to choice to him. He said he only invited people he talks to..not drama. But now I'm in the hot seat. Insane. I know I can't change people's thoughts but just wanted to vent and didn't really want to stress him out more with how insane his extended family is acting.