Turns out that the bracket that holds the caliper in place is rubbing on the rotor. I have no idea how to fix it, I tried washers to change the spacing but it offered no help, I also tried some light fileing, and maybe with a grinder i can make things work but idk.... might be time to take it to a shop....