I immediately see the problem, I forgot to delete the inside faces. Now that I've got duplicate edges and vertices on top of each other, any idea on how to delete them without history?

I feel like such an idiot.