For my second playthrough, I refused to allow Minutemen in my base. I kicked everyone out of the Drive-in, and made my home there.
I haven't visited Preston after the initial quests were finished, and I wasted more junk than I care to admit to make sure that the defenses in Sanctuary were the best I could build.
The entire quest line from him will be the last things I do