You have to ask what Patterson's motivation would be for leaving. And the question has nothing to do with the perception by some that big name coaches wouldn't want to come to this program. I think Auburn is a top 10 coaching destination no matter how you slice it.
But where Patterson is concerned, he's the winningest coach in TCU history. (155-54) I have no clue about the Horny Toad fanbases' mindset, but I imagine he has god-like status. In addition, he's making $4.75 million per year. He's top 5 right now and undefeated.
So, what's the incentive to come to Auburn? He's 57. One last challenge?