I've posted before about Eddie Gran coming and speaking to a men's group at our church years ago, but I think it bears repeating with regard to this debate. He was asked a smart ass question from someone in the audience, "When are y'all going to stop playing some of those high schools for OOC games?" Gran didn't shy away at all and his first response was "Bring on Buffalo". He said no one could really understand what playing in the SEC is like and how physical every week is. He said some players looked like they could barely walk by season's end because they were so beat up. He went on to say we need those games. We have to have those breaks for our players.
My thoughts have always been that if you're going to have 4 OOC games, make one against anyone from a legit BCS conference, as Auburn and Alabama both do every single year. Make another with someone a step down (Perception-wise) but with a recognizable enough name to generate some interest. Troy, Memphis, Houston, Tulane, SMU etc. The other 2 should be Alabama A&M and St. James or Marbury.