Obama is a natural single term guy. As natural as a terrible economy. Or poor results in Afghanistan. Remember of 41st President? Liberated Kuwait, got spending limits in and lost the election. Imagining Obama as a one term guy is as reasonable as can be. If you ever observed any previous one term Presidents anyway.
Recession can kill an administration, and many DC careers.