Believe it or not, that little "o" is an artistic statement. The designer of the reverse side of the one-cent piece, Frank Gasparra, simply preferred the look of the little "o" alongside the big "F."
http://www.essortment.com/all/historypenny_rmor.htm