Yes. If you travelled from A to B faster than the speed of light so you arrived x seconds before the photons that left A at the same time as you, you would be able to look back at A and see it as it was x seconds before you left.
However given the speed at which light travels you would have to travel quite a distance to 'beat' light by even a second or two, so you would need a pretty impressive telescope to see anything interesting of where you just travelled from.
Obviously attempting to travel faster than light tends to vapourise the molecules of one's body well before the necessary breaking of Einstein's laws, but it is possible to see into the past just by looking at things far away, the further away the further into the past you are looking - photos have been taken of galaxies on the far side of the universe and the light that is reaching us now started its journey from those galaxies not long after the Big Bang.
If you wish to see into the past don't try faster-than-light travel, it is more cost-effective to order back-issues directly from New Scientist! And no, you can't see into the future by travelling in the opposite direction, so there's still no way of finding out the lottery numbers...