This may be impossible, easy, or there may be a plugin, but I cannot find out. I am working with 32x32 and 64x64 tiles in photoshop - thus I am zoomed in to max size 100% of the time. Is there ANY way to setup a live preview window on the side of the image image, live as I edit it, which shows how the image will look in actual pixel size?

On the top menu go to Window -> Arrange -> New Window for [document name].

You can then view one window zoomed in to 1600% and the other at 100%, as you like.

You can arrange your layers tab to show icons, which would be about the size you're looking for. I've never really thought about this, since I've gotten into the habit of zooming in and out really quickly.