Best is downtown to the west of Penn Station. It's a pretty small section, but safe and as 'upscale' as it gets there. Corporate headquarters (incl. Audible), a lot of nice rentals, and shopping like Whole Foods. Also, reasonably convenient (for Newark) to get to and an easy jump into NYC.