If in the same situation, I would give Union City/West New York a look. We have family over there and have been there quite a bit.
First, I like the feel of the neighborhood. Its about a mile wide from the Hudson River to the edge of the Palisades, so you are never that far from the waterfront. Its built to human scale, very walkable and pleasant. The structures remind me a good deal of Williamsburg, most of it pre-war, though it doesn't have as much of an industrial feel to it.
Second, I like the commercial area, centered along Bergenline Avenue which runs up its spine. I go there to buy my linen clothing and love eating in the restaurants there (for the most authentic Cuban pastels north of Miami, goto Grand Via on 48th Street. Shamelessly cheap and shamelessly delicious). The commercial feel represents the neighborhood, which is much more Spanish orientated than JH east of 76th Street. A lot of shops do require a certain comfort with Spanish, which may be a sticking point for some, but for a silly monoglot like me, I sort of revel in it.
Third, I like the potential of the neighborhood. It was once a huge Cuban community, but much of that has been replaced by folks from other remnants of the Spanish Empire. That means that the housing prices are affordable (except along the water). Given its proximity to NYC, I can see home values going up in price in the semi-near future. Not having a direct subway connection makes this more difficult, but the bus service to the city is quick, cheap and frequent. The Hudson Bergen Light Rail does connect you quickly to Hoboken and from there the PATH gets you into the city. Overall, I can definitely see a good investment being made with a property purchase in the neighborhood.
As for other things, like the schools and crime, I cannot speak with too much certainty. My nephew went to the schools there and liked it. Crime in West New York used to be problematic, but from what I understand, its much more under control, much as some NYC neighborhoods.
Either way, good luck with your searching.