Vicci,
Like ScamBuster said, you should come and look around to see what's up. The only thing good about Back Beach is easy accessibility to the beach. I would not swim in any water near Back Beach. If you come out right before dawn and observe, you will see many small fishing boats heading out to sea. These boats don't have toilet facilities, so don't be surprised to see solid waste floating around while you are swimming there. I had seen a few of them floating 2 feet from my face one time swimming there, and turned around in a hurry to swim back to shore and never went back there again. I liked the Petro House Hotel located between the market and Front Beach. The address is 63 Tran Hung Dao Street. This hotel is owned by Sumitomo of Japan. Right next door is a very nice French Vietnamese Restaurant. They serve great coffee and omelette in the morning. This hotel has a swimming poor inside the ground floor surrounded by trees.
The other one I also like is more for locals, but it's very good and economical. It's the OCAP Hotel, located up the hill with magnificent ocean view. It's located at 80 Ha Long Street Ward 2 Vung Tau. It's between Front Beach and Middle Beach (Bai Giua)Â
The front has a big patio with 2 picnic tables and benches. I like the Vietnamese Omelette (ApLa) and of course the Vietnamese slow dripped coffee. You can order it next door and they will bring to your picnic table at the patio with magnificent ocean view. The rooms are very spacious, clean and cheap. If you need to rent a motor bike, just tell the women at the counter. They will call someone to bring it over in no time. The service is very good also. I heard that this hotel is owned by an Overseas Vietnamese. As ScamBuster said, Front Beach is where the actions are anyway with beach front bars and cafes. For late night snack, I like the Pho Restaurant on Hoan Hoa Tham Street. This street ends at Back Beach, so if you turn from Back Beach on Hoan Hoa Tham, you will see it on the left. The locals like to snack there too. They serve fresh sugar cane juice drink also. I also like their breakfast dishes. Another good place for late night snack is the Chinese Noodle Soup shop located on Ba Cu Street, but I don't remember the street number (going away from Front Beach on Ba Cu for a while then you will see it on the left). You can ask a taxi driver to bring you there, because this place is unique so I expect the Taxi drivers to know and the entire town to know this place. This place is packed every time I went there for Hu Tieu Mi. The cook performs tricks when preparing your meal, so this is a bonus to you for free of charge. The father is a Teo Chew Man from China and just got old and retired, so his kids only speak Vietnamese but took care of their dad's secret recipe very well.
Enjoy the trip to Vung Tau.
Docwood