According to the Rockdale Council website, Dolls Point was considered uninhabitable by early Europeans. The origins of the name are unclear but legend has it that it was named for an escaped convict who took shelter in the grim landscape to hide from the authorities.
Dolls Point is the sandy part. The green land across the water is Towra Point.