I think you are correct. Is it too young to have seeds? They generally hang on. My sighting http://canberra.naturemapr.org/Community/Sightings/Details/3364488 shows flowers and fruit but you can also see the leaves.
Yes they are too young to have seeds and hopefully they will get the chop at our next woody weed working bee! There were some Box elder trees in adjacent gardens - Not sure they are still there.