The first geocache in Australia was placed by Paul Edwards in Lane Cove National Park on 18 May 2000. Although the geocache was removed a year later, you can still visit the location and log a find as it is now a virtual.
Lane Cove (GC3E) by Paul Edwards
The next geocache in New South Wales was placed in Garigal National Park, near St Ives on 2 September 2000 — R&R (GC52) by Richard Ames (archived)
Three more geocaches were hidden in New South Wales in 2000: