Entry to All Veterans Park is near the intersection of Pickett Street and Holmes Run Parkway. The park is found along the same linear stretch of parks that straddle the Holmes Run Stream and is on the south bank of Holmes Run, across from Brookvalley Park. The two parks are connected by the Charles Beatley Bridge which was dedicated in honor of Alexandria's former Mayor Beatley.

On the northern edge, the trail parallels the water of Holmes Run. An observation deck built on the bank can be used to view the Bi-Centennial Tree across the Run.

All Veterans Park has been adopted by the Alexandria Firefighters Inc.

In 1994, City Council renamed All Veterans Park to James H. Marx All Veterans Memorial Park.