Because Nell Pape loved gardening, Earle-Harrison House is surrounded by 5.82 fenced acres of manicured lawn and gardens. The relocated house was sited toward the gardens rather than facing 4th street as it originally did.
The gardens are an interpretation of how grand the garden could have been - and now is. Landscaping began with the restoration in 1969, but expansion of the garden occurred as adjacent land became available for purchase with most of the major development completed by 1980. Landscape architects Hal Stringer and J. Robert Anderson were Pape Gardens' principal designers.

The garden's formal and informal beds and garden rooms nestle into large expanses of lawn. Brick and concrete walkways allow guests to easily stroll the entire garden. A rare double gazebo and ancient live oak trees create an intimate shaded space perfect for gatherings, photography or solitary meditation. Other areas include azalea and rose beds, a variety of mature trees, formal statuary, a tiered fountain, and a kitchen garden.