In 1976, the property at Main and Bunker Hill Streets was a rubble-strewn lot owned by the Boston Redevelopment Authority (BRA). The site had been cleared as part of Boston's 1960–70s Urban Renewal. The City's plan to construct a school on the site did not go forward, and the property began to attract unsavory uses. A handful of residents cleared enough land for a few vegetable plots, and the Garden was born.

Carrying water from the Fire Station across the street, these hardy urban gardeners tended their plots and planted the lovely borders. In 1981, a Model Gardens Grant from the City funded an irrigation system. Over the next few years, the gardeners built a tool shed and plastic greenhouse.

During this period, the organization attained 501(c)(3) non-profit status as Gardens for Charlestown (GfC). Funds were raised through plant sales, contributions, events, development mitigation funds and grants. The brick patio was built and is now used for programs, events and cookouts during the season. In 1993, the Garden became the first wheelchair accessible garden in Massachusetts.

In 1995, Mayor Thomas Menino and the BRA deeded the property to Gardens for Charlestown with the proviso it remain open space or revert back to the City of Boston. This made it easier for the fledgling non-profit to apply for grants.

​