Every fall, the neighborhood community garden slowly emptied as most people assumed the growing season was finally over.