Middleburg Memorial Cemetery was incorporated in 1938, when the trustees bought seven acres for a new cemetery. Norris Royston's undertaking parlor, established in 1932, assumed responsibility for upkeep of the burial grounds in 1958. The older, traditional stones are in plots numbered 1-143. To keep the view from Federal Street open, grave markers west of the Baptist Church, with the higher numbers, are ground level bronze plaques.