I see where Virginia allows for growing of 4 plants, possession of up to an ounce, and a $25 fine for possession over an ounce and under a pound. So at harvest time, most folks would wander into $25 fine territory.
Practically speaking, from experience here in Michigan going from medical to recreational, I don't think police will conduct 4 AM raids over the possibility of somebody possessing over an ounce and under a pound. Prior to recreational legalization, police would raid medical growers, steal their homes and personal property, and leave them out on a curb in the cold -- then you'd have to prove in court that you qualified for a medical exemption then sue to get your property back. I do believe that one reason we ended up with recreational cannabis is that police were abusing the medical law. Courts started getting tired of it, and so did the public. Now, "I thought I smelled cannabis" is no longer probable cause to ruin somebody's life.
Good luck to you!