I like your idea very much.
I have a feeling that once you get going on the years that you have the "definite" memories for, things will come to mind for the other years.
Maybe a wedding for another family member? When you got a pet? When the pet died? children's milestones? parents' anniversaries?
It's okay to just have a "plain" heart for the "just going along" years - nothing wrong with that !