I remember my mother using this idea for refreshments at a bridal shower but used sherbet in the bride's chosen colors (more pastels used then!). Once the cake was filled, returned to the freezer and then sliced for serving. Was pretty and very nice, esp for a summer event.
(Meant to post this with the quote about using fresh fruit for the filling.)