Originally Posted by QuiltE

Oh please do not use glue on something that could/should be edible!

Instead of glue ... melt some sugar in an electric frying pan.
Then dip the edges of the graham crackers into the melted sugar.

This way you have fully edible houses and everyone can enjoy it, when you are finished using it for decoration.