What kind of glue? I use Elmer's white washable liquid school glue with no problems. I put it on in tiny drops and either let dry or iron to dry faster before sewing. However, using the wrong kind of glue can create problems.
What is the brand and type of glue stick you are thinking of using?