Yes, I understand what you mean. You basically would make a 'whole cloth' crazy quilt. Start with a piece of muslin a few inches larger than the finished quilt top. If you want to use batting, you would need to baste the batting to the muslin very securely all over. Batting is up to you, many crazy quilts don't use it. If you can talk your husband into it, I would do without. Start in the middle, and baste your first piece down. Keep adding scraps using the sew & flip method, embellishing as you go. Sometimes you won't be able to cover an awkward join of 2 fabrics with a sew and flip. In this case you can fussy cut the correct shape and applique it over the join. Just keep adding fabric out to the edges.
Because of the bulk it obviously is much, much easier to do squares, but it can be done.