Hat/apron sound like great ideas.
You might also consider using some of that yarn that's kind of shredded looking (or something like the old "eye-lash" fabric) and give the duck
feathers.
That would give the baby something to play with!
Let us know what you end up doing.