Just put up a small fence inside your bigger yard. Don't just put them out, take them out. That way you will be able to protect them if need be. I have been taking my small dogs out for about 18-20 years ( a couple different sets). Praise them when they potty. If you are in the house, you won't know if they pottied or not.
They are absolutely darling.