I have a friend that adopted a little girl from China. We live in an area with a vibrant China town and so my friend was able to have her daughter involved in activities from her home culture. Her daughter took Chinese dance classes and cooking classes. There were also other parents from our area that adopted from China at the same time so they both have a support group that understand their situation.
I have had the same thoughts that you have on many occasions. By American standards we don't have a lot but we have enough and I have often thought about how we can share it with a child in need. If you and your husband are on the same page I encourage you to go for it. If the international thing doesn't work out, don't forget that there are many school aged children in America in need of a better situation.