It depends on the pattern. If you are makin a One Block Wonder pattern with the extra panel in the middle, then I would not wash any of the panels. In OBW you have to stack and match the panel patterns accurately. If it was for a different pattern, if the other fabric was washed, I would wash the panel also. After washing, you may need to block the panel square since they are seldomly on square.