It's best not to use small envelopes. Fold A4 paper in half and just put it in, which looks generous.
Of course, there is no need to use a larger size. White or cowhide envelopes will do, not fancy envelopes.
Pay attention to the requirements of the magazine. If you have any special requirements, you must not miss them.