Easier to keep the noise level down by drilling some 5/16" holes in the "baffle" pipe, about four to six at 60 degrees to each other, and clean up the flash on the holes after drilling to keep the flow smooth.
i ran my engine without a baffle for a good 4 months of daily use, no after effects at all (it ran better actually, and idled great!)
i ended up welding a 3/4 pipe fitting on the end of the pipe (to adapt a screw on style muffler, mainly because neighbors were complaining about noise) ended up working great!
long story short. no i shouldn't affect anything (though your results may very)