No you don't...the most play you can have without having issues is one inch so you're most definitely fine. Adding any more tension could possibly pop or break a rivet. If the chain stretches or loosens for some reason, or you want to get a chain tensioner, I highly recommend a spring-tensioner that you mount on your engine. They always keep the chain straight, reduces wear, and tends to have much better acceleration than a standard tensioner that comes with 99% of motor kits.