Have Been Using "shoulder Bolts" In Mine With No Problems. You Can also Buy Bronze Bushing For Shoulder Bolts With Or Without A Collar.
Star Washer/washer`s Can Be Added To One Or Both Side`s Of Threaded Part Of Shoulder Bolt for added locking in position. Shoulder bolts Cost A Couple Bucks. Many size`s and lengths available.
Get mine from "Mc Master Carr.com" . Shipping is less than $5. for most of my orders, often have order the next day UPS.
As you can see in the pic, you can just buy the bushing to match the thickness of you tensioner metal and space it with washer`s for chain or belt alignment. Many hardware stores may stock them. If you don`t burn over a gallon of gas !! lol.
Ron