Aluminum frames are built stiffer because aluminum has no stress tolerance before cyclic fatigue occurs. So by making the frame stiffer, the less its affected by alternating stress.
Steel is going to absorb the bumps better due to its higher elasticity (ability to spring back). Aluminum under stress either causes fatigue (stress over time eventually ending in breaking, cracking) or plastic deformation (being permanantly mis-shapen).
That's why you see larger diameter aluminum tubes because its stiffer. Some bike frames are put together under tension as well to increase rigidity. Frame geometry is important too for comfort.
But for the average rider/hobbyist I'd say you could only go wrong by pairing an aluminum frame with aluminum mag wheels and having no suspension and while riding on rough roads.
Just pick whatever frame looks cool
.