The Collaborative International Dictionary of English v.0.48:

Acrostically \A*cros"tic*al*ly\, adv.
   After the manner of an acrostic.
   [1913 Webster]