Allerijl is not found outside this expression and represents a contraction of aller, a fossilized dative form of al, and ijl.
in allerijl