Self-collimation of acoustic waves in the whole angular range of +/- 90 degrees. in the second and third bands of a two-dimensional rectangular sonic crystal with elliptical basis is demonstrated by examining the band structure and equifrequency contours. 70% and 77% of the second and third bands are available for wide-band all-angle self-collimation spanning a bandwidth of approximately 29% and 25% of the central frequencies of the all-angle self-collimation frequency ranges, respectively. Self-collimation of waves over large distances with a small divergence of beam width in the transverse direction is demonstrated through computations based on the finite element method. The second and third bands available for self-collimation are seen to vary linearly in the vast mid-range where a small group velocity dispersion prevents temporal divergence of waves with different frequencies.