Another one for Chuck's AEC box.
Then with Cecil Taylor you could also check out one of his solo discs, as for instance the great recent issue of his Willisau 2000 concert (on Intakt).
My Name Is Albert Ayler: a wonderful session including a great take on Gershwin's Summertime and some free playing, with a not free at all scandinavian rhythm section (who not always are up to the game). This could be a good start, somehow standing between free and more mainstream (but Ayler sounds somehow a little uncomfortable on a Charlie Parker tune).
Great recommendations all!
Maybe you could look for Don Cherry's "Complete Communion" (a recent Conoisseur), then return to Ornette.
ubu