changed ICU chain to return all tokens, also those which became empty under normaliza...

changed ICU chain to return all tokens, also those which became empty under normalization. These might still have some display terms attached to them, which are to be used by the snippet display stuff or the scan term display stuff.