* Wai-Kwong Sam LEE
| I am writing an application which takes a text and tokenizes it and do 
| some other things. I store the tokens in a list at top level.

if the input text is in a string, that might explain it.

| However, when the input text is very long, say, 45k, the tail of the text
| is not tokenized.  When the input text is even longer, say, 100k, ACL
| prompts me error msg like stack overflow.

evaluate (apropos "LIMIT" :cl) and look at the values of the various array
limits.  they might be smaller than you think.

| It *seems* that my list of tokens is too long.  Does anyone have any
| suggestion how to get around?

I find it unlikely that lists can get too long, but I have experienced
serious crashes and days of wasted time with strings longer than 32K.

#\Erik