可能会增加python处理正在使用的RAM数量
||
我在具有64GB RAM的Windows服务器上运行分类/功能提取任务，并且以某种方式，python认为我内存不足：
misiti@fff /cygdrive/c/NaiveBayes
$ python run_classify_comments.py > tenfoldcrossvalidation.txt
Traceback (most recent call last):
File \"run_classify_comments.py\", line 70, in <module>
run_classify_comments()
File \"run_classify_comments.py\", line 51, in run_classify_comments
NWORDS = get_all_words(\"./data/HUGETEXTFILE.txt\")
File \"run_classify_comments.py\", line 16, in get_all_words
def get_all_words(path): return words(file(path).read())
File \"run_classify_comments.py\", line 15, in words
def words(text): return re.findall(\'[a-z]+\', text.lower())
File \"C:\\Program Files (x86)\\Python26\\lib\\re.py\", line 175, in findall
return _compile(pattern, flags).findall(string)
MemoryError
没有找到相关结果
已邀请:
2 个回复
闲窍
def get_all_words(path): return sum((words(line) for line in open(path))诉嘎归亮