Skip to content
This repository has been archived by the owner on Jun 14, 2020. It is now read-only.

Windows memory error #33

Open
agvineet opened this issue Dec 4, 2018 · 0 comments
Open

Windows memory error #33

agvineet opened this issue Dec 4, 2018 · 0 comments

Comments

@agvineet
Copy link

agvineet commented Dec 4, 2018

python -m qas.adam -vv "When was linux kernel version 4.0 released ?"
C:\Program Files (x86)\Python37-32\lib\site-packages\gensim\utils.py:1212: UserWarning: detected Windows; aliasing chunkize to chunkize_serial
warnings.warn("detected Windows; aliasing chunkize to chunkize_serial")
[2018-12-03 20:28:22] DEBUG:main:Thinking...
I think what you want to know is: When was linux kernel version 4.0 released ?
....
....
[2018-12-03 20:29:34] DEBUG:qas.esstore.es_operate:Article Updated:updated
[2018-12-03 20:29:34] DEBUG:qas.wiki.wiki_parse:Parsed content length: 992
[2018-12-03 20:29:34] INFO:qas.wiki.wiki_parse:Inserted parsed content for: 24845611
[2018-12-03 20:29:34] DEBUG:qas.esstore.es_operate:{'query': {'bool': {'must': [{'multi_match': {'query': 'linux kernel version 4.0 release', 'type': 'most_fields', 'fields': ['content', 'content_info', 'content_table']}}], 'should': [], 'must_not': []}}}
[2018-12-03 20:29:34] DEBUG:root:Ranked Wiki Pages Title: ['Linux kernel', 'Linux', 'Kernel-based Virtual Machine', 'Linux kernel interfaces', 'Paint.net', 'Release early, release often', 'Creative Commons license', '4.0', 'Software release life cycle', 'Jeff Bridges']
[2018-12-03 20:29:34] INFO:main:Pages retrieved: 10
Traceback (most recent call last):
File "C:\Program Files (x86)\Python37-32\lib\runpy.py", line 193, in _run_module_as_main
"main", mod_spec)
File "C:\Program Files (x86)\Python37-32\lib\runpy.py", line 85, in _run_code
exec(code, run_globals)
File "C:\Vineet\Python\adam_qas\qas\adam.py", line 286, in
run()
File "C:\Vineet\Python\adam_qas\qas\adam.py", line 282, in run
main(sys.argv[1:])
File "C:\Vineet\Python\adam_qas\qas\adam.py", line 275, in main
answer = qas.process_answer()
File "C:\Vineet\Python\adam_qas\qas\adam.py", line 128, in process_answer
self.candidate_answers, keywords = get_candidate_answers(self.query, wiki_pages, self.nlp)
File "C:\Vineet\Python\adam_qas\qas\candidate_ans.py", line 122, in get_candidate_answers
en_doc = en_nlp(u'' + combined_document_str)
File "C:\Program Files (x86)\Python37-32\lib\site-packages\spacy\language.py", line 346, in call
doc = proc(doc)
File "nn_parser.pyx", line 338, in spacy.syntax.nn_parser.Parser.call
File "nn_parser.pyx", line 401, in spacy.syntax.nn_parser.Parser.parse_batch
File "nn_parser.pyx", line 730, in spacy.syntax.nn_parser.Parser.get_batch_model
File "nn_parser.pyx", line 85, in spacy.syntax.nn_parser.precompute_hiddens.init
File "C:\Program Files (x86)\Python37-32\lib\site-packages\spacy_ml.py", line 149, in begin_update
self.W.reshape((self.nFself.nOself.nP, self.nI)).T)
MemoryError

Environment

python -m qas.sys_info
System: Windows
Platform: 10.0.17134
Python: 3.7.1
Elasticsearch: (6, 3, 1)
Elasticsearch Mapping: {'settings': {'number_of_shards': 1, 'number_of_replicas': 0, 'analysis': {'filter': {'english_stop': {'type': 'stop', 'stopwords': 'english'}, 'english_porter2': {'type': 'stemmer', 'language': 'porter2'}}, 'analyzer': {'adam_analyzer': {'type': 'custom', 'tokenizer': 'standard', 'filter': ['lowercase', 'english_stop', 'english_porter2']}}}}, 'mappings': {'article': {'_meta': {'version': 2}, 'properties': {'title': {'type': 'text', 'analyzer': 'adam_analyzer'}, 'updated': {'type': 'date'}, 'raw': {'type': 'object', 'enabled': 'false'}, 'content': {'type': 'text', 'analyzer': 'adam_analyzer'}, 'content_info': {'type': 'text', 'analyzer': 'adam_analyzer'}, 'content_table': {'type': 'text', 'analyzer': 'adam_analyzer'}, 'revision': {'type': 'long'}}}}}

* Question you were trying to ask: Exception as shown above.
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant