Jedi on sublimeText3 too slow. #276

onebits · 2018-11-10T15:10:45Z

When I typing code. It's very lagging...
For example:
content = res.content.decode('utf-8')
When I typing these code, on first "c" its lag.. res. its lag..
How to fix it ???
not a large file.
Look when i typing res.

onebits · 2018-11-10T15:15:53Z

I found new info on console:

Traceback (most recent call last):
File "C:\Program Files\Sublime Text 3\sublime_plugin.py", line 685, in on_query_completions
res = vel.on_query_completions(prefix, locations)
File "C:\Users\jeeyong\AppData\Roaming\Sublime Text 3\Packages\Jedi - Python autocompletion\sublime_jedi\completion.py", line 154, in on_query_completions
location=locations[0]
File "C:\Users\jeeyong\AppData\Roaming\Sublime Text 3\Packages\Jedi - Python autocompletion\sublime_jedi\daemon.py", line 83, in ask_daemon_with_timeout
return request.result(timeout=timeout)
File "./python3.3/concurrent/futures/_base.py", line 403, in result
concurrent.futures._base.TimeoutError

srusskih · 2018-11-12T17:23:28Z

yeap, I can reproduce it :)

import requests

resp = requests.get('http://google.com')
resp.c

will try to measure/debug what is wrong

srusskih · 2018-11-12T17:24:13Z

PS:

import requests

resp: requests.Response = requests.get('http://google.com')
resp.c

with type hinting it works much faster :) 🏇 😱

Aero-fish · 2018-11-12T20:06:18Z

I think there are some bugs with type hinting. Jedi is also not able to autocomplete the following code:

v: List[str] = []
v.   # No autocomplete

srusskih · 2018-11-13T07:25:30Z

@Aero-fish I think you issue related to davidhalter/jedi/issues/1096

onebits · 2018-11-14T12:25:31Z

PS:
import requests

resp: requests.Response = requests.get('http://google.com')
resp.c
with type hinting it works much faster :) 🏇 😱

I still think this problem has something to do with this matter:

File "C:\Users\jeeyong\AppData\Roaming\Sublime Text 3\Packages\Jedi - Python autocompletion\sublime_jedi\daemon.py", line 83, in ask_daemon_with_timeout
return request.result(timeout=timeout)
File "./python3.3/concurrent/futures/_base.py", line 403, in result
concurrent.futures._base.TimeoutError

srusskih · 2018-11-15T13:24:12Z

@onebits can you try measure latency with jedi lib?

srusskih · 2018-12-12T12:06:17Z

@onebits I have added a extra logging (would be available in master soon) and what I found during checking the case:

2018-12-11 16:37:59,394 INFO   - Jedi - Python autocompletion.sublime_jedi.completion:144 - on_query_completions() - JEDI completion triggered.
2018-12-11 16:37:59,395 INFO   - Jedi - Python autocompletion.sublime_jedi.daemon:168 - request() - Sending request to daemon for "autocomplete"
2018-12-11 16:37:59,395 DEBUG  - Jedi - Python autocompletion.sublime_jedi.daemon:169 - request() - ('autocomplete', {}, '', 3, 3)
2018-12-11 16:37:59,396 DEBUG  - parso.python.diff:128 - update() - diff parser start
2018-12-11 16:37:59,397 DEBUG  - parso.python.diff:139 - update() - diff parser calculated
2018-12-11 16:37:59,397 DEBUG  - parso.python.diff:140 - update() - diff: line_lengths old: 4, new: 4
2018-12-11 16:37:59,397 DEBUG  - parso.python.diff:144 - update() - diff code[equal] old[1:3] new[1:3]
2018-12-11 16:37:59,397 DEBUG  - parso.python.diff:214 - _copy_from_old_parser() - diff actually copy 1 to 3
2018-12-11 16:37:59,397 DEBUG  - parso.python.diff:144 - update() - diff code[replace] old[4:4] new[4:4]
2018-12-11 16:37:59,398 DEBUG  - parso.python.diff:263 - _parse() - parse_part from 4 to 4 (to 3 in part parser)
2018-12-11 16:37:59,398 DEBUG  - parso.python.diff:173 - update() - diff parser end
2018-12-11 16:37:59,565 DEBUG  - parso.cache:120 - _load_from_file_system() - pickle loaded: /usr/local/lib/python3.6/site-packages/requests/models.py
2018-12-11 16:37:59,681 DEBUG  - parso.cache:120 - _load_from_file_system() - pickle loaded: /usr/local/lib/python3.6/site-packages/requests/sessions.py
2018-12-11 16:37:59,725 DEBUG  - parso.cache:120 - _load_from_file_system() - pickle loaded: /usr/local/lib/python3.6/site-packages/requests/hooks.py
2018-12-11 16:37:59,844 DEBUG  - parso.cache:120 - _load_from_file_system() - pickle loaded: /usr/local/lib/python3.6/site-packages/requests/adapters.py
2018-12-11 16:37:59,865 DEBUG  - parso.cache:120 - _load_from_file_system() - pickle loaded: /usr/local/lib/python3.6/site-packages/requests/_internal_utils.py
2018-12-11 16:37:59,925 DEBUG  - parso.cache:120 - _load_from_file_system() - pickle loaded: /usr/local/lib/python3.6/site-packages/requests/auth.py
2018-12-11 16:37:59,928 DEBUG  - parso.cache:120 - _load_from_file_system() - pickle loaded: /usr/local/lib/python3.6/site-packages/requests/certs.py
2018-12-11 16:38:00,018 DEBUG  - parso.cache:120 - _load_from_file_system() - pickle loaded: /usr/local/lib/python3.6/site-packages/requests/cookies.py
2018-12-11 16:38:00,032 DEBUG  - parso.cache:120 - _load_from_file_system() - pickle loaded: /usr/local/lib/python3.6/site-packages/requests/exceptions.py
2018-12-11 16:38:00,194 DEBUG  - parso.cache:120 - _load_from_file_system() - pickle loaded: /usr/local/lib/python3.6/site-packages/requests/utils.py
2018-12-11 16:38:00,207 DEBUG  - parso.cache:120 - _load_from_file_system() - pickle loaded: /usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/struct.py
2018-12-11 16:38:00,230 DEBUG  - parso.cache:120 - _load_from_file_system() - pickle loaded: /usr/local/lib/python3.6/site-packages/requests/compat.py
2018-12-11 16:38:00,239 DEBUG  - parso.cache:120 - _load_from_file_system() - pickle loaded: /usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/urllib/__init__.py
2018-12-11 16:38:00,428 DEBUG  - parso.cache:120 - _load_from_file_system() - pickle loaded: /usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/urllib/parse.py
2018-12-11 16:38:00,762 DEBUG  - parso.cache:120 - _load_from_file_system() - pickle loaded: /usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/collections/__init__.py
2018-12-11 16:38:00,894 DEBUG  - parso.cache:120 - _load_from_file_system() - pickle loaded: /usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/operator.py
2018-12-11 16:38:01,084 DEBUG  - parso.cache:120 - _load_from_file_system() - pickle loaded: /usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/os.py
2018-12-11 16:38:01,258 DEBUG  - parso.cache:120 - _load_from_file_system() - pickle loaded: /usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/_collections_abc.py
2018-12-11 16:38:01,478 DEBUG  - parso.cache:120 - _load_from_file_system() - pickle loaded: /usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/platform.py
2018-12-11 16:38:02,205 DEBUG  - parso.cache:120 - _load_from_file_system() - pickle loaded: /usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/urllib/request.py
2018-12-11 16:38:02,294 DEBUG  - parso.cache:120 - _load_from_file_system() - pickle loaded: /usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/re.py
2018-12-11 16:38:02,431 DEBUG  - parso.cache:120 - _load_from_file_system() - pickle loaded: /usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/sre_compile.py
2018-12-11 16:38:02,704 DEBUG  - parso.cache:120 - _load_from_file_system() - pickle loaded: /usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/socket.py
2018-12-11 16:38:02,767 DEBUG  - parso.cache:120 - _load_from_file_system() - pickle loaded: /usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/fnmatch.py
2018-12-11 16:38:02,955 DEBUG  - parso.cache:120 - _load_from_file_system() - pickle loaded: /usr/local/lib/python3.6/site-packages/requests/status_codes.py
2018-12-11 16:38:02,974 DEBUG  - parso.cache:120 - _load_from_file_system() - pickle loaded: /usr/local/lib/python3.6/site-packages/requests/structures.py
2018-12-11 16:38:03,165 DEBUG  - parso.cache:120 - _load_from_file_system() - pickle loaded: /usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/threading.py
2018-12-11 16:38:03,195 DEBUG  - parso.cache:120 - _load_from_file_system() - pickle loaded: /usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/_threading_local.py
2018-12-11 16:38:03,271 DEBUG  - parso.cache:120 - _load_from_file_system() - pickle loaded: /usr/local/lib/python3.6/site-packages/urllib3/__init__.py
2018-12-11 16:38:03,277 DEBUG  - parso.cache:120 - _load_from_file_system() - pickle loaded: /usr/local/lib/python3.6/site-packages/urllib3/util/__init__.py
2018-12-11 16:38:03,311 DEBUG  - parso.cache:120 - _load_from_file_system() - pickle loaded: /usr/local/lib/python3.6/site-packages/urllib3/util/url.py
2018-12-11 16:38:03,392 DEBUG  - parso.cache:120 - _load_from_file_system() - pickle loaded: /usr/local/lib/python3.6/site-packages/idna/__init__.py
2018-12-11 16:38:03,477 DEBUG  - parso.cache:120 - _load_from_file_system() - pickle loaded: /usr/local/lib/python3.6/site-packages/idna/core.py
2018-12-11 16:38:03,582 DEBUG  - parso.cache:120 - _load_from_file_system() - pickle loaded: /usr/local/lib/python3.6/site-packages/urllib3/packages/__init__.py
2018-12-11 16:38:03,632 DEBUG  - parso.cache:120 - _load_from_file_system() - pickle loaded: /usr/local/lib/python3.6/site-packages/urllib3/packages/ordered_dict.py
2018-12-11 16:38:03,688 DEBUG  - Jedi - Python autocompletion.sublime_jedi.daemon:182 - request() - Answer: [('close\tfunction', 'close'), ('content\tfunction', 'content'), ('cookies\tstatement', 'cookies')]
2018-12-11 16:38:03,688 INFO   - Jedi - Python autocompletion.sublime_jedi.completion:156 - on_query_completions() - Completion completed.
2018-12-11 16:38:03,689 DEBUG  - Jedi - Python autocompletion.sublime_jedi.completion:159 - on_query_completions() - Completions: [('close\tfunction', 'close'), ('content\tfunction', 'content'), ('cookies\tstatement', 'cookies')]

jedi spend most of it time in parso.cache :(

srusskih · 2018-12-27T11:09:47Z

please check a new release

walkinrain2008 · 2019-01-15T02:23:58Z

new version still slowly
when code is very large(more than 300 lines)

mew1033 · 2019-03-06T20:29:46Z

I'm still getting the slowdown too. @srusskih: Any ideas?

JeromeDesseaux · 2019-10-24T13:33:22Z

Still slow.

edelvalle · 2019-10-26T08:27:39Z

@srusskih should we make it async again? but ignore requests that were sent before the last one made?

JeromeDesseaux · 2019-10-28T17:42:53Z

@edelvalle if I can say something : I think it might be better async. Here, as soon as you type, the process is triggered after each letter. On the first letters of a word (in a project with some dependencies) you might notice that it takes quite a long time to process and let you type the second letter, then its the same again ... I think it might be interesting using async and a process like using a kind of search tree in which, for each letter, you store all the related nodes like a dictionary. Then the processing time might be reduced and an async called would be fast enough to display the results in time :)

edelvalle · 2019-10-28T18:46:34Z

A prefix tree?

srusskih · 2019-10-29T14:01:43Z

@JeromeDesseaux sound like a plan, but we do not control "search" (&caching) logic of jedi

async can help to avoid interface freez but it would recover other bug with "completion blinking" because ST3 completion non-sync by it neture.

we can try provide option to enable/disable async for those who need it...

srusskih · 2019-10-29T14:13:38Z

@JeromeDesseaux what you think about throttling on typing? to reduce a number of completion tries...

JeromeDesseaux · 2019-10-29T18:46:16Z

@srusskih to be honest : I never developed a sublime text extension. I admire all the people giving their time to do so! Really.

I have no idea how Sublime works for completion... but is it possible to "clean" the completion box content instead of redrawing it each time ? Like a blackboard or an eraser.

caph1993 · 2019-12-11T04:56:52Z

In my case, autocompletion works the first two or three times. After that, I get a timeout error and the autocompletion stops working entirely:

Traceback (most recent call last):
  File "/opt/sublime_text/sublime_plugin.py", line 701, in on_query_completions
    res = vel.on_query_completions(prefix, locations)
  File "/home/carlos/.config/sublime-text-3/Packages/Jedi - Python autocompletion/sublime_jedi/completion.py", line 162, in on_query_completions
    timeout=settings['completion_timeout']
  File "/home/carlos/.config/sublime-text-3/Packages/Jedi - Python autocompletion/sublime_jedi/daemon.py", line 84, in ask_daemon_with_timeout
    return request.result(timeout=timeout)
  File "./python3.3/concurrent/futures/_base.py", line 403, in result
concurrent.futures._base.TimeoutError

Is this due to this issue of speed?

SAPROYECTOSELECTRICOS · 2019-12-12T17:25:17Z

Hi, I have the same problem :/ . Have somebody found a solution to it? . I thank you in advance.

edelvalle · 2019-12-14T17:40:28Z

Well just made a PR #306 it should solve this problem.

srusskih mentioned this issue Nov 12, 2018

Jedi freezes ST and causes very high RAM usage. #271

Closed

edelvalle mentioned this issue Dec 14, 2019

Make the auto-completion asynchronous #306

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Jedi on sublimeText3 too slow. #276

Jedi on sublimeText3 too slow. #276

onebits commented Nov 10, 2018

onebits commented Nov 10, 2018

srusskih commented Nov 12, 2018

srusskih commented Nov 12, 2018

Aero-fish commented Nov 12, 2018

srusskih commented Nov 13, 2018

onebits commented Nov 14, 2018

srusskih commented Nov 15, 2018 •

edited

Loading

srusskih commented Dec 12, 2018 •

edited

Loading

srusskih commented Dec 27, 2018

walkinrain2008 commented Jan 15, 2019

mew1033 commented Mar 6, 2019

JeromeDesseaux commented Oct 24, 2019

edelvalle commented Oct 26, 2019

JeromeDesseaux commented Oct 28, 2019

edelvalle commented Oct 28, 2019 •

edited

Loading

srusskih commented Oct 29, 2019

srusskih commented Oct 29, 2019 •

edited

Loading

JeromeDesseaux commented Oct 29, 2019

caph1993 commented Dec 11, 2019

SAPROYECTOSELECTRICOS commented Dec 12, 2019

edelvalle commented Dec 14, 2019

Jedi on sublimeText3 too slow. #276

Jedi on sublimeText3 too slow. #276

Comments

onebits commented Nov 10, 2018

onebits commented Nov 10, 2018

srusskih commented Nov 12, 2018

srusskih commented Nov 12, 2018

Aero-fish commented Nov 12, 2018

srusskih commented Nov 13, 2018

onebits commented Nov 14, 2018

srusskih commented Nov 15, 2018 • edited Loading

srusskih commented Dec 12, 2018 • edited Loading

srusskih commented Dec 27, 2018

walkinrain2008 commented Jan 15, 2019

mew1033 commented Mar 6, 2019

JeromeDesseaux commented Oct 24, 2019

edelvalle commented Oct 26, 2019

JeromeDesseaux commented Oct 28, 2019

edelvalle commented Oct 28, 2019 • edited Loading

srusskih commented Oct 29, 2019

srusskih commented Oct 29, 2019 • edited Loading

JeromeDesseaux commented Oct 29, 2019

caph1993 commented Dec 11, 2019

SAPROYECTOSELECTRICOS commented Dec 12, 2019

edelvalle commented Dec 14, 2019

srusskih commented Nov 15, 2018 •

edited

Loading

srusskih commented Dec 12, 2018 •

edited

Loading

edelvalle commented Oct 28, 2019 •

edited

Loading

srusskih commented Oct 29, 2019 •

edited

Loading