Method run4doc([class gate.creole.ConditionalSerialAnalyserController, class gate.corpora.DocumentImpl]) does not exist ??

[robinjournet]

Hi everyone, and sorry for the barbaric title 🙇‍♂️

As you might have guessed, I obtain such an error

Method run4doc([class gate.creole.ConditionalSerialAnalyserController, class gate.corpora.DocumentImpl]) does not exist

After loading a pipeline and a corpus of XML documents in a list, I'm trying to process each documents with the method run4doc().

Here is the line with triggers the error with those around

for doc in CorpusDocsGate:
    doc = gw.load_gdoc(doc, mimetype="")
    print("\n"+str(gw.getPipelineNames())+":::"+str(gw.getDocumentNames())+"\n")
    # Which prints ['ListAPuce']:::['11546.xml_00017']
    input()
    # Until this line everything is working fine 
    gw.worker.run4doc(pipeline,doc)
    pdoc = gw.gdoc2pdoc(doc)
    gw.saveDocumentToFile(pdoc,doc,mimetype="")
    gw.worker.deleteResource(doc)

Full error message

Traceback (most recent call last):
  File "c:\Users\robin\Documents\Xxxxx\Python_Gate_NLP\test.py", line 70, in <module>       
    gw.worker.run4doc(pipeline,doc)
  File "C:\Users\robin\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\py4j\java_gateway.py", line 1309, in __call__
    return_value = get_return_value(
  File "C:\Users\robin\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\py4j\protocol.py", line 330, in get_return_value
    raise Py4JError(
py4j.protocol.Py4JError: An error occurred while calling t.run4doc. Trace:
py4j.Py4JException: Method run4doc([class gate.creole.ConditionalSerialAnalyserController, class gate.corpora.DocumentImpl]) does not exist
        at py4j.reflection.ReflectionEngine.getMethod(ReflectionEngine.java:318)
        at py4j.reflection.ReflectionEngine.getMethod(ReflectionEngine.java:326)
        at py4j.Gateway.invoke(Gateway.java:274)
        at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:132)
        at py4j.commands.CallCommand.execute(CallCommand.java:79)
        at py4j.GatewayConnection.run(GatewayConnection.java:238)
        at java.base/java.lang.Thread.run(Thread.java:834)


Java GatenlpWorker ENDING: 10580
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by py4j.reflection.MethodInvoker$1 (file:/C:/Users/robin/.m2/repository/net/sf/py4j/py4j/0.10.9/py4j-0.10.9.jar) to method java.util.ArrayList$Itr.next()WARNING: Please consider reporting this to the maintainers of py4j.reflection.MethodInvoker$1 
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release

Do you have any ideas on how to solve this issue, or what methods of the python-gatenlp plugin I can leverage to avoid using run4doc ?

Thanks a lot

[johann-petrak]

Could you please give all the details of your environment, Java version, gatenlp version, Python version, operating system and version. Also specify how you create all the variables involved in your problem, e.g. pipeline.
Also, when GateWorker is started, it should log various information about plugin versions, please include that as well.

I have tested this here with the most recent gatenlp version on Linux and it worked. With that version GateWorker has convenience methods like e.g. gw.run4Document so gw.run4Document(pipeline,doc) should also work (and did when I tried it).

It may also help to first try the same using a trivial case:

• load the prepared ANNIE pipeline and save as annie.xgapp
• create some minimal GATE document
• write a minimal program that loads the annie.xgapp pipeline, loads the document and runs the pipeline on that document.

[robinjournet]

Details of my environnement

Gatenlp version : 1.0.4

GATE version : 9.1-SNAPSHOT

JAVA version : openjdk version "11.0.10" 2021-01-19
OpenJDK Runtime Environment AdoptOpenJDK (build 11.0.10+9)
OpenJDK 64-Bit Server VM AdoptOpenJDK (build 11.0.10+9, mixed mode)

Python version: 3.9.5 (tags/v3.9.5:0a7dcbd, May 3 2021, 17:27:52) [MSC v.1928 64 bit (AMD64)]

I use windows 10.

Running a simple use case of gate worker and run4doc

| Code |

from gatenlp.gateworker import GateWorker
gs = GateWorker()
print("worker started")
pipeline = gs.worker.loadPipelineFromFile(r"C:\Users\robin\Documents\Xxxxx\SSDD\Gate\Enumeration\tests\application.xgapp")
print("pipeline loaded")
doc = gs.worker.createDocument("Some document text")
print("doc created")
gs.worker.run4doc(pipeline,doc)
print("pipeline running")
pdoc = gs.gdoc2pdoc(doc)
gs.worker.deleteResource(doc)

gs.close()
print("worker closed")

| prints and error message |

Trying to start GATE Worker on port=25333 host=127.0.0.1 log=false keep=false
Process id is 13192
PythonWorkerRunner.java: starting server with 25333/127.0.0.1/X-BLh7aLc6S_mjUUca53fzPpkgE/false
worker started
pipeline loaded
doc created
---------------------------------------------------------------------------
Py4JError                                 Traceback (most recent call last)
<ipython-input-1-1178d4c5a643> in <module>
      6 doc = gs.worker.createDocument("Some document text")
      7 print("doc created")
----> 8 gs.worker.run4doc(pipeline,doc)
      9 print("pipeline running")
     10 pdoc = gs.gdoc2pdoc(doc)

~\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\py4j\java_gateway.py in __call__(self, *args)
   1307 
   1308         answer = self.gateway_client.send_command(command)
-> 1309         return_value = get_return_value(
   1310             answer, self.gateway_client, self.target_id, self.name)
   1311 

~\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\py4j\protocol.py in get_return_value(answer, gateway_client, target_id, name)
    328                     format(target_id, ".", name), value)
    329             else:
--> 330                 raise Py4JError(
    331                     "An error occurred while calling {0}{1}{2}. Trace:\n{3}\n".
    332                     format(target_id, ".", name, value))

Py4JError: An error occurred while calling t.run4doc. Trace:
py4j.Py4JException: Method run4doc([class gate.creole.ConditionalSerialAnalyserController, class gate.corpora.DocumentImpl]) does not exist
	at py4j.reflection.ReflectionEngine.getMethod(ReflectionEngine.java:318)
	at py4j.reflection.ReflectionEngine.getMethod(ReflectionEngine.java:326)
	at py4j.Gateway.invoke(Gateway.java:274)
	at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:132)
	at py4j.commands.CallCommand.execute(CallCommand.java:79)
	at py4j.GatewayConnection.run(GatewayConnection.java:238)
	at java.base/java.lang.Thread.run(Thread.java:834)

Thank you very much

[johann-petrak]

I am sorry, my mistake to not realize this earlier, there is some incorrect documentation in the source code Pythondoc which will get corrected in the next version.

Could you please simply try using gs.run4Document(pipeline,doc) instead? This has been simplified in recent versions, see
https://gatenlp.readthedocs.io/en/latest/pythondoc/gatenlp/gateworker.html#gatenlp.gateworker.GateWorker.run4Document

You should also be able to use gs.createDocument("text")

The available methods are listed here, but please ignore the example included in the GateWorker documentation:
https://gatenlp.readthedocs.io/en/v1.0.4/pythondoc/gatenlp/gateworker.html#gatenlp.gateworker.GateWorker

[robinjournet]

Thank you a lot

Trying to start GATE Worker on port=25333 host=127.0.0.1 log=false keep=false
Process id is 20348
PythonWorkerRunner.java: starting server with 25333/127.0.0.1/6zdtOVETrs9NeeowA0ewEK7VwAw/false
worker started
pipeline loaded
doc created
pipeline running
worker closed
Java GatenlpWorker ENDING: 20348

Using run4Document instead of run4doc, it now works like a charm.