Problem with antlr4 -Dlanguage=Python3 <the path where the grammar is located> -o <the folder where we save it> -visitor #4704

KseniaTya · 2024-09-27T23:18:09Z

KseniaTya
Sep 27, 2024

When I run the command "antlr4 -Dlanguage=Python3 (the path where the grammar is located) -o (the folder where we save it) -visitor" in the command line, I get an error:

Exception in thread "main" java.lang.IllegalArgumentException: newLimit > capacity: (88581596 > 33554432)
at java.base/java.nio.Buffer.createLimitException(Unknown Source)
at java.base/java.nio.Buffer.limit(Unknown Source)
at java.base/java.nio.ByteBuffer.limit(Unknown Source)
at java.base/java.nio.MappedByteBuffer.limit(Unknown Source)
at java.base/java.nio.MappedByteBuffer.limit(Unknown Source)
at java.base/jdk.internal.jimage.BasicImageReader.slice(Unknown Source)
at java.base/jdk.internal.jimage.BasicImageReader.readBuffer(Unknown Source)
at java.base/jdk.internal.jimage.BasicImageReader.getResourceBuffer(Unknown Source)
at java.base/jdk.internal.jimage.ImageReader.getResourceBuffer(Unknown Source)
at java.base/jdk.internal.module.SystemModuleFinders$SystemModuleReader.read(Unknown Source)
at java.base/jdk.internal.loader.BuiltinClassLoader.defineClass(Unknown Source)
at java.base/jdk.internal.loader.BuiltinClassLoader.findClassInModuleOrNull(Unknown Source)
at java.base/jdk.internal.loader.BuiltinClassLoader.findClass(Unknown Source)
at java.base/java.lang.ClassLoader.loadClass(Unknown Source)
at java.base/java.lang.Class.forName(Unknown Source)
at java.base/java.util.ServiceLoader.loadProvider(Unknown Source)
at java.base/java.util.ServiceLoader$ModuleServicesLookupIterator.hasNext(Unknown Source)
at java.base/java.util.ServiceLoader$2.hasNext(Unknown Source)
at java.base/java.util.ServiceLoader$3.hasNext(Unknown Source)
at java.base/sun.util.cldr.CLDRLocaleProviderAdapter$1.run(Unknown Source)
at java.base/sun.util.cldr.CLDRLocaleProviderAdapter$1.run(Unknown Source)
at java.base/java.security.AccessController.doPrivileged(Native Method)
at java.base/sun.util.cldr.CLDRLocaleProviderAdapter.(Unknown Source)
at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(Unknown Source)
at java.base/jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source)
at java.base/java.lang.reflect.Constructor.newInstance(Unknown Source)
at java.base/java.lang.Class.newInstance(Unknown Source)
at java.base/sun.util.locale.provider.LocaleProviderAdapter.forType(Unknown Source)
at java.base/sun.util.locale.provider.LocaleProviderAdapter.findAdapter(Unknown Source)
at java.base/sun.util.locale.provider.LocaleProviderAdapter.getAdapter(Unknown Source)
at java.base/java.text.DecimalFormatSymbols.getInstance(Unknown Source)
at java.base/java.util.Formatter.getZero(Unknown Source)
at java.base/java.util.Formatter.(Unknown Source)
at java.base/java.util.Formatter.(Unknown Source)
at java.base/java.lang.String.format(Unknown Source)
at org.antlr.v4.misc.CharSupport.getANTLRCharLiteralForChar(CharSupport.java:69)
at org.antlr.v4.tool.Grammar.getTokenDisplayName(Grammar.java:661)
at org.antlr.v4.tool.Grammar.getTokenDisplayNames(Grammar.java:786)
at org.antlr.v4.codegen.model.Recognizer.(Recognizer.java:81)
at org.antlr.v4.codegen.model.Lexer.(Lexer.java:28)
at org.antlr.v4.codegen.OutputModelController.lexer(OutputModelController.java:151)
at org.antlr.v4.codegen.OutputModelController.buildLexerOutputModel(OutputModelController.java:104)
at org.antlr.v4.codegen.CodeGenerator.generateLexer(CodeGenerator.java:92)
at org.antlr.v4.codegen.CodeGenPipeline.process(CodeGenPipeline.java:36)
at org.antlr.v4.Tool.processNonCombinedGrammar(Tool.java:409)
at org.antlr.v4.Tool.process(Tool.java:351)
at org.antlr.v4.Tool.processGrammarsOnCommandLine(Tool.java:318)
at org.antlr.v4.Tool.main(Tool.java:162)

How can I solve this problem?

Answered by kaby76

Sep 29, 2024

I recommend trying a fresh download of the Antlr4 tool jar (https://github.com/antlr/website-antlr4/blob/gh-pages/download/antlr-4.13.2-complete.jar) and call via your installed Java (java -jar antlr-4.13.2-complete.jar *.g4). Try first to see if it works for the Java target (skip -Dlanguage=Python3), then with the option. Another thing to try, remove your installed Java, and let the antlr4 tool do all the downloading of the .jar and a fresh JRE.

View full answer

ericvergnaud · 2024-09-28T07:38:44Z

ericvergnaud
Sep 28, 2024
Maintainer

Hi. Do you observe the same behavior when targeting a language other than Python ?

5 replies

KseniaTya Sep 28, 2024
Author

Try with Java/ Got^
error(31): ANTLR cannot generate java code as of version 4.13.2
Exception in thread "main" java.lang.NullPointerException
at org.antlr.v4.codegen.CodeGenerator.create(CodeGenerator.java:58)
at org.antlr.v4.analysis.LeftRecursiveRuleAnalyzer.(LeftRecursiveRuleAnalyzer.java:90)
at org.antlr.v4.analysis.LeftRecursiveRuleTransformer.translateLeftRecursiveRule(LeftRecursiveRuleTransformer.java:101)
at org.antlr.v4.analysis.LeftRecursiveRuleTransformer.translateLeftRecursiveRules(LeftRecursiveRuleTransformer.java:71)
at org.antlr.v4.semantics.SemanticPipeline.process(SemanticPipeline.java:71)
at org.antlr.v4.Tool.processNonCombinedGrammar(Tool.java:371)
at org.antlr.v4.Tool.process(Tool.java:359)
at org.antlr.v4.Tool.processGrammarsOnCommandLine(Tool.java:318)
at org.antlr.v4.Tool.main(Tool.java:162)

Then try with CSharp. Got the same error (like with Python):
Exception in thread "main" java.lang.IllegalArgumentException: newLimit > capacity: (88581596 > 33554432)
at java.base/java.nio.Buffer.createLimitException(Unknown Source)
at java.base/java.nio.Buffer.limit(Unknown Source)
at java.base/java.nio.ByteBuffer.limit(Unknown Source)
at java.base/java.nio.MappedByteBuffer.limit(Unknown Source)
at java.base/java.nio.MappedByteBuffer.limit(Unknown Source)
at java.base/jdk.internal.jimage.BasicImageReader.slice(Unknown Source)
at java.base/jdk.internal.jimage.BasicImageReader.readBuffer(Unknown Source)
at java.base/jdk.internal.jimage.BasicImageReader.getResourceBuffer(Unknown Source)
at java.base/jdk.internal.jimage.ImageReader.getResourceBuffer(Unknown Source)
at java.base/jdk.internal.module.SystemModuleFinders$SystemModuleReader.read(Unknown Source)
at java.base/jdk.internal.loader.BuiltinClassLoader.defineClass(Unknown Source)
at java.base/jdk.internal.loader.BuiltinClassLoader.findClassInModuleOrNull(Unknown Source)
at java.base/jdk.internal.loader.BuiltinClassLoader.findClass(Unknown Source)
at java.base/java.lang.ClassLoader.loadClass(Unknown Source)
at java.base/java.lang.Class.forName(Unknown Source)
at java.base/java.util.ServiceLoader.loadProvider(Unknown Source)
at java.base/java.util.ServiceLoader$ModuleServicesLookupIterator.hasNext(Unknown Source)
at java.base/java.util.ServiceLoader$2.hasNext(Unknown Source)
at java.base/java.util.ServiceLoader$3.hasNext(Unknown Source)
at java.base/sun.util.cldr.CLDRLocaleProviderAdapter$1.run(Unknown Source)
at java.base/sun.util.cldr.CLDRLocaleProviderAdapter$1.run(Unknown Source)
at java.base/java.security.AccessController.doPrivileged(Native Method)
at java.base/sun.util.cldr.CLDRLocaleProviderAdapter.(Unknown Source)
at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(Unknown Source)
at java.base/jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source)
at java.base/java.lang.reflect.Constructor.newInstance(Unknown Source)
at java.base/java.lang.Class.newInstance(Unknown Source)
at java.base/sun.util.locale.provider.LocaleProviderAdapter.forType(Unknown Source)
at java.base/sun.util.locale.provider.LocaleProviderAdapter.findAdapter(Unknown Source)
at java.base/sun.util.locale.provider.LocaleProviderAdapter.getAdapter(Unknown Source)
at java.base/java.text.DecimalFormatSymbols.getInstance(Unknown Source)
at java.base/java.util.Formatter.getZero(Unknown Source)
at java.base/java.util.Formatter.(Unknown Source)
at java.base/java.util.Formatter.(Unknown Source)
at java.base/java.lang.String.format(Unknown Source)
at org.antlr.v4.misc.CharSupport.getANTLRCharLiteralForChar(CharSupport.java:69)
at org.antlr.v4.tool.Grammar.getTokenDisplayName(Grammar.java:661)
at org.antlr.v4.tool.Grammar.getTokenDisplayNames(Grammar.java:786)
at org.antlr.v4.codegen.model.Recognizer.(Recognizer.java:81)
at org.antlr.v4.codegen.model.Lexer.(Lexer.java:28)
at org.antlr.v4.codegen.OutputModelController.lexer(OutputModelController.java:151)
at org.antlr.v4.codegen.OutputModelController.buildLexerOutputModel(OutputModelController.java:104)
at org.antlr.v4.codegen.CodeGenerator.generateLexer(CodeGenerator.java:92)
at org.antlr.v4.codegen.CodeGenPipeline.process(CodeGenPipeline.java:36)
at org.antlr.v4.Tool.processNonCombinedGrammar(Tool.java:409)
at org.antlr.v4.Tool.process(Tool.java:351)
at org.antlr.v4.Tool.processGrammarsOnCommandLine(Tool.java:318)
at org.antlr.v4.Tool.main(Tool.java:162)

kaby76 Sep 28, 2024

I think it's due to your environment. What OS are you running? Could you execute the following?

java --version
export | grep JAVA
lsb_release -a
df /tmp

KseniaTya Sep 29, 2024
Author

I use Windows 11 Version 23H2.

Result of java --version:
openjdk 11.0.24 2024-07-16
OpenJDK Runtime Environment Temurin-11.0.24+8 (build 11.0.24+8)
OpenJDK 64-Bit Server VM Temurin-11.0.24+8 (build 11.0.24+8, mixed mode)

kaby76 Sep 29, 2024

I recommend trying a fresh download of the Antlr4 tool jar (https://github.com/antlr/website-antlr4/blob/gh-pages/download/antlr-4.13.2-complete.jar) and call via your installed Java (java -jar antlr-4.13.2-complete.jar *.g4). Try first to see if it works for the Java target (skip -Dlanguage=Python3), then with the option. Another thing to try, remove your installed Java, and let the antlr4 tool do all the downloading of the .jar and a fresh JRE.

Answer selected by KseniaTya

KseniaTya Sep 29, 2024
Author

Removing installed Java, and let the antlr4 tool do all the downloading of the .jar and a fresh JRE turned out to be a solution. Thank you!

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Problem with antlr4 -Dlanguage=Python3 <the path where the grammar is located> -o <the folder where we save it> -visitor #4704

{{title}}

Replies: 1 comment 5 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

Problem with antlr4 -Dlanguage=Python3 <the path where the grammar is located> -o <the folder where we save it> -visitor #4704

KseniaTya Sep 27, 2024

Replies: 1 comment · 5 replies

ericvergnaud Sep 28, 2024 Maintainer

KseniaTya Sep 28, 2024 Author

kaby76 Sep 28, 2024

KseniaTya Sep 29, 2024 Author

kaby76 Sep 29, 2024

KseniaTya Sep 29, 2024 Author

KseniaTya
Sep 27, 2024

Replies: 1 comment 5 replies

ericvergnaud
Sep 28, 2024
Maintainer

KseniaTya Sep 28, 2024
Author

KseniaTya Sep 29, 2024
Author

KseniaTya Sep 29, 2024
Author