You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the bug
Attempting to open a URL through OpenDCS abstractweb source formatted as shefit does not work but does work for shef.e formatted pages. OpenDCS will open the URL if shefmode=False or if shefmode=True. If header=shef in the source, it will attempt to read the URL and error out because of the formatting. If header=other in the source, it will not open the URL.
Error as follows:
INFO 12/18/24 19:06:40 WebDataSource Opening 'https://www.ameren.com/api/ameren/Hydroelectric/getDailyShefitGMTReport?interval=1h'
DBG3 12/18/24 19:06:42 scanForMessage oneMessageFile=true, mediumId=null
DBG3 12/18/24 19:06:42 SHEF Station name='BAGLAMUE20241217060000'
DBG3 12/18/24 19:06:42 SHEF Station Time='0'
WARNING 12/18/24 19:06:42 Invalid time-zone '0' in SHEF message ignored, using UTC.
DBG3 12/18/24 19:06:42 SHEF Time Zone = UTC
DBG3 12/18/24 19:06:42 SHEF Header Length set to 29
FAILURE 12/18/24 19:06:42 StreamDataSource Failed to parse header: decodes.datasource.HeaderParseException: Invalid date field in SHEF message '0' -- message file is invalid.
DBG3 12/18/24 19:06:42 scanForMessage oneMessageFile=true, mediumId=null
WARNING 12/18/24 19:06:42 RoutingSpec(Ameren-WebService) WebAbstractDataSource cannot open 'https://www.ameren.com/api/ameren/Hydroelectric/getDailyShefitGMTReport?interval=1h': decodes.datasource.D
ataSourceEndException: Stream EOF.
Go back to source and set header = other.
Run rs on source and see error.
WebAbstractDataSource cannot open 'https://www.ameren.com/api/ameren/Hydroelectric/getDailyShefitGMTReport?interval=1h': java.lang.NullPointerException
java.lang.NullPointerException
at decodes.db.TransportMedium.makeTmKey(TransportMedium.java:332)
at decodes.db.PlatformList.findPlatform(PlatformList.java:228)
at decodes.db.PlatformList.getPlatform(PlatformList.java:154)
at decodes.datasource.StreamDataSource.makePlatformAssociation(StreamDataSource.java:637)
at decodes.datasource.StreamDataSource.getRawMessage(StreamDataSource.java:552)
at decodes.datasource.WebAbstractDataSource.getRawMessage(WebAbstractDataSource.java:209)
at decodes.routing.RoutingSpecThread.run(RoutingSpecThread.java:435)
Expected behavior
Expect to be able to open and parse the URL as plain text or have more flexible shef assumptions so the URL can be opened.
Desktop/ServerSide (please complete the following information):
OS: Windows client v7.0.1
Server: v6.8
The text was updated successfully, but these errors were encountered:
jbatterman
changed the title
Abstract Web Source - shefmode assumptions too rigid to open URL
Abstract Web Source - shef assumptions too rigid to open URL
Jan 10, 2025
Describe the bug
Attempting to open a URL through OpenDCS abstractweb source formatted as shefit does not work but does work for shef.e formatted pages. OpenDCS will open the URL if shefmode=False or if shefmode=True. If header=shef in the source, it will attempt to read the URL and error out because of the formatting. If header=other in the source, it will not open the URL.
To Reproduce
Steps to reproduce the behavior:
Add new abstractweb source with URL = https://www.ameren.com/api/ameren/Hydroelectric/getDailyShefitGMTReport?interval=1h
Set shefmode = True or False
Set header = shef
Run rs on source and see log.
Error as follows:
INFO 12/18/24 19:06:40 WebDataSource Opening 'https://www.ameren.com/api/ameren/Hydroelectric/getDailyShefitGMTReport?interval=1h'
DBG3 12/18/24 19:06:42 scanForMessage oneMessageFile=true, mediumId=null
DBG3 12/18/24 19:06:42 SHEF Station name='BAGLAMUE20241217060000'
DBG3 12/18/24 19:06:42 SHEF Station Time='0'
WARNING 12/18/24 19:06:42 Invalid time-zone '0' in SHEF message ignored, using UTC.
DBG3 12/18/24 19:06:42 SHEF Time Zone = UTC
DBG3 12/18/24 19:06:42 SHEF Header Length set to 29
FAILURE 12/18/24 19:06:42 StreamDataSource Failed to parse header: decodes.datasource.HeaderParseException: Invalid date field in SHEF message '0' -- message file is invalid.
DBG3 12/18/24 19:06:42 scanForMessage oneMessageFile=true, mediumId=null
WARNING 12/18/24 19:06:42 RoutingSpec(Ameren-WebService) WebAbstractDataSource cannot open 'https://www.ameren.com/api/ameren/Hydroelectric/getDailyShefitGMTReport?interval=1h': decodes.datasource.D
ataSourceEndException: Stream EOF.
Go back to source and set header = other.
Run rs on source and see error.
WebAbstractDataSource cannot open 'https://www.ameren.com/api/ameren/Hydroelectric/getDailyShefitGMTReport?interval=1h': java.lang.NullPointerException
java.lang.NullPointerException
at decodes.db.TransportMedium.makeTmKey(TransportMedium.java:332)
at decodes.db.PlatformList.findPlatform(PlatformList.java:228)
at decodes.db.PlatformList.getPlatform(PlatformList.java:154)
at decodes.datasource.StreamDataSource.makePlatformAssociation(StreamDataSource.java:637)
at decodes.datasource.StreamDataSource.getRawMessage(StreamDataSource.java:552)
at decodes.datasource.WebAbstractDataSource.getRawMessage(WebAbstractDataSource.java:209)
at decodes.routing.RoutingSpecThread.run(RoutingSpecThread.java:435)
Expected behavior
Expect to be able to open and parse the URL as plain text or have more flexible shef assumptions so the URL can be opened.
Desktop/ServerSide (please complete the following information):
The text was updated successfully, but these errors were encountered: