[TEIID-5165] Infinispan hotrod translator fails with growing size of returned data

Type: Bug
Resolution: Done
Priority: Blocker
Fix Version/s: 8.12.11.6_4, 10.1
Affects Version/s: 8.12.11.6_4
Component/s: JDG Connector, Misc. Connectors
Labels:
None

Infinispan Hotrod translator fails depending on size of data returned.

I have a table with more than 5000 rows.

When I issue following query:

SELECT IntKey FROM BQT1.LargeA WHERE Intkey<4095

correct results are returned.

...

4094

When I issue:

SELECT IntKey FROM BQT1.LargeA WHERE Intkey<4096

following exception occurs and no results are returned:

12:27:56,933 ERROR [org.teiid.CONNECTOR] (Worker8_QueryProcessorQueue279) Connector worker process failed for atomic-request=+VUUR2vieWhT.59.0.46: java.util.NoSuchElementException
	at java.util.ArrayList$Itr.next(ArrayList.java:860) [rt.jar:1.8.0_151]
	at org.teiid.translator.infinispan.hotrod.InfinispanResponse.getNextRow(InfinispanResponse.java:106) [translator-infinispan-hotrod-8.12.11.6_4-redhat-7.jar:8.12.11.6_4-redhat-7]
	at org.teiid.translator.infinispan.hotrod.InfinispanQueryExecution.next(InfinispanQueryExecution.java:142) [translator-infinispan-hotrod-8.12.11.6_4-redhat-7.jar:8.12.11.6_4-redhat-7]
	at org.teiid.dqp.internal.datamgr.ConnectorWorkItem.handleBatch(ConnectorWorkItem.java:433) [teiid-engine-8.12.11.6_4-redhat-64-7.jar:8.12.11.6_4-redhat-64-7]
	at org.teiid.dqp.internal.datamgr.ConnectorWorkItem.more(ConnectorWorkItem.java:236) [teiid-engine-8.12.11.6_4-redhat-64-7.jar:8.12.11.6_4-redhat-64-7]
	at sun.reflect.GeneratedMethodAccessor170.invoke(Unknown Source) [:1.8.0_151]
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_151]
	at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_151]
	at org.teiid.dqp.internal.datamgr.ConnectorManager$1.invoke(ConnectorManager.java:211) [teiid-engine-8.12.11.6_4-redhat-64-7.jar:8.12.11.6_4-redhat-64-7]
	at com.sun.proxy.$Proxy79.more(Unknown Source)
	at org.teiid.dqp.internal.process.DataTierTupleSource.getResults(DataTierTupleSource.java:309) [teiid-engine-8.12.11.6_4-redhat-64-7.jar:8.12.11.6_4-redhat-64-7]
	at org.teiid.dqp.internal.process.DataTierTupleSource$1.call(DataTierTupleSource.java:112) [teiid-engine-8.12.11.6_4-redhat-64-7.jar:8.12.11.6_4-redhat-64-7]
	at org.teiid.dqp.internal.process.DataTierTupleSource$1.call(DataTierTupleSource.java:108) [teiid-engine-8.12.11.6_4-redhat-64-7.jar:8.12.11.6_4-redhat-64-7]
	at java.util.concurrent.FutureTask.run(FutureTask.java:266) [rt.jar:1.8.0_151]
	at org.teiid.dqp.internal.process.FutureWork.run(FutureWork.java:65) [teiid-engine-8.12.11.6_4-redhat-64-7.jar:8.12.11.6_4-redhat-64-7]
	at org.teiid.dqp.internal.process.DQPWorkContext.runInContext(DQPWorkContext.java:284) [teiid-engine-8.12.11.6_4-redhat-64-7.jar:8.12.11.6_4-redhat-64-7]
	at org.teiid.dqp.internal.process.ThreadReuseExecutor$RunnableWrapper.run(ThreadReuseExecutor.java:119) [teiid-engine-8.12.11.6_4-redhat-64-7.jar:8.12.11.6_4-redhat-64-7]
	at org.teiid.dqp.internal.process.ThreadReuseExecutor$3.run(ThreadReuseExecutor.java:210) [teiid-engine-8.12.11.6_4-redhat-64-7.jar:8.12.11.6_4-redhat-64-7]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [rt.jar:1.8.0_151]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [rt.jar:1.8.0_151]
	at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_151]

12:27:56,941 WARN  [org.teiid.PROCESSOR] (Worker7_QueryProcessorQueue282) TEIID30020 Processing exception for request +VUUR2vieWhT.59 'TEIID30504 jdg7-source: null'. Originally TeiidProcessingException ArrayList.java:860. Enable more detailed logging to see the entire stacktrace.

Please note, that this is not affected only by number of rows, also by number of columns. So we're hitting a size limit on whole result set (influence of data type size has not been confirmed).

This affects also DELETE operation, as selection is part of the operation.

blocks

CLOUD-2190 [JDV6.4] JDV/JDG infinispan-hotrod "DELETE FROM Foo" deletes only 4096 entries, blocks if more than 8192 entries in cache

Verified

RH Bugzilla Integration added a comment - 2018/02/14 1:52 PM

Debi Rieden <drieden@redhat.com> changed the Status of bug 1515197 from VERIFIED to CLOSED

RH Bugzilla Integration added a comment - 2018/02/14 1:52 PM Debi Rieden <drieden@redhat.com> changed the Status of bug 1515197 from VERIFIED to CLOSED

RH Bugzilla Integration added a comment - 2018/01/30 7:41 AM

Jan Stastny <jstastny@redhat.com> changed the Status of bug 1515197 from ON_QA to VERIFIED

RH Bugzilla Integration added a comment - 2018/01/30 7:41 AM Jan Stastny <jstastny@redhat.com> changed the Status of bug 1515197 from ON_QA to VERIFIED

RH Bugzilla Integration added a comment - 2017/12/19 9:46 AM

Van Halbert <vhalbert@redhat.com> changed the Status of bug 1515197 from ASSIGNED to MODIFIED

RH Bugzilla Integration added a comment - 2017/12/19 9:46 AM Van Halbert <vhalbert@redhat.com> changed the Status of bug 1515197 from ASSIGNED to MODIFIED

Van Halbert (Inactive) added a comment - 2017/11/21 1:43 PM - edited

I believe I do have a fix. And also appears that push down functions (like count) where failing because of this too.

Change that, only count works, non of the others work when a column is specified.

Van Halbert (Inactive) added a comment - 2017/11/21 1:43 PM - edited I believe I do have a fix. And also appears that push down functions (like count) where failing because of this too. Change that, only count works, non of the others work when a column is specified.

Van Halbert (Inactive) added a comment - 2017/11/21 1:23 PM

I think I have a fix. My initial test succeeded. I'm reinstalling and applying the patch again to confirm.

Van Halbert (Inactive) added a comment - 2017/11/21 1:23 PM I think I have a fix. My initial test succeeded. I'm reinstalling and applying the patch again to confirm.

Van Halbert (Inactive) added a comment - 2017/11/21 8:59 AM - edited

Think we've found the issue: https://issues.jboss.org/browse/JDG-1364

the following error is seen returned from the JDG server:
<vhalbert> afield, we're seeing this error: 08:41:26,831 DEBUG [org.infinispan.server.hotrod.HotRodExceptionHandler] (HotRodServerWorker-6-2) Exception caught: java.lang.NumberFormatException: For input string: "null"
<anistor> vhalbert: afield: this is what you want: https://github.com/infinispan/jdg/pull/1388
<afield> anistor: vhalbert: Yep, it's https://issues.jboss.org/browse/JDG-1364
<anistor> vhalbert: afield: unfortunatelly my fix came the day 711 became GA

Maybe its a different issue, but I'll go back thru this again, and if its different, i'll open a new jiar

Van Halbert (Inactive) added a comment - 2017/11/21 8:59 AM - edited Think we've found the issue: https://issues.jboss.org/browse/JDG-1364 the following error is seen returned from the JDG server: <vhalbert> afield, we're seeing this error: 08:41:26,831 DEBUG [org.infinispan.server.hotrod.HotRodExceptionHandler] (HotRodServerWorker-6-2) Exception caught: java.lang.NumberFormatException: For input string: " null " <anistor> vhalbert: afield: this is what you want: https://github.com/infinispan/jdg/pull/1388 <afield> anistor: vhalbert: Yep, it's https://issues.jboss.org/browse/JDG-1364 <anistor> vhalbert: afield: unfortunatelly my fix came the day 711 became GA Maybe its a different issue, but I'll go back thru this again, and if its different, i'll open a new jiar

Ramesh Reddy added a comment - 2017/11/20 8:42 PM

jstastny@redhat.com can you check if you can write a simple direct client to JDG using the CLI and see if the issue still exists?

Ramesh Reddy added a comment - 2017/11/20 8:42 PM jstastny@redhat.com can you check if you can write a simple direct client to JDG using the CLI and see if the issue still exists?

Assignee:: Van Halbert (Inactive)

Reporter:: Jan Stastny

Votes:: 0 Vote for this issue

Watchers:: 5 Start watching this issue

Created:: 2017/11/20 6:31 AM

Updated:: 2021/10/24 6:02 AM

Resolved:: 2018/01/03 8:25 AM

Details

Description

Attachments

Issue Links

Easy Agile Planning Poker

Activity

Collapse comment: RH Bugzilla Integration added a comment - 2018/02/14 1:52 PM

Expand comment: RH Bugzilla Integration added a comment - 2018/02/14 1:52 PM

Collapse comment: RH Bugzilla Integration added a comment - 2018/01/30 7:41 AM

Expand comment: RH Bugzilla Integration added a comment - 2018/01/30 7:41 AM

Collapse comment: RH Bugzilla Integration added a comment - 2017/12/19 9:46 AM

Expand comment: RH Bugzilla Integration added a comment - 2017/12/19 9:46 AM

Collapse comment: Van Halbert (Inactive) added a comment - 2017/11/21 1:43 PM, Edited by Van Halbert - 2017/11/21 1:54 PM

Expand comment: Van Halbert (Inactive) added a comment - 2017/11/21 1:43 PM, Edited by Van Halbert - 2017/11/21 1:54 PM

Collapse comment: Van Halbert (Inactive) added a comment - 2017/11/21 1:23 PM

Expand comment: Van Halbert (Inactive) added a comment - 2017/11/21 1:23 PM

Collapse comment: Van Halbert (Inactive) added a comment - 2017/11/21 8:59 AM, Edited by Van Halbert - 2017/11/21 9:02 AM

Expand comment: Van Halbert (Inactive) added a comment - 2017/11/21 8:59 AM, Edited by Van Halbert - 2017/11/21 9:02 AM

Collapse comment: Ramesh Reddy added a comment - 2017/11/20 8:42 PM

Expand comment: Ramesh Reddy added a comment - 2017/11/20 8:42 PM

People

Dates