Uploaded image for project: 'ONOS'
  1. ONOS
  2. ONOS-1162

Hazelcast exceptions under load

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed (View Workflow)
    • Priority: Critical
    • Resolution: Done
    • Affects Version/s: 1.0.0, 1.0.1
    • Fix Version/s: 1.1.0
    • Component/s: None
    • Labels:
    • Environment:

      8eb4d3acdf0e42586f94108a55dac282d32b68e9

      Description

      2015-02-23 19:14:28,955 | WARN | event-dispatch-0 | BasicMapContextQuerySupport | 53 - com.hazelcast - 3.4.0 | [192.168.200.201]:5701 [beast] [3.4] Could not get results
      java.util.concurrent.ExecutionException: com.hazelcast.spi.exception.TargetNotMemberException: Not Member! target:Address[192.168.200.203]:5701, partitionId: -1, operation: com.hazelcast.map.impl.operation.QueryOperation, service: hz:impl:mapService
      at com.hazelcast.spi.impl.BasicInvocationFuture.resolveApplicationResponseOrThrowException(BasicInvocationFuture.java:343)[53:com.hazelcast:3.4.0]
      at com.hazelcast.spi.impl.BasicInvocationFuture.get(BasicInvocationFuture.java:194)[53:com.hazelcast:3.4.0]
      at com.hazelcast.spi.impl.BasicInvocationFuture.get(BasicInvocationFuture.java:173)[53:com.hazelcast:3.4.0]
      at com.hazelcast.map.impl.BasicMapContextQuerySupport.getQueryResult(BasicMapContextQuerySupport.java:329)[53:com.hazelcast:3.4.0]
      at com.hazelcast.map.impl.BasicMapContextQuerySupport.addResultsOfPredicate(BasicMapContextQuerySupport.java:316)[53:com.hazelcast:3.4.0]
      at com.hazelcast.map.impl.BasicMapContextQuerySupport.query(BasicMapContextQuerySupport.java:227)[53:com.hazelcast:3.4.0]
      at com.hazelcast.map.impl.proxy.MapProxySupport.query(MapProxySupport.java:1060)[53:com.hazelcast:3.4.0]
      at com.hazelcast.map.impl.proxy.MapProxyImpl.entrySet(MapProxyImpl.java:584)[53:com.hazelcast:3.4.0]
      at com.hazelcast.map.impl.proxy.MapProxyImpl.entrySet(MapProxyImpl.java:568)[53:com.hazelcast:3.4.0]
      at org.onosproject.store.hz.SMap.entrySet(SMap.java:421)[152:org.onosproject.onos-core-dist:1.1.0.SNAPSHOT]
      at org.onosproject.store.mastership.impl.DistributedMastershipStore.getDevices(DistributedMastershipStore.java:193)[152:org.onosproject.onos-core-dist:1.1.0.SNAPSHOT]
      at org.onosproject.cluster.impl.MastershipManager.getDevicesOf(MastershipManager.java:179)[150:org.onosproject.onos-core-net:1.1.0.SNAPSHOT]
      at org.onosproject.cluster.impl.MastershipManager$InternalClusterEventListener.event(MastershipManager.java:323)[150:org.onosproject.onos-core-net:1.1.0.SNAPSHOT]
      at org.onosproject.cluster.impl.MastershipManager$InternalClusterEventListener.event(MastershipManager.java:286)[150:org.onosproject.onos-core-net:1.1.0.SNAPSHOT]
      at org.onosproject.event.AbstractListenerRegistry.process(AbstractListenerRegistry.java:63)[74:org.onosproject.onos-api:1.1.0.SNAPSHOT]
      at org.onosproject.event.impl.CoreEventDispatcher$DispatchLoop.run(CoreEventDispatcher.java:95)[150:org.onosproject.onos-core-net:1.1.0.SNAPSHOT]
      at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)[:1.8.0_31]
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)[:1.8.0_31]
      at java.lang.Thread.run(Unknown Source)[:1.8.0_31]
      Caused by: com.hazelcast.spi.exception.TargetNotMemberException: Not Member! target:Address[192.168.200.203]:5701, partitionId: -1, operation: com.hazelcast.map.impl.operation.QueryOperation, service: hz:impl:mapService
      at com.hazelcast.spi.impl.BasicInvocation.initInvocationTarget(BasicInvocation.java:327)
      at com.hazelcast.spi.impl.BasicInvocation.doInvoke(BasicInvocation.java:253)
      at com.hazelcast.spi.impl.BasicInvocation.run(BasicInvocation.java:614)
      at com.hazelcast.spi.impl.BasicTargetInvocation.run(BasicTargetInvocation.java:29)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)[:1.8.0_31]
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)[:1.8.0_31]
      at java.lang.Thread.run(Thread.java:745)[:1.8.0_31]
      at com.hazelcast.util.executor.HazelcastManagedThread.executeRun(HazelcastManagedThread.java:76)
      at com.hazelcast.util.executor.HazelcastManagedThread.run(HazelcastManagedThread.java:92)
      at ------ End remote and begin local stack-trace ------.(Unknown Source)
      at com.hazelcast.spi.impl.BasicInvocationFuture.resolveApplicationResponse(BasicInvocationFuture.java:387)
      at com.hazelcast.spi.impl.BasicInvocationFuture.resolveApplicationResponseOrThrowException(BasicInvocationFuture.java:320)
      ... 18 more

      ————————

      2015-02-23 19:38:27,385 | WARN | _beast.migration | InternalPartitionService | 53 - com.hazelcast - 3.4.0 | [192.168.200.202]:5701 [beast] [3.4] Failed migration from Member [192.168.200.203]:5701
      java.util.concurrent.ExecutionException: com.hazelcast.spi.exception.TargetNotMemberException: Not Member! target:Address[192.168.200.203]:5701, partitionId: 6, operation: com.hazelcast.partition.impl.MigrationRequestOperation, service: hz:core:partitionService
      at com.hazelcast.spi.impl.BasicInvocationFuture.resolveApplicationResponseOrThrowException(BasicInvocationFuture.java:343)[53:com.hazelcast:3.4.0]
      at com.hazelcast.spi.impl.BasicInvocationFuture.get(BasicInvocationFuture.java:194)[53:com.hazelcast:3.4.0]
      at com.hazelcast.spi.impl.BasicInvocationFuture.get(BasicInvocationFuture.java:173)[53:com.hazelcast:3.4.0]
      at com.hazelcast.partition.impl.InternalPartitionServiceImpl$MigrateTask.executeMigrateOperation(InternalPartitionServiceImpl.java:1696)[53:com.hazelcast:3.4.0]
      at com.hazelcast.partition.impl.InternalPartitionServiceImpl$MigrateTask.run(InternalPartitionServiceImpl.java:1665)[53:com.hazelcast:3.4.0]
      at com.hazelcast.partition.impl.InternalPartitionServiceImpl$MigrationThread.processTask(InternalPartitionServiceImpl.java:1803)[53:com.hazelcast:3.4.0]
      at com.hazelcast.partition.impl.InternalPartitionServiceImpl$MigrationThread.doRun(InternalPartitionServiceImpl.java:1779)[53:com.hazelcast:3.4.0]
      at com.hazelcast.partition.impl.InternalPartitionServiceImpl$MigrationThread.run(InternalPartitionServiceImpl.java:1756)[53:com.hazelcast:3.4.0]
      Caused by: com.hazelcast.spi.exception.TargetNotMemberException: Not Member! target:Address[192.168.200.203]:5701, partitionId: 6, operation: com.hazelcast.partition.impl.MigrationRequestOperation, service: hz:core:partitionService
      at com.hazelcast.spi.impl.BasicInvocation.initInvocationTarget(BasicInvocation.java:327)
      at com.hazelcast.spi.impl.BasicInvocation.doInvoke(BasicInvocation.java:253)
      at com.hazelcast.spi.impl.BasicInvocation.run(BasicInvocation.java:614)
      at com.hazelcast.spi.impl.BasicTargetInvocation.run(BasicTargetInvocation.java:29)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)[:1.8.0_31]
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)[:1.8.0_31]
      at java.lang.Thread.run(Thread.java:745)[:1.8.0_31]
      at com.hazelcast.util.executor.HazelcastManagedThread.executeRun(HazelcastManagedThread.java:76)
      at com.hazelcast.util.executor.HazelcastManagedThread.run(HazelcastManagedThread.java:92)
      at ------ End remote and begin local stack-trace ------.(Unknown Source)
      at com.hazelcast.spi.impl.BasicInvocationFuture.resolveApplicationResponse(BasicInvocationFuture.java:387)
      at com.hazelcast.spi.impl.BasicInvocationFuture.resolveApplicationResponseOrThrowException(BasicInvocationFuture.java:320)
      ... 7 more

        Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

            Assignee:
            madan Madan Jampani
            Reporter:
            bocon Brian O'Connor
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: