Uploaded image for project: 'ONOS'
  1. ONOS
  2. ONOS-577

java.lang.ArrayIndexOutOfBoundsException during Hazelcast event processing

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed (View Workflow)
    • Priority: Minor
    • Resolution: Done
    • Affects Version/s: 1.1.0
    • Fix Version/s: 1.1.0
    • Component/s: None
    • Labels:
      None
    • Environment:

      commit f044d8a70863b10f8db564dbd54bbcc3bc9d091c

      Description

      This exception was seen on 6 of 7 ONOS nodes in a cluster. I have not been able to reproduce this.

      2015-01-08 14:26:24,853 | ERROR | nce_1_HA.event-3 | EventServiceImpl | 52 - com.hazelcast - 3.3.2 | [10.128.30.17]:5701 [HA] [3.3.2] hz._hzInstance_1_HA.event-3 caught an exception while processing task:EventPacketProcessor

      {eventPacket=null}

      com.esotericsoftware.kryo.KryoException: java.lang.ArrayIndexOutOfBoundsException: -1756380248
      Serialization trace:
      topic (org.onosproject.cluster.Leadership)
      subject (org.onosproject.cluster.LeadershipEvent)
      at com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:125)[56:com.esotericsoftware.kryo:3.0.0]
      at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:528)[56:com.esotericsoftware.kryo:3.0.0]
      at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:704)[56:com.esotericsoftware.kryo:3.0.0]
      at com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:106)[56:com.esotericsoftware.kryo:3.0.0]
      at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:528)[56:com.esotericsoftware.kryo:3.0.0]
      at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:786)[56:com.esotericsoftware.kryo:3.0.0]
      at org.onlab.util.KryoNamespace.deserialize(KryoNamespace.java:303)[69:org.onosproject.onlab-misc:1.1.0.SNAPSHOT]
      at org.onosproject.store.serializers.KryoSerializer.decode(KryoSerializer.java:57)[156:org.onosproject.onos-core-serializers:1.1.0.SNAPSHOT]
      at org.onosproject.store.cluster.impl.HazelcastLeadershipService.onMessage(HazelcastLeadershipService.java:197)[155:org.onosproject.onos-core-dist:1.1.0.SNAPSHOT]
      at com.hazelcast.topic.impl.TopicService.dispatchEvent(TopicService.java:135)[52:com.hazelcast:3.3.2]
      at com.hazelcast.spi.impl.EventServiceImpl$EventPacketProcessor.process(EventServiceImpl.java:537)[52:com.hazelcast:3.3.2]
      at com.hazelcast.spi.impl.EventServiceImpl$RemoteEventPacketProcessor.run(EventServiceImpl.java:617)[52:com.hazelcast:3.3.2]
      at com.hazelcast.util.executor.StripedExecutor$Worker.process(StripedExecutor.java:189)[52:com.hazelcast:3.3.2]
      at com.hazelcast.util.executor.StripedExecutor$Worker.run(StripedExecutor.java:173)[52:com.hazelcast:3.3.2]
      Caused by: java.lang.ArrayIndexOutOfBoundsException: -1756380248
      at java.util.ArrayList.elementData(ArrayList.java:418)[:1.8.0_25]
      at java.util.ArrayList.get(ArrayList.java:431)[:1.8.0_25]
      at com.esotericsoftware.kryo.util.MapReferenceResolver.getReadObject(MapReferenceResolver.java:42)[56:com.esotericsoftware.kryo:3.0.0]
      at com.esotericsoftware.kryo.Kryo.readReferenceOrNull(Kryo.java:830)[56:com.esotericsoftware.kryo:3.0.0]
      at com.esotericsoftware.kryo.Kryo.readObjectOrNull(Kryo.java:753)[56:com.esotericsoftware.kryo:3.0.0]
      at com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:113)[56:com.esotericsoftware.kryo:3.0.0]
      ... 13 more

        Attachments

        1. HATestSanity-ONOS1-karaf.log
          291 kB
        2. HATestSanity-ONOS2-karaf.log
          226 kB
        3. HATestSanity-ONOS3-karaf.log
          205 kB
        4. HATestSanity-ONOS4-karaf.log
          195 kB
        5. HATestSanity-ONOS5-karaf.log
          201 kB
        6. HATestSanity-ONOS6-karaf.log
          193 kB
        7. HATestSanity-ONOS7-karaf.log
          192 kB
        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

            Assignee:
            Unassigned
            Reporter:
            jhall Jon Hall
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: