Uploaded image for project: 'ONOS'
  1. ONOS
  2. ONOS-3565

Intent Installation/Reroute latency test failed at 3-node with exceptions

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed (View Workflow)
    • Priority: Blocker
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: 1.4.0
    • Component/s: None
    • Labels:
    • Environment:
    • Story Points:
      2
    • Epic Link:
    • Sprint:
      Dead Sprint (Emu Wrap-Up)

      Description

      2015-12-08 15:35:03,232 | WARN | copycat-p1-1 | FollowerState | 71 - org.onosproject.onlab-thirdparty - 1.4.0.SNAPSHOT | onos://10.254.1.201:9876 - Rejected AppendRequest[term=1, leader=onos://10.254.1.203:9876, logIndex=1, logTerm=1, entries=[0], firstIndex=false, commitIndex=null]: Previous index (1) is greater than the local log's last index (null)
      2015-12-08 15:35:03,356 | ERROR | l.NullProviders) | onos-null-provider | 171 - org.onosproject.onos-null-provider - 1.4.0.SNAPSHOT | [org.onosproject.provider.nil.NullProviders(106)] The modified method has thrown an exception
      org.onosproject.store.service.ConsistentMapException$ConcurrentModification
      at org.onosproject.store.consistent.impl.DefaultAsyncConsistentMap.lambda$null$96(DefaultAsyncConsistentMap.java:296)[145:org.onosproject.onos-core-dist:1.4.0.SNAPSHOT]
      at org.onosproject.store.consistent.impl.DefaultAsyncConsistentMap$$Lambda$374/695773759.apply(Unknown Source)[145:org.onosproject.onos-core-dist:1.4.0.SNAPSHOT]
      at java.util.concurrent.CompletableFuture$ThenApply.run(CompletableFuture.java:717)[:1.8.0_31]
      at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:193)[:1.8.0_31]
      at java.util.concurrent.CompletableFuture.internalComplete(CompletableFuture.java:210)[:1.8.0_31]
      at java.util.concurrent.CompletableFuture$WhenCompleteCompletion.run(CompletableFuture.java:1303)[:1.8.0_31]
      at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:193)[:1.8.0_31]
      at java.util.concurrent.CompletableFuture.internalComplete(CompletableFuture.java:210)[:1.8.0_31]
      at java.util.concurrent.CompletableFuture$ThenApply.run(CompletableFuture.java:723)[:1.8.0_31]
      at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:193)[:1.8.0_31]
      at java.util.concurrent.CompletableFuture.internalComplete(CompletableFuture.java:210)[:1.8.0_31]
      at java.util.concurrent.CompletableFuture$ThenApply.run(CompletableFuture.java:723)[:1.8.0_31]
      at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:193)[:1.8.0_31]
      at java.util.concurrent.CompletableFuture.internalComplete(CompletableFuture.java:210)[:1.8.0_31]
      at java.util.concurrent.CompletableFuture$AsyncApply.exec(CompletableFuture.java:507)[:1.8.0_31]
      at java.util.concurrent.CompletableFuture$Async.run(CompletableFuture.java:428)[:1.8.0_31]
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)[:1.8.0_31]
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)[:1.8.0_31]
      at java.lang.Thread.run(Thread.java:745)[:1.8.0_31]
      2015-12-08 15:35:12,753 | INFO | event-dispatch-0 | FlowObjectiveManager | 143 - org.onosproject.onos-core-net - 1.4.0.SNAPSHOT | Driver default bound to device null:0000000000000001 ... initializing driver
      2015-12-08 15:35:14,756 | INFO | event-dispatch-0 | FlowObjectiveManager | 143 - org.onosproject.onos-core-net - 1.4.0.SNAPSHOT | Driver default bound to device null:0000000000000001 ... initializing driver
      2015-12-08 15:35:26,786 | INFO | ransfer-executor | ConsistentDeviceMastershipStore | 145 - org.onosproject.onos-core-dist - 1.4.0.SNAPSHOT | Forwarding request to relinquish mastership for device null:0000000000000003 to 10.254.1.202
      2015-12-08 15:35:26,797 | INFO | event-dispatch-0 | FlowObjectiveManager | 143 - org.onosproject.onos-core-net - 1.4.0.SNAPSHOT | Driver default bound to device null:0000000000000003 ... initializing driver
      2015-12-08 15:35:26,801 | INFO | event-dispatch-0 | FlowObjectiveManager | 143 - org.onosproject.onos-core-net - 1.4.0.SNAPSHOT | Driver default bound to device null:0000000000000003 ... initializing driver
      2015-12-08 15:35:26,805 | INFO | event-dispatch-0 | FlowObjectiveManager | 143 - org.onosproject.onos-core-net - 1.4.0.SNAPSHOT | Driver default bound to device null:0000000000000003 ... initializing driver
      2015-12-08 15:35:35,327 | INFO | ransfer-executor | ConsistentDeviceMastershipStore | 145 - org.onosproject.onos-core-dist - 1.4.0.SNAPSHOT | Forwarding request to relinquish mastership for device null:0000000000000004 to 10.254.1.202
      2015-12-08 15:35:35,330 | INFO | event-dispatch-0 | FlowObjectiveManager | 143 - org.onosproject.onos-core-net - 1.4.0.SNAPSHOT | Driver default bound to device null:0000000000000004 ... initializing driver
      2015-12-08 15:35:35,901 | INFO | event-dispatch-0 | FlowObjectiveManager | 143 - org.onosproject.onos-core-net - 1.4.0.SNAPSHOT | Driver default bound to device null:0000000000000004 ... initializing driver
      2015-12-08 15:35:36,818 | INFO | event-dispatch-0 | FlowObjectiveManager | 143 - org.onosproject.onos-core-net - 1.4.0.SNAPSHOT | Driver default bound to device null:0000000000000004 ... initializing driver
      2015-12-08 15:35:44,710 | INFO | event-dispatch-0 | FlowObjectiveManager | 143 - org.onosproject.onos-core-net - 1.4.0.SNAPSHOT | Driver default bound to device null:0000000000000005 ... initializing driver
      2015-12-08 15:35:44,826 | INFO | event-dispatch-0 | FlowObjectiveManager | 143 - org.onosproject.onos-core-net - 1.4.0.SNAPSHOT | Driver default bound to device null:0000000000000005 ... initializing driver
      2015-12-08 15:35:52,717 | INFO | event-dispatch-0 | FlowObjectiveManager | 143 - org.onosproject.onos-core-net - 1.4.0.SNAPSHOT | Driver default bound to device null:0000000000000006 ... initializing driver
      2015-12-08 15:35:52,839 | INFO | event-dispatch-0 | FlowObjectiveManager | 143 - org.onosproject.onos-core-net - 1.4.0.SNAPSHOT | Driver default bound to device null:0000000000000006 ... initializing driver
      2015-12-08 15:36:01,401 | INFO | event-dispatch-0 | FlowObjectiveManager | 143 - org.onosproject.onos-core-net - 1.4.0.SNAPSHOT | Driver default bound to device null:0000000000000007 ... initializing driver
      2015-12-08 15:36:02,850 | INFO | event-dispatch-0 | FlowObjectiveManager | 143 - org.onosproject.onos-core-net - 1.4.0.SNAPSHOT | Driver default bound to device null:0000000000000007 ... initializing driver
      2015-12-08 15:36:09,933 | INFO | ransfer-executor | ConsistentDeviceMastershipStore | 145 - org.onosproject.onos-core-dist - 1.4.0.SNAPSHOT | Forwarding request to relinquish mastership for device null:0000000000000008 to 10.254.1.202
      2015-12-08 15:36:09,938 | INFO | event-dispatch-0 | FlowObjectiveManager | 143 - org.onosproject.onos-core-net - 1.4.0.SNAPSHOT | Driver default bound to device null:0000000000000008 ... initializing driver
      2015-12-08 15:36:10,401 | INFO | event-dispatch-0 | FlowObjectiveManager | 143 - org.onosproject.onos-core-net - 1.4.0.SNAPSHOT | Driver default bound to device null:0000000000000008 ... initializing driver
      2015-12-08 15:36:10,863 | INFO | event-dispatch-0 | FlowObjectiveManager | 143 - org.onosproject.onos-core-net - 1.4.0.SNAPSHOT | Driver default bound to device null:0000000000000008 ... initializing driver
      2015-12-08 15:36:16,862 | ERROR | message-handlers | Tools | 73 - org.onosproject.onlab-misc - 1.4.0.SNAPSHOT | Uncaught exception on onos-store-flow-message-handlers
      java.lang.NullPointerException
      at org.onosproject.provider.nil.NullFlowRuleProvider.executeBatch(NullFlowRuleProvider.java:117)[171:org.onosproject.onos-null-provider:1.4.0.SNAPSHOT]
      at org.onosproject.net.flow.impl.FlowRuleManager$InternalStoreDelegate.notify(FlowRuleManager.java:501)[143:org.onosproject.onos-core-net:1.4.0.SNAPSHOT]
      at org.onosproject.net.flow.impl.FlowRuleManager$InternalStoreDelegate.notify(FlowRuleManager.java:462)[143:org.onosproject.onos-core-net:1.4.0.SNAPSHOT]
      at org.onosproject.store.AbstractStore.notifyDelegate(AbstractStore.java:58)[75:org.onosproject.onos-api:1.4.0.SNAPSHOT]
      at org.onosproject.store.flow.impl.NewDistributedFlowRuleStore.storeBatchInternal(NewDistributedFlowRuleStore.java:480)[145:org.onosproject.onos-core-dist:1.4.0.SNAPSHOT]
      at org.onosproject.store.flow.impl.NewDistributedFlowRuleStore.access$600(NewDistributedFlowRuleStore.java:110)[145:org.onosproject.onos-core-dist:1.4.0.SNAPSHOT]
      at org.onosproject.store.flow.impl.NewDistributedFlowRuleStore$OnStoreBatch.handle(NewDistributedFlowRuleStore.java:632)[145:org.onosproject.onos-core-dist:1.4.0.SNAPSHOT]
      at org.onosproject.store.cluster.messaging.impl.ClusterCommunicationManager$InternalClusterMessageHandler.apply(ClusterCommunicationManager.java:223)[145:org.onosproject.onos-core-dist:1.4.0.SNAPSHOT]
      at org.onosproject.store.cluster.messaging.impl.ClusterCommunicationManager$InternalClusterMessageHandler.apply(ClusterCommunicationManager.java:213)[145:org.onosproject.onos-core-dist:1.4.0.SNAPSHOT]
      at org.onlab.netty.NettyMessaging.lambda$null$4(NettyMessaging.java:212)[148:org.onosproject.onlab-netty:1.4.0.SNAPSHOT]
      at org.onlab.netty.NettyMessaging$$Lambda$425/272013655.run(Unknown Source)[148:org.onosproject.onlab-netty:1.4.0.SNAPSHOT]
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)[:1.8.0_31]
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)[:1.8.0_31]
      at java.lang.Thread.run(Thread.java:745)[:1.8.0_31]
      2015-12-08 15:36:16,867 | ERROR | message-handlers | Tools | 73 - org.onosproject.onlab-misc - 1.4.0.SNAPSHOT | Uncaught exception on onos-store-flow-message-handlers
      java.lang.NullPointerException
      at org.onosproject.provider.nil.NullFlowRuleProvider.executeBatch(NullFlowRuleProvider.java:117)[171:org.onosproject.onos-null-provider:1.4.0.SNAPSHOT]
      at org.onosproject.net.flow.impl.FlowRuleManager$InternalStoreDelegate.notify(FlowRuleManager.java:501)[143:org.onosproject.onos-core-net:1.4.0.SNAPSHOT]
      at org.onosproject.net.flow.impl.FlowRuleManager$InternalStoreDelegate.notify(FlowRuleManager.java:462)[143:org.onosproject.onos-core-net:1.4.0.SNAPSHOT]
      at org.onosproject.store.AbstractStore.notifyDelegate(AbstractStore.java:58)[75:org.onosproject.onos-api:1.4.0.SNAPSHOT]
      at org.onosproject.store.flow.impl.NewDistributedFlowRuleStore.storeBatchInternal(NewDistributedFlowRuleStore.java:480)[145:org.onosproject.onos-core-dist:1.4.0.SNAPSHOT]
      at org.onosproject.store.flow.impl.NewDistributedFlowRuleStore.access$600(NewDistributedFlowRuleStore.java:110)[145:org.onosproject.onos-core-dist:1.4.0.SNAPSHOT]
      at org.onosproject.store.flow.impl.NewDistributedFlowRuleStore$OnStoreBatch.handle(NewDistributedFlowRuleStore.java:632)[145:org.onosproject.onos-core-dist:1.4.0.SNAPSHOT]
      at org.onosproject.store.cluster.messaging.impl.ClusterCommunicationManager$InternalClusterMessageHandler.apply(ClusterCommunicationManager.java:223)[145:org.onosproject.onos-core-dist:1.4.0.SNAPSHOT]
      at org.onosproject.store.cluster.messaging.impl.ClusterCommunicationManager$InternalClusterMessageHandler.apply(ClusterCommunicationManager.java:213)[145:org.onosproject.onos-core-dist:1.4.0.SNAPSHOT]
      at org.onlab.netty.NettyMessaging.lambda$null$4(NettyMessaging.java:212)[148:org.onosproject.onlab-netty:1.4.0.SNAPSHOT]
      at org.onlab.netty.NettyMessaging$$Lambda$425/272013655.run(Unknown Source)[148:org.onosproject.onlab-netty:1.4.0.SNAPSHOT]
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)[:1.8.0_31]
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)[:1.8.0_31]
      at java.lang.Thread.run(Thread.java:745)[:1.8.0_31]
      2015-12-08 15:36:18,830 | ERROR | 3]-nio2-thread-4 | ShellUtil | 25 - org.apache.karaf.shell.console - 3.0.3 | Exception caught while executing command
      java.lang.NullPointerException
      at org.onosproject.provider.nil.TopologyMutationDriver.severLink(TopologyMutationDriver.java:120)
      at org.onosproject.provider.nil.NullProviders.severLink(NullProviders.java:277)
      at org.onosproject.provider.nil.cli.NullLinkCommand.execute(NullLinkCommand.java:59)
      at org.onosproject.cli.AbstractShellCommand.doExecute(AbstractShellCommand.java:129)
      at org.apache.karaf.shell.console.AbstractAction.execute(AbstractAction.java:33)
      at org.apache.karaf.shell.commands.basic.AbstractCommand.execute(AbstractCommand.java:33)
      at Proxy18537bf3_253a_426c_8d6f_4bc809278d56.execute(Unknown Source)
      at Proxy18537bf3_253a_426c_8d6f_4bc809278d56.execute(Unknown Source)
      at org.apache.felix.gogo.runtime.CommandProxy.execute(CommandProxy.java:78)
      at org.apache.felix.gogo.runtime.Closure.executeCmd(Closure.java:477)
      at org.apache.felix.gogo.runtime.Closure.executeStatement(Closure.java:403)
      at org.apache.felix.gogo.runtime.Pipe.run(Pipe.java:108)
      at org.apache.felix.gogo.runtime.Closure.execute(Closure.java:183)
      at org.apache.felix.gogo.runtime.Closure.execute(Closure.java:120)
      at org.apache.felix.gogo.runtime.CommandSessionImpl.execute(CommandSessionImpl.java:92)
      at org.apache.karaf.shell.ssh.ShellCommand$1.run(ShellCommand.java:124)
      at java.security.AccessController.doPrivileged(Native Method)[:1.8.0_31]
      at org.apache.karaf.jaas.modules.JaasHelper.doAs(JaasHelper.java:77)
      at org.apache.karaf.shell.ssh.ShellCommand.start(ShellCommand.java:120)
      at org.apache.sshd.server.channel.ChannelSession.handleExec(ChannelSession.java:422)[28:org.apache.sshd.core:0.12.0]
      at org.apache.sshd.server.channel.ChannelSession.handleRequest(ChannelSession.java:304)[28:org.apache.sshd.core:0.12.0]
      at org.apache.sshd.server.channel.ChannelSession$ChannelSessionRequestHandler.process(ChannelSession.java:576)[28:org.apache.sshd.core:0.12.0]
      at org.apache.sshd.server.channel.ChannelSession$ChannelSessionRequestHandler.process(ChannelSession.java:574)[28:org.apache.sshd.core:0.12.0]
      at org.apache.sshd.common.channel.AbstractChannel.handleRequest(AbstractChannel.java:96)[28:org.apache.sshd.core:0.12.0]
      at org.apache.sshd.common.session.AbstractConnectionService.channelRequest(AbstractConnectionService.java:261)[28:org.apache.sshd.core:0.12.0]
      at org.apache.sshd.common.session.AbstractConnectionService.process(AbstractConnectionService.java:139)[28:org.apache.sshd.core:0.12.0]
      at org.apache.sshd.common.session.AbstractSession.doHandleMessage(AbstractSession.java:399)[28:org.apache.sshd.core:0.12.0]
      at org.apache.sshd.common.session.AbstractSession.handleMessage(AbstractSession.java:295)[28:org.apache.sshd.core:0.12.0]
      at org.apache.sshd.common.session.AbstractSession.decode(AbstractSession.java:731)[28:org.apache.sshd.core:0.12.0]
      at org.apache.sshd.common.session.AbstractSession.messageReceived(AbstractSession.java:277)[28:org.apache.sshd.core:0.12.0]
      at org.apache.sshd.common.AbstractSessionIoHandler.messageReceived(AbstractSessionIoHandler.java:54)[28:org.apache.sshd.core:0.12.0]
      at org.apache.sshd.common.io.nio2.Nio2Session$1.onCompleted(Nio2Session.java:187)[28:org.apache.sshd.core:0.12.0]
      at org.apache.sshd.common.io.nio2.Nio2Session$1.onCompleted(Nio2Session.java:173)[28:org.apache.sshd.core:0.12.0]
      at org.apache.sshd.common.io.nio2.Nio2CompletionHandler$1.run(Nio2CompletionHandler.java:32)
      at java.security.AccessController.doPrivileged(Native Method)[:1.8.0_31]
      at org.apache.sshd.common.io.nio2.Nio2CompletionHandler.completed(Nio2CompletionHandler.java:30)[28:org.apache.sshd.core:0.12.0]
      at sun.nio.ch.Invoker.invokeUnchecked(Invoker.java:126)[:1.8.0_31]
      at sun.nio.ch.Invoker$2.run(Invoker.java:218)[:1.8.0_31]
      at sun.nio.ch.AsynchronousChannelGroupImpl$1.run(AsynchronousChannelGroupImpl.java:112)[:1.8.0_31]
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)[:1.8.0_31]
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)[:1.8.0_31]
      at java.lang.Thread.run(Thread.java:745)[:1.8.0_31]

        Attachments

        # Subject Branch Project Status CR V

          Activity

            People

            Assignee:
            suibin suibin
            Reporter:
            suibin suibin
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: