Uploaded image for project: 'ONOS'
  1. ONOS
  2. ONOS-955

Caught "NoSuchElement" exception while installing large-size intents using "push-test-intents"

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed (View Workflow)
    • Priority: Major
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: 1.1.0
    • Component/s: None
    • Labels:

      Description

      1) 3-node bm cluster;
      2) "push-test-intents src dst 100 10 1" - everything is fine with valid returns; from jprofiler, we can see about 11 "onos-intent-#" worker threads running
      3) "push-test-intents src dat 100 100 1"

      • from jprofiler, we are seeing "onos-intent-#" working threads keep being created - to up to ~80;
      • lots of intents are stuck at "INSTALLED_REQ"
      • from log, we see following exceptions:
        ---------------------------------------------------------
        2015-02-04 09:24:19,472 | ERROR | onos-intent-75 | IntentManager | 152 - org.onosproject.onos-core-net - 1.1.0.SNAPSHOT | Error submitting batches:
        java.util.NoSuchElementException: Queue is empty!
        at com.hazelcast.queue.impl.proxy.QueueProxyImpl.remove(QueueProxyImpl.java:131)[53:com.hazelcast:3.4.0]
        at org.onosproject.store.hz.SQueue.remove(SQueue.java:122)[154:org.onosproject.onos-core-dist:1.1.0.SNAPSHOT]
        at org.onosproject.store.intent.impl.HazelcastIntentBatchQueue.removeIntentOperations(HazelcastIntentBatchQueue.java:178)[154:org.onosproject.onos-core-dist:1.1.0.SNAPSHOT]
        at org.onosproject.net.intent.impl.IntentManager$IntentBatchProcessFutures.run(IntentManager.java:1217)[152:org.onosproject.onos-core-net:1.1.0.SNAPSHOT]
        at org.onosproject.net.intent.impl.IntentManager$IntentBatchApplyFirst.run(IntentManager.java:1144)[152:org.onosproject.onos-core-net:1.1.0.SNAPSHOT]
        at org.onosproject.net.intent.impl.IntentManager$IntentBatchPreprocess.run(IntentManager.java:1079)[152:org.onosproject.onos-core-net:1.1.0.SNAPSHOT]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)[:1.8.0_11]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)[:1.8.0_11]
        at java.lang.Thread.run(Thread.java:745)[:1.8.0_11]
        2015-02-04 09:24:19,473 | ERROR | onos-intent-75 | IntentManager | 152 - org.onosproject.onos-core-net - 1.1.0.SNAPSHOT | Walk the plank, matey...
        2015-02-04 09:24:19,493 | WARN | onos-intent-75 | HazelcastIntentBatchQueue | 154 - org.onosproject.onos-core-dist - 1.1.0.SNAPSHOT | Operation IntentOperations{operations=[IntentOperation{type=SUBMIT, intentId=0x3d73d, intent=PointToPointIntent{id=0x3d73d, appId=DefaultApplicationId {id=116, name=org.onosproject.cli-100}, resources=[], selector=DefaultTrafficSelector{criteria=[ETH_TYPE{ethType=800}, ETH_SRC{mac=00:00:00:01:86:A1}]}, treatment=DefaultTrafficTreatment{instructions=[]}, ingress=ConnectPoint{elementId=null:ffffffff99ac0000, portNumber=1}, egress=ConnectPoint{elementId=null:ffffffff99c9ffff, portNumber=1}, constraints=[LinkTypeConstraint{inclusive=false, types=[OPTICAL]}]}}, IntentOperation{type=SUBMIT, intentId=0x3d73e, intent=PointToPointIntent{id=0x3d73e, appId=DefaultApplicationId{id=116, name=org.onosproject.cli-100}

        , resources=[], selector=DefaultTrafficSelector

        Unknown macro: {criteria=[ETH_TYPE{ethType=800}, ETH_SRC{mac=00:00:00:01:86:A2}]}

        , treatment=DefaultTrafficTreatment

        {instructions=[]}, ingress=ConnectPoint{elementId=null:ffffffff99ac0000, portNumber=1}, egress=ConnectPoint{elementId=null:ffffffff99c9ffff, portNumber=1}, constraints=[LinkTypeConstraint{inclusive=false, types=[OPTICAL]}]}}, IntentOperation{type=SUBMIT, intentId=0x3d73f, intent=PointToPointIntent{id=0x3d73f, appId=DefaultApplicationId{id=116, name=org.onosproject.cli-100}, resources=[], selector=DefaultTrafficSelector:00:00:01:86:A2}]}, treatment=DefaultTrafficTreatment{instructions=[]}

        , ingress=ConnectPoint

        {el ementId=null:ffffffff99ac0000, portNumber=1}

        , egress=ConnectPoin......

        Attachments

          Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

            Activity

              People

              Assignee:
              bocon Brian O'Connor
              Reporter:
              suibin suibin
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: