Uploaded image for project: 'ONOS'
  1. ONOS
  2. ONOS-5159

java process CPU utilization very high after link between switches flap

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed (View Workflow)
    • Priority: Major
    • Resolution: Cannot Reproduce
    • Affects Version/s: 1.7.0
    • Fix Version/s: 1.7.0
    • Component/s: None
    • Labels:
      None
    • Environment:

      1 controller, 2 hardware switches, 1 quagga host, 3 external hosts

    • Story Points:
      1
    • Sprint:
      Hummingbird sprint 3

      Description

      Used SDN-IP with scale about 750 routes, 2-2.5k flows
      After few link flaps between switches or between switch-external host see very high CPU utilization by java process with about 500 threads.
      Log says that ONOS constantly adds/removes flows. Once CPU hit 370-400% nothing calm it within reasonable 10-20min besides kill -9, not even kill -15. I tried also to add more memory to java - java ate 4GB and CPU reached 380%
      Just routes flap without link flap did not caused same effect.

      top -bn1 -p `pidof java` | egrep "CPU|java"
      PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
      25156 sdn 20 0 4555828 904340 23340 S 380.0 11.1 2380:40 java

      pstree -p | grep jav | wc
      493 985 20209

      onos> bgp-routes -s
      Total BGP IPv4 routes = 722
      Total BGP IPv6 routes = 0
      onos>
      onos> intents -s | grep Multi
      MultiPointToSinglePoint total= 770 installed= 674
      MultiPointToSinglePoint withdrawn= 96 failed= 0
      ...
      onos> flows -c
      deviceId=of:aaaa7cfe90f05bc0, flowRuleCount=2589
      deviceId=of:bbbb7cfe90f6c840, flowRuleCount=2065
      onos>

        Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

            Assignee:
            Unassigned
            Reporter:
            semionl Semion Lisyansky
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Dates

              Created:
              Updated: