Author Topic: queuemetrics will eat all the cpus after a long running  (Read 5320 times)

coolname

  • Full Member
  • ***
  • Posts: 163
  • Karma: 0
    • View Profile
queuemetrics will eat all the cpus after a long running
« on: December 21, 2011, 02:52:46 »
in top,i see java process use 393% cpu after a long time running,should i restart queuemetrics everyday?

patrick

  • Newbie
  • *
  • Posts: 1
  • Karma: 0
    • View Profile
Re: queuemetrics will eat all the cpus after a long running
« Reply #1 on: January 05, 2012, 18:07:30 »
I have the same problem.  Java mem has been increased but still no change.  this happens at the same time every working day.
I have noticed that there are almost 200 sessions within mysql, these processes are usually terminated after 10 to 30 seconds but when we have 'issues' the process stack builds and builds until we have too many sessions for mysql.

What kind of diagnostics do I take? mysql, java or qm itself?

Any help would be nice.

QueueMetrics

  • Loway
  • Hero Member
  • *
  • Posts: 2999
  • Karma: 39
    • View Profile
    • QueueMetrics
Re: queuemetrics will eat all the cpus after a long running
« Reply #2 on: January 18, 2012, 18:09:13 »
Taking a thread dump is the only way to know what's actually going on.
Most likely, you are sending QM too many requests (or it's too slow to fetch data to process them, but it's the same thing) so it lags behind. Try avoiding having too many realtime screens open.

coolname

  • Full Member
  • ***
  • Posts: 163
  • Karma: 0
    • View Profile
Re: queuemetrics will eat all the cpus after a long running
« Reply #3 on: March 13, 2012, 06:46:36 »
through threaddump,i get the below process eats too many cpus


"http-8080-4" daemon prio=10 tid=0x09e01c00 nid=0x192e runnable [0x0b969000]
   java.lang.Thread.State: RUNNABLE
   at it.loway.tpf.common.containers.LContext.eliminaPrefisso(LContext.java:237)
   at it.loway.tpf.transaction.servlets.LowayTransactionController.pulisceChiavi(LowayTransactionController.java:886)
   at it.loway.tpf.transaction.servlets.LowayTransactionController.serveRequest(LowayTransactionController.java:557)
   at it.loway.tpf.transaction.servlets.LowayTransactionController.serveRequestWrapper(LowayTransactionController.java:387)
   at it.loway.tpf.transaction.servlets.LowayTransactionController.doPost(LowayTransactionController.java:238)
   at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
   at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
   at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
   at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
   at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
   at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
   at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
   at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
   at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
   at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:291)
   at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859)
   at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:602)
   at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
   at java.lang.Thread.run(Thread.java:662)

coolname

  • Full Member
  • ***
  • Posts: 163
  • Karma: 0
    • View Profile
Re: queuemetrics will eat all the cpus after a long running
« Reply #4 on: April 08, 2012, 04:05:38 »
after change into centos 6.2 64bit,mem 8GB,the problem has gone

QueueMetrics

  • Loway
  • Hero Member
  • *
  • Posts: 2999
  • Karma: 39
    • View Profile
    • QueueMetrics
Re: queuemetrics will eat all the cpus after a long running
« Reply #5 on: April 10, 2012, 12:49:04 »
Nice to see it's fixed.

coolname

  • Full Member
  • ***
  • Posts: 163
  • Karma: 0
    • View Profile
Re: queuemetrics will eat all the cpus after a long running
« Reply #6 on: April 25, 2012, 11:24:43 »
after run about 20 days,it occured agagin

QueueMetrics

  • Loway
  • Hero Member
  • *
  • Posts: 2999
  • Karma: 39
    • View Profile
    • QueueMetrics
Re: queuemetrics will eat all the cpus after a long running
« Reply #7 on: April 27, 2012, 15:28:14 »
Do you run a programmed restart of the server?

coolname

  • Full Member
  • ***
  • Posts: 163
  • Karma: 0
    • View Profile
Re: queuemetrics will eat all the cpus after a long running
« Reply #8 on: May 04, 2012, 15:45:42 »
no ,i manually restart the qm

QueueMetrics

  • Loway
  • Hero Member
  • *
  • Posts: 2999
  • Karma: 39
    • View Profile
    • QueueMetrics
Re: queuemetrics will eat all the cpus after a long running
« Reply #9 on: May 09, 2012, 13:32:59 »
We usually suggest doing a programmed restart just to be on the safe side of things.
BTW, in the upcoming release, we spotted a threading issue that would cause high CPU spikes; this is fixed in 12.05, so it would be wise to upgrade.

coolname

  • Full Member
  • ***
  • Posts: 163
  • Karma: 0
    • View Profile
Re: queuemetrics will eat all the cpus after a long running
« Reply #10 on: May 10, 2012, 03:30:12 »
really? :D :D :D when would it realeased?

QueueMetrics

  • Loway
  • Hero Member
  • *
  • Posts: 2999
  • Karma: 39
    • View Profile
    • QueueMetrics
Re: queuemetrics will eat all the cpus after a long running
« Reply #11 on: May 10, 2012, 13:10:49 »
Next week or so. We are finalizing changes and doing final testing.