Author Topic: Qloaderd missing data  (Read 7973 times)

Richarddb

  • Jr. Member
  • **
  • Posts: 57
  • Karma: 0
    • View Profile
Qloaderd missing data
« on: September 30, 2011, 09:58:57 »
Hi all,

A week ago we had to fail over to the other pbx and we forgot to start the qloaderd service. The database is missing one day of data. My question is if we can use the ./loadAllQueueLogFiles.sh script to load the missing data into the database.

Qloaderd version 1.22-16

QueueMetrics

  • Loway
  • Hero Member
  • *
  • Posts: 2999
  • Karma: 39
    • View Profile
    • QueueMetrics
Re: Qloaderd missing data
« Reply #1 on: September 30, 2011, 11:53:43 »

Richarddb

  • Jr. Member
  • **
  • Posts: 57
  • Karma: 0
    • View Profile
Re: Qloaderd missing data
« Reply #2 on: October 06, 2011, 11:33:04 »
The script is not working. When we run a report in queuemetrics we are still missing the same days.

./queuePartialUpdater.pl /var/log/asterisk/queue_log.10 P001 /var/log/qlog.log

[root@enovpbx1 qloader]# ./queuePartialUpdater.pl /var/log/asterisk/queue_log.9 P001 /var/log/qlog.log |QueueMetrics Partial Queue Database Updater - $Revision: 1.4 $
|Removing items from time id 1317088925 to 1317174707 for partition P001
|Moving items with timestamp greater than 1317174707 for partition P001
|Calling ./qloader.pl -h 127.0.0.1 -d queuemetrics -u queuemetrics -p javadude /var/log/asterisk/queue_log.9 P001 /var/log/qlog.log 1
|Restoring items with timestamp greater than 1317174707 into partition P001
|QueueMetrics Partial Queue Database Updater - terminating

QueueMetrics

  • Loway
  • Hero Member
  • *
  • Posts: 2999
  • Karma: 39
    • View Profile
    • QueueMetrics
Re: Qloaderd missing data
« Reply #3 on: October 06, 2011, 12:38:49 »
Looks correct to me. We are checking if everything is fine at the qloader version now.
(bug #1480)

marcos

  • Loway
  • Full Member
  • *
  • Posts: 138
  • Karma: 3
    • View Profile
Re: Qloaderd missing data
« Reply #4 on: October 06, 2011, 17:34:57 »
Hi.
We investigated about the problem but we are not able to replicate it.
Could it be a problem with the partition?
Looking at your log I can see that the data are restored on partition P001. Is that partition your actual working partition?

Richarddb

  • Jr. Member
  • **
  • Posts: 57
  • Karma: 0
    • View Profile
Re: Qloaderd missing data
« Reply #5 on: October 07, 2011, 11:37:22 »
This is our partition information, P001 is the partition we always used and are still using.


The current storage info:

Partition                 Entries                 N. calls   From:                       To:                               Days of data:    Last heartbeat:   
P001                      1.132.473 1         30.822   2008-12-15 12:16   2011-10-07 10:29        1.026,1 days   2011-10-07 10:29

Richarddb

  • Jr. Member
  • **
  • Posts: 57
  • Karma: 0
    • View Profile
Re: Qloaderd missing data
« Reply #6 on: October 07, 2011, 17:06:57 »
After we used the link you mentioned above, it does delete the information but it doesn't reload it into the database. It means we now miss even more data then before.

Do you have a solution for this?

root@enovpbx1 qloader]# ./queuePartialUpdater.pl /var/log/asterisk/queue_log.4 P001 /var/log/qlog.log
|QueueMetrics Partial Queue Database Updater - $Revision: 1.4 $
|Removing items from time id 1317607324 to 1317693107 for partition P001
|Moving items with timestamp greater than 1317693107 for partition P001
|Calling ./qloader.pl -h 127.0.0.1 -d queuemetrics -u queuemetrics -p javadude /var/log/asterisk/queue_log.4 P001 /var/log/qlog.log 1
|Restoring items with timestamp greater than 1317693107 into partition P001
|QueueMetrics Partial Queue Database Updater – terminating


« Last Edit: October 10, 2011, 09:05:19 by Richarddb »

Richarddb

  • Jr. Member
  • **
  • Posts: 57
  • Karma: 0
    • View Profile
Re: Qloaderd missing data
« Reply #7 on: October 14, 2011, 15:59:41 »
Hi,

Is there anyone who know a solution for this problem. The report of last month is incomplete.

QueueMetrics

  • Loway
  • Hero Member
  • *
  • Posts: 2999
  • Karma: 39
    • View Profile
    • QueueMetrics
Re: Qloaderd missing data
« Reply #8 on: October 25, 2011, 12:00:21 »
Which version of the qloaderd are you using?

Richarddb

  • Jr. Member
  • **
  • Posts: 57
  • Karma: 0
    • View Profile
Re: Qloaderd missing data
« Reply #9 on: October 25, 2011, 13:09:12 »
Hi,

We already solved the problem now. There was a problem with the rights in the script. Besides that, the script was directing to the wrong database.

QueueMetrics

  • Loway
  • Hero Member
  • *
  • Posts: 2999
  • Karma: 39
    • View Profile
    • QueueMetrics
Re: Qloaderd missing data
« Reply #10 on: January 18, 2012, 18:22:47 »
 :'(