QueueMetrics forum

QueueMetrics => MySQL storage and Qloaderd/Uniloader => Topic started by: Richarddb on September 30, 2011, 09:58:57

Title: Qloaderd missing data
Post by: Richarddb on September 30, 2011, 09:58:57

Hi all,

A week ago we had to fail over to the other pbx and we forgot to start the qloaderd service. The database is missing one day of data. My question is if we can use the ./loadAllQueueLogFiles.sh script to load the missing data into the database.

Qloaderd version 1.22-16

Title: Re: Qloaderd missing data
Post by: QueueMetrics on September 30, 2011, 11:53:43

No, but we have a way to do it; see http://queuemetrics.com/manuals/QLoader-chunked/ar01s03.html

Title: Re: Qloaderd missing data
Post by: Richarddb on October 06, 2011, 11:33:04

The script is not working. When we run a report in queuemetrics we are still missing the same days.

./queuePartialUpdater.pl /var/log/asterisk/queue_log.10 P001 /var/log/qlog.log

[root@enovpbx1 qloader]# ./queuePartialUpdater.pl /var/log/asterisk/queue_log.9 P001 /var/log/qlog.log |QueueMetrics Partial Queue Database Updater - $Revision: 1.4 $
|Removing items from time id 1317088925 to 1317174707 for partition P001
|Moving items with timestamp greater than 1317174707 for partition P001
|Calling ./qloader.pl -h 127.0.0.1 -d queuemetrics -u queuemetrics -p javadude /var/log/asterisk/queue_log.9 P001 /var/log/qlog.log 1
|Restoring items with timestamp greater than 1317174707 into partition P001
|QueueMetrics Partial Queue Database Updater - terminating

Title: Re: Qloaderd missing data
Post by: QueueMetrics on October 06, 2011, 12:38:49

Looks correct to me. We are checking if everything is fine at the qloader version now.
(bug #1480)

Title: Re: Qloaderd missing data
Post by: marcos on October 06, 2011, 17:34:57

Hi.
We investigated about the problem but we are not able to replicate it.
Could it be a problem with the partition?
Looking at your log I can see that the data are restored on partition P001. Is that partition your actual working partition?

Title: Re: Qloaderd missing data
Post by: Richarddb on October 07, 2011, 11:37:22

This is our partition information, P001 is the partition we always used and are still using.


The current storage info:

Partition                 Entries                 N. calls   From:                       To:                               Days of data:    Last heartbeat:   
P001                      1.132.473 1         30.822   2008-12-15 12:16   2011-10-07 10:29        1.026,1 days   2011-10-07 10:29

Title: Re: Qloaderd missing data
Post by: Richarddb on October 07, 2011, 17:06:57

After we used the link you mentioned above, it does delete the information but it doesn't reload it into the database. It means we now miss even more data then before.

Do you have a solution for this?

root@enovpbx1 qloader]# ./queuePartialUpdater.pl /var/log/asterisk/queue_log.4 P001 /var/log/qlog.log
|QueueMetrics Partial Queue Database Updater - $Revision: 1.4 $
|Removing items from time id 1317607324 to 1317693107 for partition P001
|Moving items with timestamp greater than 1317693107 for partition P001
|Calling ./qloader.pl -h 127.0.0.1 -d queuemetrics -u queuemetrics -p javadude /var/log/asterisk/queue_log.4 P001 /var/log/qlog.log 1
|Restoring items with timestamp greater than 1317693107 into partition P001
|QueueMetrics Partial Queue Database Updater – terminating

(http://i888.photobucket.com/albums/ac88/Enovation_Apps/qm_database.jpg)

Title: Re: Qloaderd missing data
Post by: Richarddb on October 14, 2011, 15:59:41

Hi,

Is there anyone who know a solution for this problem. The report of last month is incomplete.

Title: Re: Qloaderd missing data
Post by: QueueMetrics on October 25, 2011, 12:00:21

Which version of the qloaderd are you using?

Title: Re: Qloaderd missing data
Post by: Richarddb on October 25, 2011, 13:09:12

Hi,

We already solved the problem now. There was a problem with the rights in the script. Besides that, the script was directing to the wrong database.

Title: Re: Qloaderd missing data
Post by: QueueMetrics on January 18, 2012, 18:22:47

 :'(