Unnecessary Data

cset16 · July 20, 2012, 03:41:17 PM

Is there any way in Advanced Data Logger to choose which data is logged?

I am tracking weight data from a Citizen Scale SSH-94 balance and I am receiving data perfectly by setting up the parser so I get a time stamp and then my data each on its own line as shown below.

Currently the data logging speed is subject only to the baud rate which is giving me too many data points even at the lowest baud rate. For my purposes, the balance will be idle a majority of the time and the weight will be unstable very rarely. The unstable weight measures are preceded by a '?' character. I was wondering if there is a way to only record one of the stable data points (when there is not a '?')? So instead of recording 0 grams for 500 lines, it would only be recorded once while the value isn't changing. This would greatly reduce my unnecessary data points and would give a log like the second one below.

Thanks!

Current:
<07.12.2012 16:38:52.562>SI 0.0 g
<07.12.2012 16:38:52.656>SI 0.0 g
<07.12.2012 16:38:52.750>SI 0.0 g
<07.12.2012 16:38:52.859>SI 0.0 g
<07.12.2012 16:38:52.953>SI 0.0 g
<07.12.2012 16:38:53.046>SI ? 0.2 g
<07.12.2012 16:38:53.156>SI ? 5.9 g
<07.12.2012 16:38:53.250>SI ? 7.7 g
<07.12.2012 16:38:53.359>SI ? 10.1 g
<07.12.2012 16:38:53.453>SI ? 12.0 g
<07.12.2012 16:38:53.562>SI ? 13.8 g
<07.12.2012 16:38:53.656>SI ? 15.6 g
<07.12.2012 16:38:53.750>SI ? 17.2 g
<07.12.2012 16:38:53.859>SI ? 17.2 g
<07.12.2012 16:38:53.953>SI ? 17.2 g
<07.12.2012 16:38:54.046>SI ? 15.1 g
<07.12.2012 16:38:54.156>SI ? 14.5 g
<07.12.2012 16:38:54.578>SI ? 14.5 g
<07.12.2012 16:38:54.687>SI ? 14.5 g
<07.12.2012 16:38:54.765>SI ? 14.5 g
<07.12.2012 16:38:54.843>SI ? 14.5 g
<07.12.2012 16:38:54.953>SI ? 14.5 g
<07.12.2012 16:38:55.046>SI ? 14.5 g
<07.12.2012 16:38:57.031>SI ? 14.5 g
<07.12.2012 16:38:57.140>SI ? 14.5 g
<07.12.2012 16:38:57.250>SI 14.5 g
<07.12.2012 16:38:57.343>SI 14.5 g
<07.12.2012 16:38:57.453>SI 14.5 g
<07.12.2012 16:38:57.546>SI 14.5 g
<07.12.2012 16:38:57.656>SI 14.5 g
<07.12.2012 16:38:57.750>SI 14.5 g

Desired:

<07.12.2012 16:38:52.953>SI 0.0 g
<07.12.2012 16:38:53.046>SI ? 0.2 g
<07.12.2012 16:38:53.156>SI ? 5.9 g
<07.12.2012 16:38:53.250>SI ? 7.7 g
<07.12.2012 16:38:53.359>SI ? 10.1 g
<07.12.2012 16:38:53.453>SI ? 12.0 g
<07.12.2012 16:38:53.562>SI ? 13.8 g
<07.12.2012 16:38:53.656>SI ? 15.6 g
<07.12.2012 16:38:53.750>SI ? 17.2 g
<07.12.2012 16:38:53.859>SI ? 17.2 g
<07.12.2012 16:38:53.953>SI ? 17.2 g
<07.12.2012 16:38:54.046>SI ? 15.1 g
<07.12.2012 16:38:54.156>SI ? 14.5 g
<07.12.2012 16:38:54.578>SI ? 14.5 g
<07.12.2012 16:38:54.687>SI ? 14.5 g
<07.12.2012 16:38:54.765>SI ? 14.5 g
<07.12.2012 16:38:54.843>SI ? 14.5 g
<07.12.2012 16:38:54.953>SI ? 14.5 g
<07.12.2012 16:38:55.046>SI ? 14.5 g
<07.12.2012 16:38:57.031>SI ? 14.5 g
<07.12.2012 16:38:57.140>SI ? 14.5 g
<07.12.2012 16:38:57.250>SI 14.5 g

Arthur Grasin · April 08, 2020, 11:00:00 AM

You can simply define filter rules in the ASCII Data Parser. For example you can filter out packets that contain text "?".

cset16 · July 20, 2012, 08:54:55 PM

I understand that that it is possible to just get the data with "?", but I also need some data points that do not contain the "?", specifically the weights that occur before and after the "?" so how would I use the filter to accomplish this?

Also do I need any plug ins to use the filter?

Arthur Grasin · July 21, 2012, 06:52:44 AM

In this case, you need to disable filters in the parser and enable the Deadband filter plugin.

cset16 · July 26, 2012, 03:39:14 AM

I tried to get the deadband plug-in to get rid of the stable data points, but it is not working as I thought it would. Can you give me any more information on how to set this up so I can maintain a stable point before and after the unstable ones (unstable if have "?") but get rid of all the rest?

Arthur Grasin · July 26, 2012, 05:39:41 AM

I'm sorry, but this is a complex logic that can't implemented by standard plugins.

cset16 · July 26, 2012, 01:11:05 PM

Could you elaborate on how the four deadband settings work? I read this page http://www.aggsoft.com/serial-data-logger/plugins/deadband.pdf but I didn't find it very clear how they functioned.

As I read it, for absolute you give a value and if the next value changes by less than the absolute value of this number it will not be recorded. When I tried this, it did reduce the first set of data points, but after the weight value changed, it would not eliminate any more of the points. Am I not understanding this setting correctly?

These were the actual readings:
<07.25.2012 10:15:59.113>SUI 1207.0 g
<07.25.2012 10:16:00.703>SUI 1207.0 g
<07.25.2012 10:16:02.343>SUI 1207.0 g
<07.25.2012 10:16:04.031>SUI ? 1217.7 g
<07.25.2012 10:16:05.734>SUI ? 1223.6 g
<07.25.2012 10:16:07.437>SUI ? 1228.4 g
<07.25.2012 10:16:09.125>SUI ? 1231.3 g
<07.25.2012 10:16:10.796>SUI ? 1227.0 g
<07.25.2012 10:16:12.421>SUI ? 1206.9 g
<07.25.2012 10:16:14.046>SUI ? 1206.9 g
<07.25.2012 10:16:15.734>SUI ? 1225.2 g
<07.25.2012 10:16:17.421>SUI ? 1206.9 g
<07.25.2012 10:16:19.031>SUI ? 1284.7 g
<07.25.2012 10:16:20.718>SUI ? 1184.0 g
<07.25.2012 10:16:22.328>SUI ? 721.1 g
<07.25.2012 10:16:24.031>SUI ? 759.6 g
<07.25.2012 10:16:25.718>SUI ? 14.6 g
<07.25.2012 10:16:27.328>SUI ? 14.5 g
<07.25.2012 10:16:29.015>SUI ? 14.6 g
<07.25.2012 10:16:30.625>SUI ? 14.6 g
<07.25.2012 10:16:32.312>SUI 14.6 g
<07.25.2012 10:16:34.015>SUI 14.6 g
<07.25.2012 10:16:35.609>SUI 14.6 g
<07.25.2012 10:16:37.203>SUI 14.6 g

Then the deadband plug-in gave:
<07.25.2012 10:15:59.113>SUI 1207.0 g

<07.25.2012 10:16:04.031>SUI ? 1217.7 g
<07.25.2012 10:16:05.734>SUI ? 1223.6 g
<07.25.2012 10:16:07.437>SUI ? 1228.4 g
<07.25.2012 10:16:09.125>SUI ? 1231.3 g
<07.25.2012 10:16:10.796>SUI ? 1227.0 g
<07.25.2012 10:16:12.421>SUI ? 1206.9 g
<07.25.2012 10:16:14.046>SUI ? 1206.9 g
<07.25.2012 10:16:15.734>SUI ? 1225.2 g
<07.25.2012 10:16:17.421>SUI ? 1206.9 g
<07.25.2012 10:16:19.031>SUI ? 1284.7 g
<07.25.2012 10:16:20.718>SUI ? 1184.0 g
<07.25.2012 10:16:22.328>SUI ? 721.1 g
<07.25.2012 10:16:24.031>SUI ? 759.6 g
<07.25.2012 10:16:25.718>SUI ? 14.6 g
<07.25.2012 10:16:27.328>SUI ? 14.5 g
<07.25.2012 10:16:29.015>SUI ? 14.6 g
<07.25.2012 10:16:30.625>SUI ? 14.6 g
<07.25.2012 10:16:32.312>SUI 14.6 g
<07.25.2012 10:16:34.015>SUI 14.6 g
<07.25.2012 10:16:35.609>SUI 14.6 g
<07.25.2012 10:16:37.203>SUI 14.6 g

(Reduces the first set of excess data points, but not the second (14.6))

Arthur Grasin · July 26, 2012, 07:02:06 PM

I don't see your settings and can't say what is wrong. Could you attach a backup copy of your current configuration?

cset16 · May 05, 2020, 11:00:00 AM

Attached are screenviews of all my main configuration settings for the dead-band plug-in

Arthur Grasin · July 27, 2012, 05:15:12 AM

Please, note that the program window display data after parsing, but before filtering. You need to check data in a file that creates the Local Database plugin.

News:

Unnecessary Data