<div dir="auto">Thanks Michael <div dir="auto"><br></div><div dir="auto">I can't recall testing a later version but I think Chris can confirm he was on a later version when his Leaf had a similar problem.</div><div dir="auto"><br></div><div dir="auto">The Leaf is now my wife's daily drive so I won't be able to take a look at making the suggested changes for a couple of weeks at least.</div></div><br><div class="gmail_quote gmail_quote_container"><div dir="ltr" class="gmail_attr">On Mon, 20 Jan 2025, 8:31 am Michael Balzer via OvmsDev, <<a href="mailto:ovmsdev@lists.openvehicles.com">ovmsdev@lists.openvehicles.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><u></u>

  
    
  
  <div>
    Derek,<br>
    <br>
    <div>Am 03.05.24 um 12:53 schrieb Derek
      Caudwell via OvmsDev:<br>
    </div>
    <blockquote type="cite">When
      running <b>firmware  </b><span style="color:rgb(0,34,0);font-family:ui-monospace,"Cascadia Mono","Segoe UI Mono",Hack,"Source Code Pro","Roboto Mono",Menlo,Monaco,Consolas,monospace;font-size:13px"><b>3.3.004-74-gbd4e7196</b>
        on my Nissan Leaf I suspect (but can't be 100% sure as it's only
        been 24h without fault) the new poller caused the car to throw
        the attached faults from overloading the can bus whilst driving.
        The fault was sufficient to send the car into limp mode and
        could not be driven until cleared with LeafSpy.</span></blockquote>
    <br>
    Build 3.3.004-74 (released 2024-04-30) did not yet include the
    poller tracing control, i.e. it did lots of logging for frames,
    significantly affecting overall performance.<br>
    <br>
    Poller tracing control was introduced in
<a href="https://github.com/openvehicles/Open-Vehicle-Monitoring-System-3/commit/7e4046042a99339d0212aac8f874cc8f780e634e" target="_blank" rel="noreferrer">https://github.com/openvehicles/Open-Vehicle-Monitoring-System-3/commit/7e4046042a99339d0212aac8f874cc8f780e634e</a>
    on May 12.<br>
    <br>
    That commit was first included in build 3.3.004-103-g11fddbf6
    released 2024-05-25. Do you remember testing that build or a later
    one?<br>
    <br>
    <br>
    But as I still don't understand how a software queue overflow could
    cause a bus crash, I've also checked the 500 kbit timing for the
    MCP2515 and found that may have the same issue as the 125 kbit
    timing:<br>
    <br>
    Our timing is:<br>
    <font face="monospace">  case CAN_SPEED_500KBPS:<br>
          cnf1=0x00; cnf2=0xf0; cnf3=0x86;<br>
        = PROP=1, PS1=7, PS2=7, SJW=1, Sample 3x @56.3%</font><br>
    <br>
    Remember, the SAE/CiA recommendation is SJW=2, Sample 1x @87.5%.
    That would translate to:<br>
    <font face="monospace">  PROP=5, PS1=8, PS2=2, SJW=2, Sample 1x
      @87.5% =<br>
          cnf1=0x40; cnf2=0xbc; cnf3=0x81;</font><br>
    <br>
    I also checked the Arduino MCP_CAN lib, and that uses:<br>
    <font face="monospace">    cnf1=0x40; cnf2=0xe5; cnf3=0x83;</font><br>
    <font face="monospace">  = PROP=6, PS1=5, PS2=4, SJW=2, Sample 3x
      @75%<br>
    </font><br>
    So our timing for 500 kbit/s on the MCP buses also isn't as
    recommended.<br>
    <br>
    Derek, could you test the SAE/CiA recommendation and the MCP_CAN
    config as shown? Or anyone else with a live can2/can3 bus at 500
    kbit?<br>
    <br>
    If these work, the question is which is the more general setup we
    should adopt. Apparently the MCP_CAN lib also does not follow the
    CiA recommendation, I wonder if the MCP_CAN config is a compromise
    for compatibility.<br>
    <br>
    Regards,<br>
    Michael<br>
    <br>
    <br>
    <div>Am 19.01.25 um 19:07 schrieb Derek
      Caudwell via OvmsDev:<br>
    </div>
    <blockquote type="cite">
      
      <div dir="auto">
        <div>Hi Michael 
          <div dir="auto"><br>
          </div>
          <div dir="auto">I just used the firmware stock with no changes
            to the poller settings.</div>
          <div dir="auto"><br>
          </div>
          <div dir="auto">The Leaf is using high speeds on both buses:</div>
          RegisterCanBus(1,CAN_MODE_ACTIVE,CAN_SPEED_500KBPS);</div>
        <div dir="auto"> 
          RegisterCanBus(2,CAN_MODE_ACTIVE,CAN_SPEED_500KBPS);<br>
          <br>
          <div class="gmail_quote" dir="auto">
            <div dir="ltr" class="gmail_attr">On Sun, 19 Jan 2025, 10:15
              pm Michael Balzer via OvmsDev, <<a href="mailto:ovmsdev@lists.openvehicles.com" target="_blank" rel="noreferrer">ovmsdev@lists.openvehicles.com</a>>
              wrote:<br>
            </div>
            <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
              <div> Michael,<br>
                <br>
                I suggest adding a standard bool member variable to
                reflect if any filter is defined, so
                `PollerRxCallback()` can just skip the filter test while
                that is false. A mutex has some overhead, even if used
                non-blocking, and a bool variable only read there will
                be sufficient to signal "apply filtering" to the
                callback. With the simple bool test, all vehicles that
                don't need filtering (i.e. most vehicles) will have a
                neglectible impact from this.<br>
                <br>
                <br>
                Regarding the overhead: the GCC atomic implementation
                should use the xtensa CPU builtin atomic support
                (SCOMPARE1 register & S32C1I instruction), so should
                be pretty fast and not use any interrupt disabling, see:<br>
                <ul>
                  <li><a href="https://gcc.gnu.org/wiki/Atomic" rel="noreferrer noreferrer" target="_blank">https://gcc.gnu.org/wiki/Atomic</a>
                    (xtensa atomic support since gcc 4.4.0)<br>
                  </li>
                  <li><a href="https://www.cadence.com/content/dam/cadence-www/global/en_US/documents/tools/silicon-solutions/compute-ip/isa-summary.pdf" rel="noreferrer noreferrer" target="_blank">https://www.cadence.com/content/dam/cadence-www/global/en_US/documents/tools/silicon-solutions/compute-ip/isa-summary.pdf</a>
                    (section 4.3.13)</li>
                </ul>
                So I still doubt the queue overflow is the real culprit.<br>
                <br>
                But having the filter option doesn't hurt (with my
                suggestion above), and your changes to the queue
                processing look promising as well.<br>
                <br>
                @Derek: what was your poller tracing & timing setup
                when you had the bus issue on the Leaf? I still think
                that was something related to your car or setup. There
                are currently 11 Leafs on my server running "edge"
                releases including the new poller, all without
                (reported) issues.<br>
                <br>
                Regards,<br>
                Michael<br>
                <br>
                <br>
                <br>
                <div>Am 19.01.25 um 04:26 schrieb Michael Geddes:<br>
                </div>
                <blockquote type="cite">
                  <div dir="ltr">
                    <div>P/R Created</div>
                    <div dir="ltr"><a href="https://github.com/openvehicles/Open-Vehicle-Monitoring-System-3/pull/1100" rel="noreferrer noreferrer" target="_blank">https://github.com/openvehicles/Open-Vehicle-Monitoring-System-3/pull/1100</a></div>
                    <div>Let me know if you want me to split it up or
                      ANY changes and I'll get onto it asap.</div>
                    <div><br>
                    </div>
                    <div>Maybe somebody could grab the code and check it
                      out in the context of specifying some filters. 
                      This will prevent those messages from coming to
                      the vehicle implementation at all.. and even from
                      going through the poller queue.  It is
                      non-blocking meaning that the filter is briefly
                      inopperational while the filter is being
                      modified.  </div>
                    <div> </div>
                    <div>//.</div>
                    <div><br>
                    </div>
                    <br>
                    <div class="gmail_quote">
                      <div dir="ltr" class="gmail_attr">On Sun, 19 Jan
                        2025 at 11:02, Michael Geddes <<a href="mailto:frog@bunyip.wheelycreek.net" rel="noreferrer noreferrer" target="_blank">frog@bunyip.wheelycreek.net</a>>
                        wrote:<br>
                      </div>
                      <blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
                        <div dir="ltr">
                          <div dir="ltr"><br>
                          </div>
                          <br>
                          <div class="gmail_quote">
                            <div dir="ltr" class="gmail_attr">On Sat, 18
                              Jan 2025 at 17:08, Michael Balzer via
                              OvmsDev <<a href="mailto:ovmsdev@lists.openvehicles.com" rel="noreferrer noreferrer" target="_blank">ovmsdev@lists.openvehicles.com</a>>
                              wrote:<br>
                            </div>
                            <blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
                              <div> <br>
                                <blockquote type="cite"> I have
                                  commented out the line with the
                                  Atomic_Increment statement. Now I no
                                  longer receive any messages with “RX
                                  Task Queue Overflow Run”<br>
                                  Here is the output of <font face="monospace">poller times status</font>:</blockquote>
                                <br>
                                The main question is if you still get
                                the CAN bus crash (vehicle running into
                                issues) with that modification in active
                                mode. Timing statistics were not
                                expected to change.<br>
                              </div>
                            </blockquote>
                            <div>I have a feeling that the atomic
                              operations are along the lines of:</div>
                            <div><br>
                            </div>
                            <div>* Set Interrupts off</div>
                            <div>* atomic operation</div>
                            <div>* Set interrupts on</div>
                            <div><br>
                            </div>
                            <div>Which means no real 'blocking' .. just
                              not allowing interrupts and therefor task
                              switching for a couple of instructions.</div>
                            <div><br>
                            </div>
                            <div> </div>
                            <blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
                              <div> <br>
                                <br>
                                Nearly 2800 frames per second is quite a
                                lot, and most is on can1 with many frame
                                periods at 20 ms. Yet the total
                                processing time averages at 30-40 ms, so
                                there is no actual CPU capacity issue
                                for that amount of frames.<br>
                                <br>
                                @Derek: can you please supply these
                                statistics for the Leaf in drive mode as
                                well?<br>
                                <br>
                                <br>
                                <div>Am 18.01.25 um 02:42 schrieb
                                  Michael Geddes via OvmsDev:<br>
                                </div>
                                <blockquote type="cite">Maybe try
                                  setting
                                  CONFIG_OVMS_VEHICLE_CAN_RX_QUEUE_SIZE
                                  = 160   and see if that reduces the
                                  overflow?</blockquote>
                                <br>
                                Simons car sends at least 91 process
                                data frame IDs on can1 and 84 on can2.
                                Worst case would be these come all in
                                within the shortest possible time span,
                                that would mean the queue needs to be
                                able to hold 175 frames. I'd add some
                                headroom and round up to 200.<br>
                                <br>
                                But keep in mind, if the Incoming
                                processing actually occasionally gets
                                blocked for up to 60 ms -- as indicated
                                by Simons statistics --, the queue may
                                need to be twice as large.<br>
                                <br>
                                <br>
                                <div>Am 18.01.25 um 02:42 schrieb
                                  Michael Geddes via OvmsDev:<br>
                                </div>
                                <blockquote type="cite">
                                  <div> I was thinking that the frame
                                    filter would be here:</div>
                                  <div>void
                                    OvmsPollers::PollerRxCallback(const
                                    CAN_frame_t* frame, bool success)<br>
                                      {</div>
                                  <div>  Queue_PollerFrame(*frame,
                                    success, false);<br>
                                      }<br>
                                  </div>
                                  <div>which I guess is executed in  the
                                    task handling the CAN queue.  (we
                                    don't know how many frames get
                                    dropped there).</div>
                                </blockquote>
                                <br>
                                Actually we do know that, or at least
                                have some indication, as we count the
                                CAN transceiver queue overruns. That
                                info is included as "Rx overflw" in the
                                can status output & as "rxovr" in
                                the logs.<br>
                                <br>
                                Adding a filter before queueing the
                                frame would exclude the filtered IDs
                                from all vehicle processing. I meant
                                adding a filter just to exclude IDs from
                                the timing statistics, assuming those
                                are the culprits, as Simon wrote the
                                issue only appears after enabling the
                                timing statistics and printing them.
                                That's why I asked if printing might
                                need to lock the statistics for too long
                                in case of such a long list.<br>
                                <br>
                                Completely blocking ID ranges from
                                processing by the vehicle should
                                normally not be necessary, unless the
                                Incoming handler is written very poorly.<br>
                                <br>
                                <br>
                                Yet, if we add that, a mutex in the CAN
                                RX callback must be avoided, or would
                                need to be non-blocking:<br>
                                <br>
                                <blockquote type="cite">
                                  <div>The only real concern is thread
                                    safety between checking and adding
                                    to the filter - so the check itself
                                    might have to be mutexed.</div>
                                  <div>
                                    <div>void
                                      OvmsPollers::PollerRxCallback(const
                                      CAN_frame_t* frame, bool success)<br>
                                        {</div>
                                    <div>  // Check filter</div>
                                    <div>    {</div>
                                    <div>  OvmsRecMutexLock
                                      lock(&m_filter_mutex);<br>
                                    </div>
                                    <div>    if (!
                                      m_filter->IsFiltered(frame))</div>
                                    <div>      return;     </div>
                                    <div>    } <br>
                                        Queue_PollerFrame(*frame,
                                      success, false);<br>
                                        }</div>
                                  </div>
                                </blockquote>
                                <br>
                                A mutex like that could block the CAN
                                task, which must be avoided at all cost.
                                I introduced CAN callbacks for vehicles
                                & applications that need to react to
                                certain frames as fast as possible, e.g.
                                to maintain control precedence, so
                                cannot use the standard CAN listener
                                mechanism (frame queueing).<br>
                                <br>
                                The current poller callback use is OK,
                                if (!) the atomic type really isn't the
                                culprit, ie doesn't block.<br>
                                <br>
                                So if (!) an ID filter needs to be added
                                before queueing, it needs to be done in
                                a way that needs no mutex. But I don't
                                see an issue with the vehicle passing a
                                fixed filter when registering with the
                                poller/buses. The filter doesn't need to
                                by mutable on the fly.<br>
                                <br>
                                <br>
                                Regards,<br>
                                Michael<br>
                                <br>
                                <br>
                                <br>
                                <div>Am 17.01.25 um 19:42 schrieb Simon
                                  Ehlen via OvmsDev:<br>
                                </div>
                                <blockquote type="cite">
                                  <div>
                                    <blockquote type="cite">The poller
                                      statistics can help you track this
                                      down, but you need to have at
                                      least 10 seconds of statistics,
                                      the more the better. Rule of
                                      thumb: PRI average at 0.0/second
                                      means you don't have enough data
                                      yet.</blockquote>
                                    <br>
                                    There were again many messages with
                                    “RX Task Queue Overflow Run”.<br>
                                    Here are the statistics of <font face="monospace">poller times
                                      status</font>:<br>
                                    <br>
                                    <font face="monospace">OVMS# poll
                                      times status<br>
                                      Poller timing is: on<br>
                                      Type           | count  | Utlztn |
                                      Time<br>
                                                     | per s  | [%]    |
                                      [ms]<br>
---------------+--------+--------+---------<br>
                                      Poll:PRI    Avg|    1.00| 
                                      0.0043|    0.004<br>
                                                 Peak|        | 
                                      0.0043|    0.052<br>
---------------+--------+--------+---------<br>
                                      RxCan1[010] Avg|   34.26| 
                                      1.6741|    0.015<br>
                                                 Peak|        | 
                                      1.6741|    1.182<br>
---------------+--------+--------+---------<br>
                                      RxCan1[030] Avg|   34.06| 
                                      1.7085|    0.020<br>
                                                 Peak|        | 
                                      1.7085|    1.390<br>
---------------+--------+--------+---------<br>
                                      RxCan1[041] Avg|   49.89| 
                                      0.8109|    0.016<br>
                                                 Peak|        | 
                                      0.8541|    1.098<br>
---------------+--------+--------+---------<br>
                                      RxCan1[049] Avg|   50.00| 
                                      1.5970|    0.019<br>
                                                 Peak|        | 
                                      1.7154|   32.233<br>
---------------+--------+--------+---------<br>
                                      RxCan1[04c] Avg|   49.92| 
                                      0.8340|    0.014<br>
                                                 Peak|        | 
                                      0.8933|    1.995<br>
---------------+--------+--------+---------<br>
                                      RxCan1[04d] Avg|   34.43| 
                                      1.6211|    0.014<br>
                                                 Peak|        | 
                                      1.6756|    1.318<br>
---------------+--------+--------+---------<br>
                                      RxCan1[076] Avg|   50.00| 
                                      0.8362|    0.024<br>
                                                 Peak|        | 
                                      0.8784|    2.185<br>
---------------+--------+--------+---------<br>
                                      RxCan1[077] Avg|   50.00| 
                                      0.7837|    0.014<br>
                                                 Peak|        | 
                                      0.8083|    1.156<br>
---------------+--------+--------+---------<br>
                                      RxCan1[07a] Avg|   34.31| 
                                      2.1870|    0.017<br>
                                                 Peak|        | 
                                      2.3252|    1.888<br>
---------------+--------+--------+---------<br>
                                      RxCan1[07d] Avg|   50.00| 
                                      0.8001|    0.013<br>
                                                 Peak|        | 
                                      0.8434|    1.150<br>
---------------+--------+--------+---------<br>
                                      RxCan1[0c8] Avg|   49.96| 
                                      0.8359|    0.013<br>
                                                 Peak|        | 
                                      0.8715|    1.171<br>
---------------+--------+--------+---------<br>
                                      RxCan1[11a] Avg|   34.35| 
                                      1.6701|    0.020<br>
                                                 Peak|        | 
                                      1.6981|    1.273<br>
---------------+--------+--------+---------<br>
                                      RxCan1[130] Avg|   50.00| 
                                      0.7902|    0.018<br>
                                                 Peak|        | 
                                      0.8513|    0.980<br>
---------------+--------+--------+---------<br>
                                      RxCan1[139] Avg|   49.92| 
                                      0.7872|    0.013<br>
                                                 Peak|        | 
                                      0.8219|    0.795<br>
---------------+--------+--------+---------<br>
                                      RxCan1[156] Avg|   10.00| 
                                      0.1620|    0.014<br>
                                                 Peak|        | 
                                      0.1729|    0.919<br>
---------------+--------+--------+---------<br>
                                      RxCan1[160] Avg|   50.04| 
                                      0.7977|    0.014<br>
                                                 Peak|        | 
                                      0.8232|    1.495<br>
---------------+--------+--------+---------<br>
                                      RxCan1[165] Avg|   49.85| 
                                      0.7976|    0.014<br>
                                                 Peak|        | 
                                      0.8486|    1.015<br>
---------------+--------+--------+---------<br>
                                      RxCan1[167] Avg|   34.39| 
                                      1.6025|    0.016<br>
                                                 Peak|        | 
                                      1.6888|    1.354<br>
---------------+--------+--------+---------<br>
                                      RxCan1[171] Avg|   50.00| 
                                      0.8150|    0.017<br>
                                                 Peak|        | 
                                      0.8488|    1.091<br>
---------------+--------+--------+---------<br>
                                      RxCan1[178] Avg|   10.00| 
                                      0.1614|    0.014<br>
                                                 Peak|        | 
                                      0.1702|    0.903<br>
---------------+--------+--------+---------<br>
                                      RxCan1[179] Avg|   10.00| 
                                      0.1630|    0.017<br>
                                                 Peak|        | 
                                      0.1663|    1.336<br>
---------------+--------+--------+---------<br>
                                      RxCan1[180] Avg|   50.00| 
                                      0.8137|    0.014<br>
                                                 Peak|        | 
                                      0.8605|    1.566<br>
---------------+--------+--------+---------<br>
                                      RxCan1[185] Avg|   50.04| 
                                      0.8033|    0.013<br>
                                                 Peak|        | 
                                      0.8393|    1.126<br>
---------------+--------+--------+---------<br>
                                      RxCan1[1a0] Avg|   49.92| 
                                      0.7748|    0.013<br>
                                                 Peak|        | 
                                      0.8169|    1.184<br>
---------------+--------+--------+---------<br>
                                      RxCan1[1e0] Avg|   49.92| 
                                      0.7738|    0.014<br>
                                                 Peak|        | 
                                      0.8028|    1.049<br>
---------------+--------+--------+---------<br>
                                      RxCan1[1e4] Avg|   49.89| 
                                      0.9692|    0.018<br>
                                                 Peak|        | 
                                      1.0096|    1.332<br>
---------------+--------+--------+---------<br>
                                      RxCan1[1f0] Avg|   33.22| 
                                      0.5544|    0.014<br>
                                                 Peak|        | 
                                      0.5855|    0.848<br>
---------------+--------+--------+---------<br>
                                      RxCan1[200] Avg|   49.92| 
                                      0.7879|    0.015<br>
                                                 Peak|        | 
                                      0.8345|    1.206<br>
---------------+--------+--------+---------<br>
                                      RxCan1[202] Avg|   34.28| 
                                      1.7075|    0.016<br>
                                                 Peak|        | 
                                      1.7874|    1.218<br>
---------------+--------+--------+---------<br>
                                      RxCan1[204] Avg|   34.35| 
                                      1.5641|    0.013<br>
                                                 Peak|        | 
                                      1.6427|    1.235<br>
---------------+--------+--------+---------<br>
                                      RxCan1[213] Avg|   49.89| 
                                      0.7814|    0.015<br>
                                                 Peak|        | 
                                      0.8232|    0.910<br>
---------------+--------+--------+---------<br>
                                      RxCan1[214] Avg|   49.92| 
                                      0.7736|    0.014<br>
                                                 Peak|        | 
                                      0.8216|    0.800<br>
---------------+--------+--------+---------<br>
                                      RxCan1[217] Avg|   34.31| 
                                      1.6294|    0.014<br>
                                                 Peak|        | 
                                      1.7165|    1.153<br>
---------------+--------+--------+---------<br>
                                      RxCan1[218] Avg|   49.86| 
                                      0.7877|    0.013<br>
                                                 Peak|        | 
                                      0.8290|    1.068<br>
---------------+--------+--------+---------<br>
                                      RxCan1[230] Avg|   50.00| 
                                      0.7596|    0.014<br>
                                                 Peak|        | 
                                      0.7660|    1.021<br>
---------------+--------+--------+---------<br>
                                      RxCan1[240] Avg|   10.00| 
                                      0.1669|    0.013<br>
                                                 Peak|        | 
                                      0.1835|    0.887<br>
---------------+--------+--------+---------<br>
                                      RxCan1[242] Avg|   24.96| 
                                      0.4764|    0.020<br>
                                                 Peak|        | 
                                      0.4963|    1.501<br>
---------------+--------+--------+---------<br>
                                      RxCan1[24a] Avg|    9.89| 
                                      0.1789|    0.015<br>
                                                 Peak|        | 
                                      0.2009|    0.874<br>
---------------+--------+--------+---------<br>
                                      RxCan1[24b] Avg|    9.89| 
                                      0.1702|    0.014<br>
                                                 Peak|        | 
                                      0.1870|    1.195<br>
---------------+--------+--------+---------<br>
                                      RxCan1[24c] Avg|    9.89| 
                                      0.2146|    0.019<br>
                                                 Peak|        | 
                                      0.2187|    1.242<br>
---------------+--------+--------+---------<br>
                                      RxCan1[25a] Avg|   10.00| 
                                      0.1603|    0.013<br>
                                                 Peak|        | 
                                      0.1667|    0.720<br>
---------------+--------+--------+---------<br>
                                      RxCan1[25b] Avg|   49.94| 
                                      0.7918|    0.017<br>
                                                 Peak|        | 
                                      0.8454|    1.666<br>
---------------+--------+--------+---------<br>
                                      RxCan1[25c] Avg|   34.24| 
                                      1.5331|    0.013<br>
                                                 Peak|        | 
                                      1.5997|    1.538<br>
---------------+--------+--------+---------<br>
                                      RxCan1[260] Avg|   10.00| 
                                      0.1626|    0.014<br>
                                                 Peak|        | 
                                      0.1682|    0.718<br>
---------------+--------+--------+---------<br>
                                      RxCan1[270] Avg|   49.90| 
                                      0.8120|    0.014<br>
                                                 Peak|        | 
                                      0.8460|    1.671<br>
---------------+--------+--------+---------<br>
                                      RxCan1[280] Avg|   49.92| 
                                      0.7777|    0.019<br>
                                                 Peak|        | 
                                      0.8447|    1.157<br>
---------------+--------+--------+---------<br>
                                      RxCan1[2e4] Avg|   19.89| 
                                      0.5778|    0.032<br>
                                                 Peak|        | 
                                      0.6648|    2.226<br>
---------------+--------+--------+---------<br>
                                      RxCan1[2ec] Avg|   10.00| 
                                      0.1701|    0.014<br>
                                                 Peak|        | 
                                      0.1755|    0.928<br>
---------------+--------+--------+---------<br>
                                      RxCan1[2ed] Avg|   10.00| 
                                      0.1650|    0.013<br>
                                                 Peak|        | 
                                      0.1747|    0.917<br>
---------------+--------+--------+---------<br>
                                      RxCan1[2ee] Avg|    9.98| 
                                      0.1544|    0.013<br>
                                                 Peak|        | 
                                      0.1588|    1.312<br>
---------------+--------+--------+---------<br>
                                      RxCan1[312] Avg|   10.00| 
                                      0.1648|    0.017<br>
                                                 Peak|        | 
                                      0.1690|    0.922<br>
---------------+--------+--------+---------<br>
                                      RxCan1[326] Avg|    9.89| 
                                      0.1603|    0.015<br>
                                                 Peak|        | 
                                      0.1833|    1.230<br>
---------------+--------+--------+---------<br>
                                      RxCan1[336] Avg|    1.00| 
                                      0.0146|    0.015<br>
                                                 Peak|        | 
                                      0.0150|    0.349<br>
---------------+--------+--------+---------<br>
                                      RxCan1[352] Avg|    6.66| 
                                      0.1223|    0.022<br>
                                                 Peak|        | 
                                      0.1338|    1.015<br>
---------------+--------+--------+---------<br>
                                      RxCan1[355] Avg|    2.00| 
                                      0.0424|    0.019<br>
                                                 Peak|        | 
                                      0.0431|    0.786<br>
---------------+--------+--------+---------<br>
                                      RxCan1[35e] Avg|    9.96| 
                                      0.1570|    0.013<br>
                                                 Peak|        | 
                                      0.1644|    0.579<br>
---------------+--------+--------+---------<br>
                                      RxCan1[365] Avg|   10.00| 
                                      0.1600|    0.014<br>
                                                 Peak|        | 
                                      0.1653|    0.961<br>
---------------+--------+--------+---------<br>
                                      RxCan1[366] Avg|   10.00| 
                                      0.1716|    0.013<br>
                                                 Peak|        | 
                                      0.1890|    0.987<br>
---------------+--------+--------+---------<br>
                                      RxCan1[367] Avg|    9.93| 
                                      0.1793|    0.015<br>
                                                 Peak|        | 
                                      0.1864|    0.984<br>
---------------+--------+--------+---------<br>
                                      RxCan1[368] Avg|   10.00| 
                                      0.1645|    0.014<br>
                                                 Peak|        | 
                                      0.1778|    0.768<br>
---------------+--------+--------+---------<br>
                                      RxCan1[369] Avg|   10.00| 
                                      0.1562|    0.016<br>
                                                 Peak|        | 
                                      0.1606|    0.724<br>
---------------+--------+--------+---------<br>
                                      RxCan1[380] Avg|   10.00| 
                                      0.1619|    0.014<br>
                                                 Peak|        | 
                                      0.1644|    0.605<br>
---------------+--------+--------+---------<br>
                                      RxCan1[38b] Avg|   25.00| 
                                      0.3991|    0.016<br>
                                                 Peak|        | 
                                      0.4280|    1.448<br>
---------------+--------+--------+---------<br>
                                      RxCan1[3b3] Avg|   10.00| 
                                      0.1537|    0.013<br>
                                                 Peak|        | 
                                      0.1610|    0.380<br>
---------------+--------+--------+---------<br>
                                      RxCan1[400] Avg|    4.00| 
                                      0.0626|    0.014<br>
                                                 Peak|        | 
                                      0.0626|    0.251<br>
---------------+--------+--------+---------<br>
                                      RxCan1[405] Avg|    3.90| 
                                      0.1019|    0.028<br>
                                                 Peak|        | 
                                      0.1019|    0.781<br>
---------------+--------+--------+---------<br>
                                      RxCan1[40a] Avg|    7.90| 
                                      0.1256|    0.020<br>
                                                 Peak|        | 
                                      0.1256|    0.991<br>
---------------+--------+--------+---------<br>
                                      RxCan1[410] Avg|   10.00| 
                                      0.1643|    0.016<br>
                                                 Peak|        | 
                                      0.1839|    1.634<br>
---------------+--------+--------+---------<br>
                                      RxCan1[411] Avg|   10.00| 
                                      0.1532|    0.013<br>
                                                 Peak|        | 
                                      0.1645|    0.824<br>
---------------+--------+--------+---------<br>
                                      RxCan1[416] Avg|   10.00| 
                                      0.1516|    0.016<br>
                                                 Peak|        | 
                                      0.1582|    0.807<br>
---------------+--------+--------+---------<br>
                                      RxCan1[421] Avg|   10.00| 
                                      0.1648|    0.013<br>
                                                 Peak|        | 
                                      0.1740|    0.839<br>
---------------+--------+--------+---------<br>
                                      RxCan1[42d] Avg|   10.00| 
                                      0.1548|    0.014<br>
                                                 Peak|        | 
                                      0.1658|    0.741<br>
---------------+--------+--------+---------<br>
                                      RxCan1[42f] Avg|   10.00| 
                                      0.1527|    0.013<br>
                                                 Peak|        | 
                                      0.1578|    0.667<br>
---------------+--------+--------+---------<br>
                                      RxCan1[430] Avg|   10.00| 
                                      0.1730|    0.016<br>
                                                 Peak|        | 
                                      0.1880|    1.209<br>
---------------+--------+--------+---------<br>
                                      RxCan1[434] Avg|   10.00| 
                                      0.1620|    0.021<br>
                                                 Peak|        | 
                                      0.1712|    1.140<br>
---------------+--------+--------+---------<br>
                                      RxCan1[435] Avg|    6.66| 
                                      0.1104|    0.014<br>
                                                 Peak|        | 
                                      0.1121|    1.011<br>
---------------+--------+--------+---------<br>
                                      RxCan1[43e] Avg|   20.00| 
                                      0.3194|    0.013<br>
                                                 Peak|        | 
                                      0.3434|    1.212<br>
---------------+--------+--------+---------<br>
                                      RxCan1[440] Avg|    1.00| 
                                      0.0160|    0.014<br>
                                                 Peak|        | 
                                      0.0175|    0.315<br>
---------------+--------+--------+---------<br>
                                      RxCan1[465] Avg|    1.00| 
                                      0.0172|    0.015<br>
                                                 Peak|        | 
                                      0.0194|    0.404<br>
---------------+--------+--------+---------<br>
                                      RxCan1[466] Avg|    1.00| 
                                      0.0198|    0.015<br>
                                                 Peak|        | 
                                      0.0252|    0.890<br>
---------------+--------+--------+---------<br>
                                      RxCan1[467] Avg|    1.00| 
                                      0.0152|    0.014<br>
                                                 Peak|        | 
                                      0.0160|    0.217<br>
---------------+--------+--------+---------<br>
                                      RxCan1[472] Avg|    0.70| 
                                      0.0533|    0.075<br>
                                                 Peak|        | 
                                      0.0546|    0.990<br>
---------------+--------+--------+---------<br>
                                      RxCan1[473] Avg|    0.65| 
                                      0.0325|    0.051<br>
                                                 Peak|        | 
                                      0.0361|    0.774<br>
---------------+--------+--------+---------<br>
                                      RxCan1[474] Avg|    1.00| 
                                      0.0146|    0.014<br>
                                                 Peak|        | 
                                      0.0151|    0.189<br>
---------------+--------+--------+---------<br>
                                      RxCan1[475] Avg|    2.00| 
                                      0.0332|    0.015<br>
                                                 Peak|        | 
                                      0.0362|    0.513<br>
---------------+--------+--------+---------<br>
                                      RxCan1[476] Avg|    2.00| 
                                      0.0305|    0.014<br>
                                                 Peak|        | 
                                      0.0307|    0.249<br>
---------------+--------+--------+---------<br>
                                      RxCan1[477] Avg|    2.00| 
                                      0.0309|    0.014<br>
                                                 Peak|        | 
                                      0.0311|    0.438<br>
---------------+--------+--------+---------<br>
                                      RxCan1[595] Avg|    1.00| 
                                      0.0151|    0.014<br>
                                                 Peak|        | 
                                      0.0160|    0.230<br>
---------------+--------+--------+---------<br>
                                      RxCan1[59e] Avg|    1.00| 
                                      0.0179|    0.015<br>
                                                 Peak|        | 
                                      0.0209|    0.716<br>
---------------+--------+--------+---------<br>
                                      RxCan1[5a2] Avg|    1.00| 
                                      0.0154|    0.016<br>
                                                 Peak|        | 
                                      0.0184|    0.699<br>
---------------+--------+--------+---------<br>
                                      RxCan1[5ba] Avg|    1.00| 
                                      0.0159|    0.017<br>
                                                 Peak|        | 
                                      0.0174|    0.485<br>
---------------+--------+--------+---------<br>
                                      RxCan2[010] Avg|    0.00| 
                                      0.0000|    0.015<br>
                                                 Peak|        | 
                                      0.0000|    0.146<br>
---------------+--------+--------+---------<br>
                                      RxCan2[020] Avg|   31.10| 
                                      0.5159|    0.015<br>
                                                 Peak|        | 
                                      0.5730|    0.992<br>
---------------+--------+--------+---------<br>
                                      RxCan2[030] Avg|   20.70| 
                                      0.3506|    0.016<br>
                                                 Peak|        | 
                                      0.3956|    1.055<br>
---------------+--------+--------+---------<br>
                                      RxCan2[03a] Avg|   18.65| 
                                      0.3157|    0.014<br>
                                                 Peak|        | 
                                      0.3292|    0.702<br>
---------------+--------+--------+---------<br>
                                      RxCan2[040] Avg|   18.60| 
                                      0.3111|    0.015<br>
                                                 Peak|        | 
                                      0.3474|    0.953<br>
---------------+--------+--------+---------<br>
                                      RxCan2[060] Avg|   18.60| 
                                      0.3182|    0.014<br>
                                                 Peak|        | 
                                      0.3569|    0.694<br>
---------------+--------+--------+---------<br>
                                      RxCan2[070] Avg|   15.55| 
                                      0.4581|    0.017<br>
                                                 Peak|        | 
                                      0.6859|   39.212<br>
---------------+--------+--------+---------<br>
                                      RxCan2[080] Avg|   15.50| 
                                      0.5041|    0.029<br>
                                                 Peak|        | 
                                      0.5414|    1.555<br>
---------------+--------+--------+---------<br>
                                      RxCan2[083] Avg|   18.70| 
                                      0.3083|    0.014<br>
                                                 Peak|        | 
                                      0.3325|    0.557<br>
---------------+--------+--------+---------<br>
                                      RxCan2[090] Avg|   23.40| 
                                      0.3961|    0.014<br>
                                                 Peak|        | 
                                      0.4445|    1.218<br>
---------------+--------+--------+---------<br>
                                      RxCan2[0a0] Avg|   15.55| 
                                      0.2734|    0.014<br>
                                                 Peak|        | 
                                      0.3144|    1.062<br>
---------------+--------+--------+---------<br>
                                      RxCan2[100] Avg|   15.50| 
                                      0.2645|    0.016<br>
                                                 Peak|        | 
                                      0.2875|    1.021<br>
---------------+--------+--------+---------<br>
                                      RxCan2[108] Avg|   23.40| 
                                      0.4231|    0.016<br>
                                                 Peak|        | 
                                      0.4680|    1.297<br>
---------------+--------+--------+---------<br>
                                      RxCan2[110] Avg|   15.55| 
                                      0.2467|    0.014<br>
                                                 Peak|        | 
                                      0.2684|    0.475<br>
---------------+--------+--------+---------<br>
                                      RxCan2[130] Avg|   13.30| 
                                      0.2231|    0.014<br>
                                                 Peak|        | 
                                      0.2447|    0.512<br>
---------------+--------+--------+---------<br>
                                      RxCan2[150] Avg|   15.50| 
                                      0.2533|    0.015<br>
                                                 Peak|        | 
                                      0.2836|    0.823<br>
---------------+--------+--------+---------<br>
                                      RxCan2[160] Avg|    4.70| 
                                      0.0784|    0.014<br>
                                                 Peak|        | 
                                      0.0863|    0.608<br>
---------------+--------+--------+---------<br>
                                      RxCan2[180] Avg|   15.55| 
                                      0.2713|    0.015<br>
                                                 Peak|        | 
                                      0.2841|    0.884<br>
---------------+--------+--------+---------<br>
                                      RxCan2[190] Avg|   15.50| 
                                      0.2596|    0.014<br>
                                                 Peak|        | 
                                      0.2825|    0.743<br>
---------------+--------+--------+---------<br>
                                      RxCan2[1a0] Avg|    0.95| 
                                      0.0164|    0.015<br>
                                                 Peak|        | 
                                      0.0164|    0.346<br>
---------------+--------+--------+---------<br>
                                      RxCan2[1a4] Avg|   18.65| 
                                      0.3232|    0.015<br>
                                                 Peak|        | 
                                      0.3515|    0.989<br>
---------------+--------+--------+---------<br>
                                      RxCan2[1a8] Avg|   11.60| 
                                      0.1911|    0.016<br>
                                                 Peak|        | 
                                      0.2012|    0.757<br>
---------------+--------+--------+---------<br>
                                      RxCan2[1b0] Avg|    9.35| 
                                      0.1558|    0.016<br>
                                                 Peak|        | 
                                      0.1641|    0.795<br>
---------------+--------+--------+---------<br>
                                      RxCan2[1b4] Avg|    9.35| 
                                      0.1543|    0.015<br>
                                                 Peak|        | 
                                      0.1617|    1.217<br>
---------------+--------+--------+---------<br>
                                      RxCan2[1b8] Avg|   11.65| 
                                      0.2003|    0.014<br>
                                                 Peak|        | 
                                      0.2236|    1.549<br>
---------------+--------+--------+---------<br>
                                      RxCan2[1c0] Avg|    9.40| 
                                      0.1532|    0.016<br>
                                                 Peak|        | 
                                      0.1673|    0.955<br>
---------------+--------+--------+---------<br>
                                      RxCan2[1e0] Avg|    9.30| 
                                      0.1582|    0.015<br>
                                                 Peak|        | 
                                      0.1708|    0.661<br>
---------------+--------+--------+---------<br>
                                      RxCan2[215] Avg|    7.80| 
                                      0.1409|    0.016<br>
                                                 Peak|        | 
                                      0.1531|    0.660<br>
---------------+--------+--------+---------<br>
                                      RxCan2[217] Avg|    7.80| 
                                      0.1239|    0.014<br>
                                                 Peak|        | 
                                      0.1333|    0.520<br>
---------------+--------+--------+---------<br>
                                      RxCan2[220] Avg|    6.20| 
                                      0.1041|    0.015<br>
                                                 Peak|        | 
                                      0.1094|    0.652<br>
---------------+--------+--------+---------<br>
                                      RxCan2[225] Avg|   23.40| 
                                      0.4648|    0.015<br>
                                                 Peak|        | 
                                      0.4696|    4.288<br>
---------------+--------+--------+---------<br>
                                      RxCan2[230] Avg|    6.20| 
                                      0.3120|    0.048<br>
                                                 Peak|        | 
                                      0.3377|    1.065<br>
---------------+--------+--------+---------<br>
                                      RxCan2[240] Avg|    7.70| 
                                      0.1248|    0.014<br>
                                                 Peak|        | 
                                      0.1364|    0.635<br>
---------------+--------+--------+---------<br>
                                      RxCan2[241] Avg|   18.60| 
                                      0.3258|    0.014<br>
                                                 Peak|        | 
                                      0.3343|    1.288<br>
---------------+--------+--------+---------<br>
                                      RxCan2[250] Avg|    4.70| 
                                      0.0761|    0.014<br>
                                                 Peak|        | 
                                      0.0809|    0.322<br>
---------------+--------+--------+---------<br>
                                      RxCan2[255] Avg|   11.75| 
                                      0.2058|    0.014<br>
                                                 Peak|        | 
                                      0.2283|    0.937<br>
---------------+--------+--------+---------<br>
                                      RxCan2[265] Avg|   11.65| 
                                      0.1964|    0.014<br>
                                                 Peak|        | 
                                      0.2068|    0.965<br>
---------------+--------+--------+---------<br>
                                      RxCan2[270] Avg|    4.70| 
                                      0.0808|    0.016<br>
                                                 Peak|        | 
                                      0.0949|    0.729<br>
---------------+--------+--------+---------<br>
                                      RxCan2[290] Avg|    3.15| 
                                      0.0498|    0.015<br>
                                                 Peak|        | 
                                      0.0504|    0.449<br>
---------------+--------+--------+---------<br>
                                      RxCan2[295] Avg|    6.25| 
                                      0.1019|    0.014<br>
                                                 Peak|        | 
                                      0.1094|    0.859<br>
---------------+--------+--------+---------<br>
                                      RxCan2[2a0] Avg|    3.15| 
                                      0.0550|    0.014<br>
                                                 Peak|        | 
                                      0.0551|    0.779<br>
---------------+--------+--------+---------<br>
                                      RxCan2[2a7] Avg|   11.65| 
                                      0.1929|    0.014<br>
                                                 Peak|        | 
                                      0.2080|    0.775<br>
---------------+--------+--------+---------<br>
                                      RxCan2[2b0] Avg|    3.00| 
                                      0.0497|    0.015<br>
                                                 Peak|        | 
                                      0.0562|    0.528<br>
---------------+--------+--------+---------<br>
                                      RxCan2[2c0] Avg|    3.10| 
                                      0.0534|    0.016<br>
                                                 Peak|        | 
                                      0.0592|    0.501<br>
---------------+--------+--------+---------<br>
                                      RxCan2[2e0] Avg|    1.55| 
                                      0.0247|    0.014<br>
                                                 Peak|        | 
                                      0.0289|    0.319<br>
---------------+--------+--------+---------<br>
                                      RxCan2[2f0] Avg|    1.55| 
                                      0.0244|    0.014<br>
                                                 Peak|        | 
                                      0.0273|    0.192<br>
---------------+--------+--------+---------<br>
                                      RxCan2[2f5] Avg|   11.65| 
                                      0.2078|    0.016<br>
                                                 Peak|        | 
                                      0.2333|    0.879<br>
---------------+--------+--------+---------<br>
                                      RxCan2[300] Avg|    1.60| 
                                      0.0266|    0.018<br>
                                                 Peak|        | 
                                      0.0278|    0.724<br>
---------------+--------+--------+---------<br>
                                      RxCan2[310] Avg|    1.55| 
                                      0.0276|    0.016<br>
                                                 Peak|        | 
                                      0.0285|    0.759<br>
---------------+--------+--------+---------<br>
                                      RxCan2[320] Avg|    1.60| 
                                      0.0240|    0.014<br>
                                                 Peak|        | 
                                      0.0258|    0.179<br>
---------------+--------+--------+---------<br>
                                      RxCan2[326] Avg|    9.30| 
                                      0.1550|    0.014<br>
                                                 Peak|        | 
                                      0.1582|    0.850<br>
---------------+--------+--------+---------<br>
                                      RxCan2[330] Avg|   29.95| 
                                      0.5311|    0.015<br>
                                                 Peak|        | 
                                      0.5565|    4.522<br>
---------------+--------+--------+---------<br>
                                      RxCan2[340] Avg|    7.75| 
                                      0.1693|    0.024<br>
                                                 Peak|        | 
                                      0.1868|    1.148<br>
---------------+--------+--------+---------<br>
                                      RxCan2[345] Avg|    1.60| 
                                      0.0292|    0.016<br>
                                                 Peak|        | 
                                      0.0316|    0.471<br>
---------------+--------+--------+---------<br>
                                      RxCan2[350] Avg|    0.00| 
                                      0.0000|    0.019<br>
                                                 Peak|        | 
                                      0.0000|    0.188<br>
---------------+--------+--------+---------<br>
                                      RxCan2[35e] Avg|    4.70| 
                                      0.0851|    0.019<br>
                                                 Peak|        | 
                                      0.0911|    1.023<br>
---------------+--------+--------+---------<br>
                                      RxCan2[360] Avg|    1.60| 
                                      0.0258|    0.015<br>
                                                 Peak|        | 
                                      0.0284|    0.306<br>
---------------+--------+--------+---------<br>
                                      RxCan2[361] Avg|    7.75| 
                                      0.1341|    0.017<br>
                                                 Peak|        | 
                                      0.1487|    0.761<br>
---------------+--------+--------+---------<br>
                                      RxCan2[363] Avg|    1.20| 
                                      0.0203|    0.016<br>
                                                 Peak|        | 
                                      0.0220|    0.421<br>
---------------+--------+--------+---------<br>
                                      RxCan2[370] Avg|    0.85| 
                                      0.0140|    0.016<br>
                                                 Peak|        | 
                                      0.0162|    0.354<br>
---------------+--------+--------+---------<br>
                                      RxCan2[381] Avg|    3.15| 
                                      0.0512|    0.016<br>
                                                 Peak|        | 
                                      0.0546|    0.416<br>
---------------+--------+--------+---------<br>
                                      RxCan2[3a0] Avg|   15.60| 
                                      0.2548|    0.015<br>
                                                 Peak|        | 
                                      0.2890|    0.976<br>
---------------+--------+--------+---------<br>
                                      RxCan2[3d0] Avg|    9.35| 
                                      0.1553|    0.019<br>
                                                 Peak|        | 
                                      0.1612|    1.115<br>
---------------+--------+--------+---------<br>
                                      RxCan2[3d5] Avg|    5.15| 
                                      0.0836|    0.016<br>
                                                 Peak|        | 
                                      0.0867|    0.479<br>
---------------+--------+--------+---------<br>
                                      RxCan2[3e0] Avg|    0.00| 
                                      0.0000|    0.014<br>
                                                 Peak|        | 
                                      0.0000|    0.142<br>
---------------+--------+--------+---------<br>
                                      RxCan2[400] Avg|    3.55| 
                                      0.0613|    0.017<br>
                                                 Peak|        | 
                                      0.0695|    0.501<br>
---------------+--------+--------+---------<br>
                                      RxCan2[405] Avg|    3.50| 
                                      0.0584|    0.018<br>
                                                 Peak|        | 
                                      0.0626|    0.686<br>
---------------+--------+--------+---------<br>
                                      RxCan2[40a] Avg|    7.10| 
                                      0.1278|    0.017<br>
                                                 Peak|        | 
                                      0.1389|    1.244<br>
---------------+--------+--------+---------<br>
                                      RxCan2[415] Avg|    1.60| 
                                      0.0258|    0.014<br>
                                                 Peak|        | 
                                      0.0287|    0.266<br>
---------------+--------+--------+---------<br>
                                      RxCan2[435] Avg|    0.85| 
                                      0.0165|    0.019<br>
                                                 Peak|        | 
                                      0.0167|    0.367<br>
---------------+--------+--------+---------<br>
                                      RxCan2[440] Avg|    0.85| 
                                      0.0128|    0.019<br>
                                                 Peak|        | 
                                      0.0141|    0.885<br>
---------------+--------+--------+---------<br>
                                      RxCan2[465] Avg|    0.95| 
                                      0.0177|    0.016<br>
                                                 Peak|        | 
                                      0.0195|    0.721<br>
---------------+--------+--------+---------<br>
                                      RxCan2[466] Avg|    0.95| 
                                      0.0147|    0.014<br>
                                                 Peak|        | 
                                      0.0160|    0.184<br>
---------------+--------+--------+---------<br>
                                      RxCan2[467] Avg|    0.95| 
                                      0.0172|    0.017<br>
                                                 Peak|        | 
                                      0.0188|    0.391<br>
---------------+--------+--------+---------<br>
                                      RxCan2[501] Avg|    1.45| 
                                      0.0273|    0.016<br>
                                                 Peak|        | 
                                      0.0327|    0.996<br>
---------------+--------+--------+---------<br>
                                      RxCan2[503] Avg|    1.45| 
                                      0.0288|    0.020<br>
                                                 Peak|        | 
                                      0.0338|    0.970<br>
---------------+--------+--------+---------<br>
                                      RxCan2[504] Avg|    1.40| 
                                      0.0241|    0.015<br>
                                                 Peak|        | 
                                      0.0263|    0.609<br>
---------------+--------+--------+---------<br>
                                      RxCan2[505] Avg|    1.40| 
                                      0.0255|    0.015<br>
                                                 Peak|        | 
                                      0.0296|    0.866<br>
---------------+--------+--------+---------<br>
                                      RxCan2[508] Avg|    1.35| 
                                      0.0237|    0.017<br>
                                                 Peak|        | 
                                      0.0237|    0.384<br>
---------------+--------+--------+---------<br>
                                      RxCan2[511] Avg|    1.35| 
                                      0.0226|    0.016<br>
                                                 Peak|        | 
                                      0.0228|    0.426<br>
---------------+--------+--------+---------<br>
                                      RxCan2[51e] Avg|    1.40| 
                                      0.0221|    0.014<br>
                                                 Peak|        | 
                                      0.0245|    0.211<br>
---------------+--------+--------+---------<br>
                                      RxCan2[581] Avg|    0.80| 
                                      0.0189|    0.019<br>
                                                 Peak|        | 
                                      0.0290|    1.217<br>
---------------+--------+--------+---------<br>
                                      RxCan2[606] Avg|    0.00| 
                                      0.0000|    0.014<br>
                                                 Peak|        | 
                                      0.0000|    0.142<br>
---------------+--------+--------+---------<br>
                                      RxCan2[657] Avg|    0.00| 
                                      0.0000|    0.014<br>
                                                 Peak|        | 
                                      0.0000|    0.137<br>
---------------+--------+--------+---------<br>
                                      Cmd:State   Avg|    0.00| 
                                      0.0000|    0.002<br>
                                                 Peak|        | 
                                      0.0000|    0.024<br>
===============+========+========+=========<br>
                                            Total Avg| 2748.42|
                                      58.3344|   28.718</font><br>
                                    <br>
                                    <blockquote type="cite">@Simon: it
                                      would be an option to try
                                      commenting out the overflow
                                      counting, to see if that's causing
                                      the issue.</blockquote>
                                    <br>
                                    I have commented out the line with
                                    the Atomic_Increment statement. Now
                                    I no longer receive any messages
                                    with “RX Task Queue Overflow Run”<br>
                                    Here is the output of <font face="monospace">poller times
                                      status</font>:<br>
                                    <br>
                                    <font face="monospace">OVMS# poll
                                      time status<br>
                                      Poller timing is: on<br>
                                      Type           | count  | Utlztn |
                                      Time<br>
                                                     | per s  | [%]    |
                                      [ms]<br>
---------------+--------+--------+---------<br>
                                      Poll:PRI    Avg|    1.00| 
                                      0.0045|    0.004<br>
                                                 Peak|        | 
                                      0.0046|    0.064<br>
---------------+--------+--------+---------<br>
                                      RxCan1[010] Avg|   34.26| 
                                      2.2574|    0.021<br>
                                                 Peak|        | 
                                      2.2574|    4.609<br>
---------------+--------+--------+---------<br>
                                      RxCan1[030] Avg|   34.26| 
                                      2.3820|    0.021<br>
                                                 Peak|        | 
                                      2.3820|    1.135<br>
---------------+--------+--------+---------<br>
                                      RxCan1[041] Avg|   49.89| 
                                      1.2059|    0.021<br>
                                                 Peak|        | 
                                      1.2295|    5.331<br>
---------------+--------+--------+---------<br>
                                      RxCan1[049] Avg|   49.96| 
                                      1.2400|    0.030<br>
                                                 Peak|        | 
                                      1.2699|    1.402<br>
---------------+--------+--------+---------<br>
                                      RxCan1[04c] Avg|   49.92| 
                                      1.1752|    0.021<br>
                                                 Peak|        | 
                                      1.2072|    4.502<br>
---------------+--------+--------+---------<br>
                                      RxCan1[04d] Avg|   34.31| 
                                      2.4433|    0.022<br>
                                                 Peak|        | 
                                      2.4773|    1.368<br>
---------------+--------+--------+---------<br>
                                      RxCan1[076] Avg|   49.96| 
                                      1.2071|    0.024<br>
                                                 Peak|        | 
                                      1.2554|    2.007<br>
---------------+--------+--------+---------<br>
                                      RxCan1[077] Avg|   49.96| 
                                      1.2012|    0.022<br>
                                                 Peak|        | 
                                      1.2492|    1.955<br>
---------------+--------+--------+---------<br>
                                      RxCan1[07a] Avg|   34.35| 
                                      2.9251|    0.030<br>
                                                 Peak|        | 
                                      3.1103|    1.829<br>
---------------+--------+--------+---------<br>
                                      RxCan1[07d] Avg|   49.96| 
                                      1.1954|    0.022<br>
                                                 Peak|        | 
                                      1.2282|    1.074<br>
---------------+--------+--------+---------<br>
                                      RxCan1[0c8] Avg|   49.89| 
                                      1.2491|    0.021<br>
                                                 Peak|        | 
                                      1.3169|    1.181<br>
---------------+--------+--------+---------<br>
                                      RxCan1[11a] Avg|   34.39| 
                                      2.4423|    0.024<br>
                                                 Peak|        | 
                                      2.5693|    1.491<br>
---------------+--------+--------+---------<br>
                                      RxCan1[130] Avg|   49.95| 
                                      1.1312|    0.020<br>
                                                 Peak|        | 
                                      1.1684|    1.218<br>
---------------+--------+--------+---------<br>
                                      RxCan1[139] Avg|   49.92| 
                                      1.1547|    0.021<br>
                                                 Peak|        | 
                                      1.1778|    1.199<br>
---------------+--------+--------+---------<br>
                                      RxCan1[156] Avg|    9.96| 
                                      0.2391|    0.023<br>
                                                 Peak|        | 
                                      0.2591|    1.943<br>
---------------+--------+--------+---------<br>
                                      RxCan1[160] Avg|   49.96| 
                                      1.1657|    0.031<br>
                                                 Peak|        | 
                                      1.2017|    2.158<br>
---------------+--------+--------+---------<br>
                                      RxCan1[165] Avg|   49.96| 
                                      1.1257|    0.021<br>
                                                 Peak|        | 
                                      1.1652|    1.471<br>
---------------+--------+--------+---------<br>
                                      RxCan1[167] Avg|   34.31| 
                                      2.2871|    0.021<br>
                                                 Peak|        | 
                                      2.3374|    1.776<br>
---------------+--------+--------+---------<br>
                                      RxCan1[171] Avg|   49.96| 
                                      1.1879|    0.023<br>
                                                 Peak|        | 
                                      1.2268|    1.166<br>
---------------+--------+--------+---------<br>
                                      RxCan1[178] Avg|   10.00| 
                                      0.2371|    0.029<br>
                                                 Peak|        | 
                                      0.2459|    1.516<br>
---------------+--------+--------+---------<br>
                                      RxCan1[179] Avg|   10.00| 
                                      0.2196|    0.021<br>
                                                 Peak|        | 
                                      0.2260|    0.758<br>
---------------+--------+--------+---------<br>
                                      RxCan1[180] Avg|   49.96| 
                                      1.1703|    0.022<br>
                                                 Peak|        | 
                                      1.2103|    1.481<br>
---------------+--------+--------+---------<br>
                                      RxCan1[185] Avg|   49.95| 
                                      1.1127|    0.020<br>
                                                 Peak|        | 
                                      1.1636|    1.292<br>
---------------+--------+--------+---------<br>
                                      RxCan1[1a0] Avg|   49.96| 
                                      1.1009|    0.020<br>
                                                 Peak|        | 
                                      1.1468|    1.060<br>
---------------+--------+--------+---------<br>
                                      RxCan1[1e0] Avg|   49.96| 
                                      1.1744|    0.021<br>
                                                 Peak|        | 
                                      1.2027|    1.240<br>
---------------+--------+--------+---------<br>
                                      RxCan1[1e4] Avg|   49.96| 
                                      1.3733|    0.032<br>
                                                 Peak|        | 
                                      1.4085|    1.523<br>
---------------+--------+--------+---------<br>
                                      RxCan1[1f0] Avg|   33.30| 
                                      0.7625|    0.023<br>
                                                 Peak|        | 
                                      0.8004|    3.349<br>
---------------+--------+--------+---------<br>
                                      RxCan1[200] Avg|   49.92| 
                                      1.1462|    0.021<br>
                                                 Peak|        | 
                                      1.1809|    1.254<br>
---------------+--------+--------+---------<br>
                                      RxCan1[202] Avg|   34.39| 
                                      2.4034|    0.028<br>
                                                 Peak|        | 
                                      2.5611|    1.472<br>
---------------+--------+--------+---------<br>
                                      RxCan1[204] Avg|   34.30| 
                                      2.2541|    0.022<br>
                                                 Peak|        | 
                                      2.2924|    2.015<br>
---------------+--------+--------+---------<br>
                                      RxCan1[213] Avg|   49.96| 
                                      1.1599|    0.027<br>
                                                 Peak|        | 
                                      1.1794|    1.714<br>
---------------+--------+--------+---------<br>
                                      RxCan1[214] Avg|   49.96| 
                                      1.1537|    0.022<br>
                                                 Peak|        | 
                                      1.1941|    1.439<br>
---------------+--------+--------+---------<br>
                                      RxCan1[217] Avg|   34.39| 
                                      2.2490|    0.020<br>
                                                 Peak|        | 
                                      2.2856|    3.766<br>
---------------+--------+--------+---------<br>
                                      RxCan1[218] Avg|   49.96| 
                                      1.1291|    0.021<br>
                                                 Peak|        | 
                                      1.1646|    1.547<br>
---------------+--------+--------+---------<br>
                                      RxCan1[230] Avg|   49.96| 
                                      1.1272|    0.020<br>
                                                 Peak|        | 
                                      1.2237|    1.295<br>
---------------+--------+--------+---------<br>
                                      RxCan1[240] Avg|   10.00| 
                                      0.2191|    0.021<br>
                                                 Peak|        | 
                                      0.2226|    1.067<br>
---------------+--------+--------+---------<br>
                                      RxCan1[242] Avg|   24.96| 
                                      0.6911|    0.024<br>
                                                 Peak|        | 
                                      0.7161|    1.180<br>
---------------+--------+--------+---------<br>
                                      RxCan1[24a] Avg|    9.96| 
                                      0.2345|    0.024<br>
                                                 Peak|        | 
                                      0.2535|    0.779<br>
---------------+--------+--------+---------<br>
                                      RxCan1[24b] Avg|    9.96| 
                                      0.2433|    0.023<br>
                                                 Peak|        | 
                                      0.2697|    2.085<br>
---------------+--------+--------+---------<br>
                                      RxCan1[24c] Avg|    9.96| 
                                      0.3103|    0.029<br>
                                                 Peak|        | 
                                      0.3203|    0.809<br>
---------------+--------+--------+---------<br>
                                      RxCan1[25a] Avg|   10.00| 
                                      0.2346|    0.022<br>
                                                 Peak|        | 
                                      0.2405|    1.223<br>
---------------+--------+--------+---------<br>
                                      RxCan1[25b] Avg|   49.89| 
                                      1.2121|    0.020<br>
                                                 Peak|        | 
                                      1.3659|   19.523<br>
---------------+--------+--------+---------<br>
                                      RxCan1[25c] Avg|   34.31| 
                                      2.4193|    0.019<br>
                                                 Peak|        | 
                                      2.8022|   58.153<br>
---------------+--------+--------+---------<br>
                                      RxCan1[260] Avg|    9.93| 
                                      0.2149|    0.024<br>
                                                 Peak|        | 
                                      0.2174|    1.096<br>
---------------+--------+--------+---------<br>
                                      RxCan1[270] Avg|   49.96| 
                                      1.2042|    0.026<br>
                                                 Peak|        | 
                                      1.2755|   20.612<br>
---------------+--------+--------+---------<br>
                                      RxCan1[280] Avg|   49.96| 
                                      1.0922|    0.020<br>
                                                 Peak|        | 
                                      1.1312|    1.266<br>
---------------+--------+--------+---------<br>
                                      RxCan1[2e4] Avg|   19.96| 
                                      0.6942|    0.044<br>
                                                 Peak|        | 
                                      0.8604|    1.533<br>
---------------+--------+--------+---------<br>
                                      RxCan1[2ec] Avg|   10.00| 
                                      0.3727|    0.025<br>
                                                 Peak|        | 
                                      0.5154|   28.819<br>
---------------+--------+--------+---------<br>
                                      RxCan1[2ed] Avg|   10.00| 
                                      0.2298|    0.023<br>
                                                 Peak|        | 
                                      0.2378|    1.345<br>
---------------+--------+--------+---------<br>
                                      RxCan1[2ee] Avg|    9.96| 
                                      0.2172|    0.019<br>
                                                 Peak|        | 
                                      0.2210|    1.058<br>
---------------+--------+--------+---------<br>
                                      RxCan1[312] Avg|   10.00| 
                                      0.2206|    0.020<br>
                                                 Peak|        | 
                                      0.2396|    1.060<br>
---------------+--------+--------+---------<br>
                                      RxCan1[326] Avg|    9.96| 
                                      0.2099|    0.020<br>
                                                 Peak|        | 
                                      0.2158|    0.507<br>
---------------+--------+--------+---------<br>
                                      RxCan1[336] Avg|    1.00| 
                                      0.0212|    0.020<br>
                                                 Peak|        | 
                                      0.0233|    0.315<br>
---------------+--------+--------+---------<br>
                                      RxCan1[352] Avg|    6.64| 
                                      0.1675|    0.024<br>
                                                 Peak|        | 
                                      0.1818|    1.048<br>
---------------+--------+--------+---------<br>
                                      RxCan1[355] Avg|    2.00| 
                                      0.0540|    0.027<br>
                                                 Peak|        | 
                                      0.0619|    1.209<br>
---------------+--------+--------+---------<br>
                                      RxCan1[35e] Avg|    9.98| 
                                      0.2221|    0.021<br>
                                                 Peak|        | 
                                      0.2284|    1.186<br>
---------------+--------+--------+---------<br>
                                      RxCan1[365] Avg|   10.00| 
                                      0.2282|    0.023<br>
                                                 Peak|        | 
                                      0.2335|    0.769<br>
---------------+--------+--------+---------<br>
                                      RxCan1[366] Avg|   10.00| 
                                      0.3163|    0.022<br>
                                                 Peak|        | 
                                      0.6330|   23.587<br>
---------------+--------+--------+---------<br>
                                      RxCan1[367] Avg|   10.00| 
                                      0.2417|    0.021<br>
                                                 Peak|        | 
                                      0.2568|    1.417<br>
---------------+--------+--------+---------<br>
                                      RxCan1[368] Avg|    9.96| 
                                      0.2187|    0.019<br>
                                                 Peak|        | 
                                      0.2250|    1.135<br>
---------------+--------+--------+---------<br>
                                      RxCan1[369] Avg|    9.99| 
                                      0.2277|    0.021<br>
                                                 Peak|        | 
                                      0.2334|    0.667<br>
---------------+--------+--------+---------<br>
                                      RxCan1[380] Avg|    9.96| 
                                      0.2133|    0.020<br>
                                                 Peak|        | 
                                      0.2161|    0.560<br>
---------------+--------+--------+---------<br>
                                      RxCan1[38b] Avg|   24.92| 
                                      0.5622|    0.022<br>
                                                 Peak|        | 
                                      0.5716|    1.618<br>
---------------+--------+--------+---------<br>
                                      RxCan1[3b3] Avg|   10.00| 
                                      0.2132|    0.023<br>
                                                 Peak|        | 
                                      0.2194|    1.106<br>
---------------+--------+--------+---------<br>
                                      RxCan1[400] Avg|    4.00| 
                                      0.0885|    0.019<br>
                                                 Peak|        | 
                                      0.0885|    0.570<br>
---------------+--------+--------+---------<br>
                                      RxCan1[405] Avg|    3.70| 
                                      0.1414|    0.036<br>
                                                 Peak|        | 
                                      0.1414|    0.710<br>
---------------+--------+--------+---------<br>
                                      RxCan1[40a] Avg|    8.00| 
                                      0.1887|    0.021<br>
                                                 Peak|        | 
                                      0.1887|    1.027<br>
---------------+--------+--------+---------<br>
                                      RxCan1[410] Avg|   10.00| 
                                      0.2141|    0.023<br>
                                                 Peak|        | 
                                      0.2188|    0.984<br>
---------------+--------+--------+---------<br>
                                      RxCan1[411] Avg|   10.00| 
                                      0.2325|    0.023<br>
                                                 Peak|        | 
                                      0.2447|    0.660<br>
---------------+--------+--------+---------<br>
                                      RxCan1[416] Avg|   10.00| 
                                      0.2326|    0.022<br>
                                                 Peak|        | 
                                      0.2389|    0.774<br>
---------------+--------+--------+---------<br>
                                      RxCan1[421] Avg|   10.00| 
                                      0.2245|    0.021<br>
                                                 Peak|        | 
                                      0.2271|    1.160<br>
---------------+--------+--------+---------<br>
                                      RxCan1[42d] Avg|   10.00| 
                                      0.2315|    0.021<br>
                                                 Peak|        | 
                                      0.2411|    0.677<br>
---------------+--------+--------+---------<br>
                                      RxCan1[42f] Avg|   10.00| 
                                      0.2480|    0.020<br>
                                                 Peak|        | 
                                      0.2975|    8.093<br>
---------------+--------+--------+---------<br>
                                      RxCan1[430] Avg|   10.00| 
                                      0.2203|    0.019<br>
                                                 Peak|        | 
                                      0.2302|    0.847<br>
---------------+--------+--------+---------<br>
                                      RxCan1[434] Avg|   10.00| 
                                      0.2331|    0.019<br>
                                                 Peak|        | 
                                      0.2620|    1.150<br>
---------------+--------+--------+---------<br>
                                      RxCan1[435] Avg|    6.68| 
                                      0.1445|    0.020<br>
                                                 Peak|        | 
                                      0.1486|    1.063<br>
---------------+--------+--------+---------<br>
                                      RxCan1[43e] Avg|   20.00| 
                                      0.4515|    0.021<br>
                                                 Peak|        | 
                                      0.4632|    1.013<br>
---------------+--------+--------+---------<br>
                                      RxCan1[440] Avg|    1.00| 
                                      0.0210|    0.019<br>
                                                 Peak|        | 
                                      0.0218|    0.294<br>
---------------+--------+--------+---------<br>
                                      RxCan1[465] Avg|    0.95| 
                                      0.0214|    0.023<br>
  </font></div></blockquote></div></blockquote></div></div></blockquote></div></div></blockquote></div></blockquote></div></div></div></blockquote></div></blockquote></div>