<html>
  <head>
    <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
  </head>
  <body>
    I just remembered…<br>
    <br>
<a class="moz-txt-link-freetext" href="https://github.com/espressif/esp-idf/issues/2892#issuecomment-459120605">https://github.com/espressif/esp-idf/issues/2892#issuecomment-459120605</a><br>
    <br>
    …and as Duktape runs on core #1, I now test shifting the Duktape
    heap into the upper 2 MB of SPIRAM.<br>
    <br>
    The TypeError in PubSub occurred ~ 3 times per day in my car module,
    so I should see a difference over the weekend.<br>
    <br>
    Regards,<br>
    Michael<br>
    <br>
    <br>
    <div class="moz-cite-prefix">Am 17.09.21 um 10:02 schrieb Mark
      Webb-Johnson:<br>
    </div>
    <blockquote type="cite"
      cite="mid:0D014F4F-7E3D-44BD-931D-177EF8219B4C@webb-johnson.net">
      <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
      Thanks for the feedback.
      <div class=""><br class="">
      </div>
      <div class="">I should have a final sample of v3.3 hardware with
        rev3 esp32 in my hands towards the end of this month (this is
        the same sample set that goes to be destroyed by the
        certification labs). Is there any way of triggering the bug
        earlier, for replication? Like a stress test or something? Or
        just have to wait.</div>
      <div class=""><br class="">
      </div>
      <div class="">Regards, Mark.<br class="">
        <div class="">
          <div><br class="">
            <blockquote type="cite" class="">
              <div class="">On 17 Sep 2021, at 3:24 PM, Michael Balzer
                <<a href="mailto:dexter@expeedo.de" class=""
                  moz-do-not-send="true">dexter@expeedo.de</a>>
                wrote:</div>
              <br class="Apple-interchange-newline">
              <div class="">
                <div class="content-isolator__container">
                  <div class="protected-part">
                    <div class="protected-title">Signed PGP part</div>
                    <div class="protected-content">
                      <meta http-equiv="Content-Type"
                        content="text/html; charset=UTF-8" class="">
                      <div class=""> Mark,<br class="">
                        <br class="">
                        I've been running the new for-v3.3 version this
                        week on both of my modules without ppp issues.<br
                          class="">
                        <br class="">
                        Duktape still occasionally runs into the
                        null/undefined issue with for…in:<br class="">
                        <br class="">
                        <a class="moz-txt-link-freetext"
href="https://github.com/openvehicles/Open-Vehicle-Monitoring-System-3/issues/474#issuecomment-744005044"
                          moz-do-not-send="true">https://github.com/openvehicles/Open-Vehicle-Monitoring-System-3/issues/474#issuecomment-744005044</a><br
                          class="">
                        <br class="">
                        for…in normally doesn't throw an error even if
                        you run over null or undefined.<br class="">
                        <br class="">
                        I think both could still be the SPIRAM bug, now
                        probably only occurring with very specific
                        conditions. We build with LWIP using SPIRAM as
                        well, so the PPP instance is allocated from
                        SPIRAM also. Reallocating the instance on each
                        new connect implies a higher chance of
                        triggering the problem if it's address specific.
                        The Duktape stack object addresses vary
                        continuously with the running event handlers and
                        user interactions, so that also has a high
                        chance of occasionally triggering an address
                        specific bug.<br class="">
                        <br class="">
                        We need to test the revision 3 ESP32 on this.<br
                          class="">
                        <br class="">
                        Regards,<br class="">
                        Michael<br class="">
                        <br class="">
                        <br class="">
                        <div class="moz-cite-prefix">Am 09.09.21 um
                          02:31 schrieb Mark Webb-Johnson:<br class="">
                        </div>
                        <blockquote type="cite"
                          cite="mid:20735B00-13FF-4F16-B319-2CA6CFE8E879@webb-johnson.net"
                          class="">
                          <meta http-equiv="Content-Type"
                            content="text/html; charset=UTF-8" class="">
                          Reviving this old topic still impacting us…
                          <div class=""><br class="">
                          </div>
                          <div class="">Comparing the master vs for-v3.3
                            branches, the only thing that changed
                            related to ppp is that in 3.3 the ppp object
                            is dynamically created and destroyed, while
                            in master it is statically allocated at
                            boot. The ppp code is so simple, and I can’t
                            see how that could be a problem. Perhaps
                            related to position in memory, and some
                            other memory corruption?</div>
                          <div class=""><br class="">
                          </div>
                          <div class="">Anyway, I changed it to not
                            destroy the ppp object when the gsm
                            connection is lost, but merely shutdown the
                            ppp (which is what master branch does).
                            While it is still dynamically allocated, it
                            is no longer as dynamic (being created just
                            once at startup of the cellular system).
                            I’ve never managed to reliably repeat this
                            problem in my environment, but I think this
                            should help.It has been running on my
                            desktop test unit for the past four days
                            without issue.</div>
                          <div class=""><br class="">
                          </div>
                          <div class="">That code is committed now. I
                            would appreciate it if others who saw this
                            problem could try again with this latest
                            build of the for-v3.3 branch.<br class="">
                            <div class=""><br class="">
                            </div>
                            <div class="">Regards, Mark.<br class="">
                              <div class=""><br class="">
                                <blockquote type="cite" class="">
                                  <div class="">On 24 Mar 2021, at 3:53
                                    PM, Mark Webb-Johnson <<a
                                      href="mailto:mark@webb-johnson.net"
                                      class="" moz-do-not-send="true">mark@webb-johnson.net</a>>
                                    wrote:</div>
                                  <br class="Apple-interchange-newline">
                                  <div class="">
                                    <div
                                      class="content-isolator__container">
                                      <div class="protected-part">
                                        <div class="protected-title">Signed
                                          PGP part</div>
                                        <div class="protected-content">
                                          <meta
                                            http-equiv="Content-Type"
                                            content="text/html;
                                            charset=UTF-8" class="">
                                          <div style="word-wrap:
                                            break-word;
                                            -webkit-nbsp-mode: space;
                                            line-break:
                                            after-white-space;" class="">Good
                                            grief, this is not so easy.
                                            Now we have:
                                            <blockquote style="margin: 0
                                              0 0 40px; border: none;
                                              padding: 0px;" class=""><br
                                                class="">
                                              <font style="font-style:
                                                normal; font-size:
                                                12px;" class=""
                                                face="Andale Mono">Guru
                                                Meditation Error: Core
                                                 1 panic'ed
                                                (LoadProhibited).
                                                Exception was unhandled.</font></blockquote>
                                            <blockquote style="margin: 0
                                              0 0 40px; border: none;
                                              padding: 0px;" class=""><font
                                                style="font-style:
                                                normal; font-size:
                                                12px;" class=""
                                                face="Andale Mono"><br
                                                  class="">
                                              </font></blockquote>
                                            <blockquote style="margin: 0
                                              0 0 40px; border: none;
                                              padding: 0px;" class=""><font
                                                style="font-style:
                                                normal; font-size:
                                                12px;" class=""
                                                face="Andale Mono">Core
                                                1 register dump:</font></blockquote>
                                            <blockquote style="margin: 0
                                              0 0 40px; border: none;
                                              padding: 0px;" class="">
                                              <blockquote style="margin:
                                                0 0 0 40px; border:
                                                none; padding: 0px;"
                                                class=""><font
                                                  style="font-style:
                                                  normal; font-size:
                                                  12px;" class=""
                                                  face="Andale Mono">PC
                                                       : 0x40008044  PS
                                                       : 0x00060f30  A0
                                                       : 0x800fe2cc  A1
                                                       : 0x3ffcaa90</font></blockquote>
                                              <blockquote style="margin:
                                                0 0 0 40px; border:
                                                none; padding: 0px;"
                                                class=""><font
                                                  style="font-style:
                                                  normal; font-size:
                                                  12px;" class=""
                                                  face="Andale Mono">A2
                                                       : 0x3f413acc  A3
                                                       : 0x00000046  A4
                                                       : 0x00e6807e  A5
                                                       : 0x00000000</font></blockquote>
                                              <blockquote style="margin:
                                                0 0 0 40px; border:
                                                none; padding: 0px;"
                                                class=""><font
                                                  style="font-style:
                                                  normal; font-size:
                                                  12px;" class=""
                                                  face="Andale Mono">A6
                                                       : 0x00000000  A7
                                                       : 0x00000000  A8
                                                       : 0x00000010  A9
                                                       : 0x00e6807e</font></blockquote>
                                              <blockquote style="margin:
                                                0 0 0 40px; border:
                                                none; padding: 0px;"
                                                class=""><font
                                                  style="font-style:
                                                  normal; font-size:
                                                  12px;" class=""
                                                  face="Andale Mono">A10
                                                      : 0x00000078  A11
                                                      : 0x00000009  A12
                                                      : 0x3ffcaa3f  A13
                                                      : 0x00000032</font></blockquote>
                                              <blockquote style="margin:
                                                0 0 0 40px; border:
                                                none; padding: 0px;"
                                                class=""><font
                                                  style="font-style:
                                                  normal; font-size:
                                                  12px;" class=""
                                                  face="Andale Mono">A14
                                                      : 0x00000000  A15
                                                      : 0x3ffcaa48  SAR
                                                      : 0x00000004
                                                   EXCCAUSE: 0x0000001c</font></blockquote>
                                              <blockquote style="margin:
                                                0 0 0 40px; border:
                                                none; padding: 0px;"
                                                class=""><font
                                                  style="font-style:
                                                  normal; font-size:
                                                  12px;" class=""
                                                  face="Andale Mono">EXCVADDR:
                                                  0x00e6807e  LBEG    :
                                                  0x4008bdad  LEND    :
                                                  0x4008bdd1  LCOUNT  :
                                                  0x800f93f4</font></blockquote>
                                            </blockquote>
                                            <blockquote style="margin: 0
                                              0 0 40px; border: none;
                                              padding: 0px;" class=""><font
                                                style="font-style:
                                                normal; font-size:
                                                12px;" class=""
                                                face="Andale Mono"><br
                                                  class="">
                                                ELF file SHA256:
                                                74bb0a75eeb4578b<br
                                                  class="">
                                                <br class="">
                                                Backtrace:
                                                0x40008044:0x3ffcaa90
                                                0x400fe2c9:0x3ffcab20
                                                0x400fe412:0x3ffcabb0
                                                0x402937b5:0x3ffcabd0</font></blockquote>
                                            <blockquote style="margin: 0
                                              0 0 40px; border: none;
                                              padding: 0px;" class=""><font
                                                style="font-style:
                                                normal; font-size:
                                                12px;" class=""
                                                face="Andale Mono"><br
                                                  class="">
                                              </font></blockquote>
                                            <blockquote style="margin: 0
                                              0 0 40px; border: none;
                                              padding: 0px;" class=""><font
                                                style="font-style:
                                                normal; font-size:
                                                12px;" class=""
                                                face="Andale Mono">0x400fe2c9
                                                is in
OvmsNetManager::DoSafePrioritiseAndIndicate()
(/Users/hq.mark.johnson/Documents/ovms/Open-Vehicle-Monitoring-System-3/vehicle/OVMS.V3/main/ovms_netmanager.cpp:723).<br
                                                  class="">
                                                718<span class="Apple-tab-span" style="white-space: pre;">    </span>
                                                   }<br class="">
                                                719<br class="">
                                                720<span class="Apple-tab-span" style="white-space: pre;">    </span>
                                                 for (struct netif *pri
                                                = netif_list; pri !=
                                                NULL; pri=pri->next)<br
                                                  class="">
                                                721<span class="Apple-tab-span" style="white-space: pre;">    </span>
                                                   {<br class="">
                                                722<span class="Apple-tab-span" style="white-space: pre;">    </span>
                                                 
                                                 ESP_EARLY_LOGI(TAG,"DoSafePrioritiseAndIndicate:
                                                interface %p",pri);<br
                                                  class="">
                                                723<span class="Apple-tab-span" style="white-space: pre;">    </span>
                                                 
                                                 ESP_EARLY_LOGI(TAG,"DoSafePrioritiseAndIndicate:
                                                  name  
                                                 %s",pri->name);<br
                                                  class="">
                                                724<span class="Apple-tab-span" style="white-space: pre;">    </span>
                                                   if
                                                ((pri->name[0]==search[0])&&<br
                                                  class="">
                                                725<span class="Apple-tab-span" style="white-space: pre;">    </span>
                                                     
                                                 (pri->name[1]==search[1]))<br
                                                  class="">
                                                726<span class="Apple-tab-span" style="white-space: pre;">    </span>
                                                     {<br class="">
                                                727<span class="Apple-tab-span" style="white-space: pre;">    </span>
                                                     if (search[0] !=
                                                m_previous_name[0] ||
                                                search[1] !=
                                                m_previous_name[1])<br
                                                  class="">
                                                0x400fe412 is in
                                                SafePrioritiseAndIndicate(void*)
(/Users/hq.mark.johnson/Documents/ovms/Open-Vehicle-Monitoring-System-3/vehicle/OVMS.V3/main/ovms_netmanager.cpp:676).<br
                                                  class="">
                                                671<span class="Apple-tab-span" style="white-space: pre;">    </span>
                                                   }<br class="">
                                                672<span class="Apple-tab-span" style="white-space: pre;">    </span>
                                                 }<br class="">
                                                673<br class="">
                                                674<span class="Apple-tab-span" style="white-space: pre;">    </span>void
SafePrioritiseAndIndicate(void* ctx)<br class="">
                                                675<span class="Apple-tab-span" style="white-space: pre;">    </span>
                                                 {<br class="">
                                                676<span class="Apple-tab-span" style="white-space: pre;">    </span>
 MyNetManager.DoSafePrioritiseAndIndicate();<br class="">
                                                677<span class="Apple-tab-span" style="white-space: pre;">    </span>
                                                 }<br class="">
                                                678<br class="">
                                                679<span class="Apple-tab-span" style="white-space: pre;">    </span>void
OvmsNetManager::PrioritiseAndIndicate()<br class="">
                                                680<span class="Apple-tab-span" style="white-space: pre;">    </span>
                                                 {<br class="">
                                                0x402937b5 is in
                                                tcpip_thread
(/Users/hq.mark.johnson/esp/esp-idf/components/lwip/lwip/src/api/tcpip.c:158).<br
                                                  class="">
                                                153<span class="Apple-tab-span" style="white-space: pre;">    </span>
                                                     break;<br class="">
                                                154<span class="Apple-tab-span" style="white-space: pre;">    </span>#endif
                                                /* LWIP_TCPIP_TIMEOUT
                                                && LWIP_TIMERS
                                                */<br class="">
                                                155<br class="">
                                                156<span class="Apple-tab-span" style="white-space: pre;">    </span>
                                                   case
                                                TCPIP_MSG_CALLBACK:<br
                                                  class="">
                                                157<span class="Apple-tab-span" style="white-space: pre;">    </span>
                                                   
                                                 LWIP_DEBUGF(TCPIP_DEBUG,
                                                ("tcpip_thread: CALLBACK
                                                %p\n", (void *)msg));<br
                                                  class="">
                                                158<span class="Apple-tab-span" style="white-space: pre;">    </span>
                                                   
                                                 msg->msg.cb.function(msg->msg.cb.ctx);<br
                                                  class="">
                                                159<span class="Apple-tab-span" style="white-space: pre;">    </span>
                                                   
                                                 memp_free(MEMP_TCPIP_MSG_API,
                                                msg);<br class="">
                                                160<span class="Apple-tab-span" style="white-space: pre;">    </span>
                                                     break;<br class="">
                                                161<br class="">
                                                162<span class="Apple-tab-span" style="white-space: pre;">    </span>
                                                   case
                                                TCPIP_MSG_CALLBACK_STATIC:</font></blockquote>
                                            <div class=""><br class="">
                                            </div>
                                            <div class="">So the issue
                                              is most likely corruption
                                              of the network interface
                                              structure, not thread safe
                                              traversal.</div>
                                            <div class=""><br class="">
                                            </div>
                                            <div class="">I had added
                                              some ESP_EARLY_LOGI
                                              statements, so can see a
                                              little more of what is
                                              going on:</div>
                                            <div class=""><br class="">
                                            </div>
                                            <blockquote style="margin: 0
                                              0 0 40px; border: none;
                                              padding: 0px;" class="">
                                              <div class="">
                                                <div class="">
                                                  <div class=""><font
                                                      class=""
                                                      face="Andale Mono"><span
style="font-style: normal; font-size: 12px;" class="">I (103202)
                                                        gsm-ppp:
                                                        Initialising...</span></font></div>
                                                  <div class=""><font
                                                      class=""
                                                      face="Andale Mono"><span
style="font-style: normal; font-size: 12px;" class="">I (103212) events:
Signal(system.modem.netmode)</span></font></div>
                                                </div>
                                                <div class=""><font
                                                    class=""
                                                    face="Andale Mono"><span
                                                      style="font-style:
                                                      normal; font-size:
                                                      12px;" class="">I
                                                      (105902)
                                                      netmanager:
                                                      DoSafePrioritiseAndIndicate:
                                                      start</span></font></div>
                                                <div class=""><font
                                                    class=""
                                                    face="Andale Mono"><span
                                                      style="font-style:
                                                      normal; font-size:
                                                      12px;" class="">I
                                                      (105902)
                                                      netmanager:
                                                      DoSafePrioritiseAndIndicate:
                                                      connected wifi</span></font></div>
                                                <div class=""><font
                                                    class=""
                                                    face="Andale Mono"><span
                                                      style="font-style:
                                                      normal; font-size:
                                                      12px;" class="">I
                                                      (105912)
                                                      netmanager:
                                                      DoSafePrioritiseAndIndicate:
                                                      interface
                                                      0x3ffed6a0</span></font></div>
                                                <div class=""><font
                                                    class=""
                                                    face="Andale Mono"><span
                                                      style="font-style:
                                                      normal; font-size:
                                                      12px;" class="">I
                                                      (105912)
                                                      netmanager:
                                                      DoSafePrioritiseAndIndicate:
                                                        name    pp</span></font></div>
                                                <div class=""><font
                                                    class=""
                                                    face="Andale Mono"><span
                                                      style="font-style:
                                                      normal; font-size:
                                                      12px;" class="">I
                                                      (105922)
                                                      netmanager:
                                                      DoSafePrioritiseAndIndicate:
                                                      interface
                                                      0x3ffde854</span></font></div>
                                                <div class=""><font
                                                    class=""
                                                    face="Andale Mono"><span
                                                      style="font-style:
                                                      normal; font-size:
                                                      12px;" class="">I
                                                      (105932)
                                                      netmanager:
                                                      DoSafePrioritiseAndIndicate:
                                                        name    ap</span></font></div>
                                                <div class=""><font
                                                    class=""
                                                    face="Andale Mono"><span
                                                      style="font-style:
                                                      normal; font-size:
                                                      12px;" class="">I
                                                      (105932)
                                                      netmanager:
                                                      DoSafePrioritiseAndIndicate:
                                                      interface
                                                      0x3ffde640</span></font></div>
                                                <div class=""><font
                                                    class=""
                                                    face="Andale Mono"><span
                                                      style="font-style:
                                                      normal; font-size:
                                                      12px;" class="">I
                                                      (105942)
                                                      netmanager:
                                                      DoSafePrioritiseAndIndicate:
                                                        name    st</span></font></div>
                                                <div class=""><font
                                                    class=""
                                                    face="Andale Mono"><span
                                                      style="font-style:
                                                      normal; font-size:
                                                      12px;" class="">I
                                                      (105952)
                                                      netmanager:
                                                      DoSafePrioritiseAndIndicate:
                                                      end</span></font></div>
                                              </div>
                                              <div class="">
                                                <div class=""><font
                                                    class=""
                                                    face="Andale Mono"><span
                                                      style="font-style:
                                                      normal; font-size:
                                                      12px;" class="">I
                                                      (105902) gsm-ppp:
                                                      StatusCallBack:
                                                      None</span></font></div>
                                                <div class=""><font
                                                    class=""
                                                    face="Andale Mono"><span
                                                      style="font-style:
                                                      normal; font-size:
                                                      12px;" class="">I
                                                      (105902) gsm-ppp:
                                                      status_cb:
                                                      Connected</span></font></div>
                                                <div class=""><font
                                                    class=""
                                                    face="Andale Mono"><span
                                                      style="font-style:
                                                      normal; font-size:
                                                      12px;" class="">I
                                                      (105902) gsm-ppp:
                                                         our_ipaddr  =
                                                      10.52.40.80</span></font></div>
                                              </div>
                                              <div class=""><font
                                                  class="" face="Andale
                                                  Mono"><span
                                                    style="font-style:
                                                    normal; font-size:
                                                    12px;" class="">…</span></font></div>
                                              <div class="">
                                                <div class=""><font
                                                    class=""
                                                    face="Andale Mono"><span
                                                      style="font-style:
                                                      normal; font-size:
                                                      12px;" class="">I
                                                      (3708442)
                                                      cellular: PPP
                                                      Connection
                                                      disconnected</span></font></div>
                                                <div class=""><font
                                                    class=""
                                                    face="Andale Mono"><span
                                                      style="font-style:
                                                      normal; font-size:
                                                      12px;" class="">I
                                                      (3708442)
                                                      cellular: PPP
                                                      Connection
                                                      disconnected</span></font></div>
                                                <div class=""><font
                                                    class=""
                                                    face="Andale Mono"><span
                                                      style="font-style:
                                                      normal; font-size:
                                                      12px;" class="">I
                                                      (3709212)
                                                      netmanager:
                                                      DoSafePrioritiseAndIndicate:
                                                      start</span></font></div>
                                                <div class=""><font
                                                    class=""
                                                    face="Andale Mono"><span
                                                      style="font-style:
                                                      normal; font-size:
                                                      12px;" class="">I
                                                      (3709212)
                                                      netmanager:
                                                      DoSafePrioritiseAndIndicate:
                                                      connected wifi</span></font></div>
                                                <div class=""><font
                                                    class=""
                                                    face="Andale Mono"><span
                                                      style="font-style:
                                                      normal; font-size:
                                                      12px;" class="">I
                                                      (3709212)
                                                      netmanager:
                                                      DoSafePrioritiseAndIndicate:
                                                      interface
                                                      0x3ffed6a0</span></font></div>
                                                <div class=""><font
                                                    class=""
                                                    face="Andale Mono"><span
                                                      style="font-style:
                                                      normal; font-size:
                                                      12px;" class="">I
                                                      (3709222)
                                                      netmanager:
                                                      DoSafePrioritiseAndIndicate:
                                                        name    pp</span></font></div>
                                                <div class=""><font
                                                    class=""
                                                    face="Andale Mono"><span
                                                      style="font-style:
                                                      normal; font-size:
                                                      12px;" class="">I
                                                      (3709222)
                                                      netmanager:
                                                      DoSafePrioritiseAndIndicate:
                                                      interface
                                                      0x30323930</span></font></div>
                                                <div class=""><font
                                                    class=""
                                                    face="Andale Mono"><span
                                                      style="font-style:
                                                      normal; font-size:
                                                      12px;" class="">I
                                                      (3709232)
                                                      netmanager:
                                                      DoSafePrioritiseAndIndicate:
                                                        name    f</span></font></div>
                                                <div class=""><font
                                                    class=""
                                                    face="Andale Mono"><span
                                                      style="font-style:
                                                      normal; font-size:
                                                      12px;" class="">I
                                                      (3709242)
                                                      netmanager:
                                                      DoSafePrioritiseAndIndicate:
                                                      interface
                                                      0x667fc000</span></font></div>
                                                <div class=""><font
                                                    class=""
                                                    face="Andale Mono"><span
                                                      style="font-style:
                                                      normal; font-size:
                                                      12px;" class="">I
                                                      (3709252)
                                                      netmanager:
                                                      DoSafePrioritiseAndIndicate:
                                                        name</span></font></div>
                                                <div class=""><font
                                                    class=""
                                                    face="Andale Mono"><span
                                                      style="font-style:
                                                      normal; font-size:
                                                      12px;" class="">Guru
                                                      Meditation Error:
                                                      Core  1 panic'ed
                                                      (Interrupt wdt
                                                      timeout on CPU1)</span></font></div>
                                              </div>
                                            </blockquote>
                                            <div class="">
                                              <div class=""><br class="">
                                              </div>
                                              <div class="">Doesn’t help
                                                much, apart from confirm
                                                the corruption. Took
                                                about an hour to
                                                recreate the problem.</div>
                                              <div class=""><br class="">
                                              </div>
                                              <div class="">I’ll keep
                                                looking.</div>
                                              <div class=""><br class="">
                                              </div>
                                              <div class="">Regards,
                                                Mark.</div>
                                              <div class=""><br class="">
                                                <blockquote type="cite"
                                                  class="">
                                                  <div class="">On 23
                                                    Mar 2021, at 4:05
                                                    PM, Mark
                                                    Webb-Johnson <<a
href="mailto:mark@webb-johnson.net" class="" moz-do-not-send="true">mark@webb-johnson.net</a>>
                                                    wrote:</div>
                                                  <br
                                                    class="Apple-interchange-newline">
                                                  <div class="">
                                                    <div
                                                      class="content-isolator__container">
                                                      <div
                                                        class="protected-part">
                                                        <div
                                                          class="protected-title">Signed
                                                          PGP part</div>
                                                        <div
                                                          class="protected-content">
                                                          <meta
                                                          http-equiv="Content-Type"
content="text/html; charset=UTF-8" class="">
                                                          <div
                                                          style="word-wrap:
                                                          break-word;
                                                          -webkit-nbsp-mode:
                                                          space;
                                                          line-break:
                                                          after-white-space;"
                                                          class="">My
                                                          attempt didn’t
                                                          work (still
                                                          crashes), so
                                                          I’m now trying
                                                          your
                                                          suggestion of
wrapping PrioritiseAndIndicate() in a tcpip_callback_with_block. 
                                                          <div class=""><br
                                                          class="">
                                                          </div>
                                                          <div class=""> 🤞🏻</div>
                                                          <div class=""><br
                                                          class="">
                                                          </div>
                                                          <div class="">Regards,
                                                          Mark.<br
                                                          class="">
                                                          <div class=""><br
                                                          class="">
                                                          <blockquote
                                                          type="cite"
                                                          class="">
                                                          <div class="">On
                                                          23 Mar 2021,
                                                          at 3:02 PM,
                                                          Michael Balzer
                                                          <<a
                                                          href="mailto:dexter@expeedo.de"
                                                          class=""
                                                          moz-do-not-send="true">dexter@expeedo.de</a>>
                                                          wrote:</div>
                                                          <br
                                                          class="Apple-interchange-newline">
                                                          <div class="">
                                                          <div
                                                          class="content-isolator__container">
                                                          <div
                                                          class="protected-part">
                                                          <div
                                                          class="protected-title">Signed
                                                          PGP part</div>
                                                          <div
                                                          class="protected-content">
                                                          <meta
                                                          http-equiv="Content-Type"
content="text/html; charset=UTF-8" class="">
                                                          <div class="">
                                                          Mark,<br
                                                          class="">
                                                          <br class="">
                                                          regarding
                                                          point 2: I've
                                                          had the same
                                                          issue with
                                                          jobs that need
                                                          to iterate
                                                          over the
                                                          mongoose
                                                          connection
                                                          list, I
                                                          introduced the
                                                          netmanager job
                                                          queue for this
                                                          to delegate
                                                          these to the
                                                          mongoose
                                                          context.<br
                                                          class="">
                                                          <br class="">
                                                          I remember
                                                          seeing LwIP
                                                          has a similar
                                                          API while
                                                          browsing the
                                                          source… yes,
                                                          found it: the
"tcpip_callback…" functions, e.g.:<br class="">
                                                          <br class="">
                                                          <font class=""
face="monospace">/**<br class="">
                                                           * Call a
                                                          specific
                                                          function in
                                                          the thread
                                                          context of<br
                                                          class="">
                                                           *
                                                          tcpip_thread
                                                          for easy
                                                          access
                                                          synchronization.<br
                                                          class="">
                                                           * A function
                                                          called in that
                                                          way may access
                                                          lwIP core code<br
                                                          class="">
                                                           * without
                                                          fearing
                                                          concurrent
                                                          access.<br
                                                          class="">
                                                           *<br class="">
                                                           * @param
                                                          function the
                                                          function to
                                                          call<br
                                                          class="">
                                                           * @param ctx
                                                          parameter
                                                          passed to f<br
                                                          class="">
                                                           * @param
                                                          block 1 to
                                                          block until
                                                          the request is
                                                          posted, 0 to
                                                          non-blocking
                                                          mode<br
                                                          class="">
                                                           * @return
                                                          ERR_OK if the
                                                          function was
                                                          called,
                                                          another err_t
                                                          if not<br
                                                          class="">
                                                           */<br
                                                          class="">
                                                          err_t<br
                                                          class="">
tcpip_callback_with_block(tcpip_callback_fn function, void *ctx, u8_t
                                                          block)</font><br
                                                          class="">
                                                          <br class="">
                                                          So we probably
                                                          can use this
                                                          to execute
                                                          PrioritiseAndIndicate()
                                                          in the LwIP
                                                          context.<br
                                                          class="">
                                                          <br class="">
                                                          Regards,<br
                                                          class="">
                                                          Michael<br
                                                          class="">
                                                          <br class="">
                                                          <br class="">
                                                          <div
                                                          class="moz-cite-prefix">Am
                                                          23.03.21 um
                                                          06:47 schrieb
                                                          Mark
                                                          Webb-Johnson:<br
                                                          class="">
                                                          </div>
                                                          <blockquote
                                                          type="cite"
                                                          cite="mid:CB78F43A-5706-4504-A0B2-F287DC10B40C@webb-johnson.net"
                                                          class="">
                                                          <meta
                                                          http-equiv="Content-Type"
content="text/html; charset=UTF-8" class="">
                                                          OK, some
                                                          progress…
                                                          <div class=""><br
                                                          class="">
                                                          </div>
                                                          <div class="">
                                                          <ol
                                                          class="MailOutline">
                                                          <li class="">I’ve
                                                          added a check
                                                          in
                                                          the OvmsSyncHttpClient
                                                          code to refuse
                                                          to block while
                                                          running as the
                                                          netman
                                                          (mongoose)
                                                          task. This
                                                          will now
                                                          simply fail
                                                          the http
                                                          connection,
                                                          and log an
                                                          error. Not
                                                          perfect, and
                                                          not a solution
                                                          to the core
                                                          problem, but
                                                          at least it
                                                          avoids a known
                                                          problem.<br
                                                          class="">
                                                          <br class="">
                                                          I’m not sure
                                                          of the best
                                                          permanent
                                                          solution to
                                                          this. It seems
                                                          that we need a
                                                          callback
                                                          interface to
                                                          run commands
                                                          asynchronously,
                                                          and use that
                                                          in mongoose
                                                          event
                                                          handlers.
                                                          Adding another
                                                          mongoose event
                                                          loop, or using
                                                          a separate
                                                          networking
                                                          socket with
                                                          select(), just
                                                          minimise the
                                                          problem - they
                                                          don’t solve
                                                          it. The core
                                                          issue here is
                                                          blocking
                                                          during a
                                                          mongoose event
                                                          delivery. That
                                                          is going to
                                                          pause all high
                                                          level
                                                          networking.<br
                                                          class="">
                                                          <br class="">
                                                          </li>
                                                          <li class="">I
                                                          found a race
                                                          condition in
                                                          ovms_netmanager
                                                          that seems
                                                          nasty. The new
                                                          cellular code
                                                          could raise
                                                          duplicate
                                                          modem.down
                                                          signals,
                                                          picked up and
                                                          handled in
                                                          ovms_netmanager.
                                                          As part of
                                                          that it calls
a PrioritiseAndIndicate() function that iterates over the network
                                                          interface list
                                                          (maintained by
                                                          LWIP). If that
                                                          network
                                                          interface list
                                                          is modified
                                                          (eg; removing
                                                          an interface)
                                                          while it is
                                                          being
                                                          traversed,
                                                          nasty crashes
                                                          can happen.
                                                          The ‘fix’ I’ve
                                                          done is again
                                                          just a
                                                          workaround to
                                                          try to reduce
                                                          the duplicate
                                                          signals and
                                                          hence reduce
                                                          the likelyhood
                                                          of the problem
                                                          happening, but
                                                          it won’t fix
                                                          the core
                                                          problem (that
                                                          is in both
                                                          master and
                                                          for-v3.3).<br
                                                          class="">
                                                          <br class="">
                                                          There is a
                                                          netif_find
                                                          function in
                                                          LWIP, but (a)
                                                          that requires
                                                          an interface
                                                          number that we
                                                          don’t have,
                                                          and (b)
                                                          doesn’t seem
                                                          to lock the
                                                          list either.<br
                                                          class="">
                                                          <br class="">
                                                          Can’t think of
                                                          an elegant
                                                          solution to
                                                          this, other
                                                          than
                                                          modifications
                                                          to lwip. We
                                                          could add our
                                                          own mutex and
                                                          use that
                                                          whenever we
                                                          talk to lwip,
                                                          but even that
                                                          would miss out
                                                          on some
                                                          modifications
                                                          to the network
                                                          interface
                                                          list, I
                                                          guess. </li>
                                                          </ol>
                                                          <div class=""><br
                                                          class="">
                                                          </div>
                                                          <div class="">These
                                                          two changes
                                                          are in ‘pre’
                                                          now, and I am
                                                          trying them in
                                                          my car.</div>
                                                          <div class=""><br
                                                          class="">
                                                          </div>
                                                          <div class="">Regards,
                                                          Mark.</div>
                                                          <div class=""><br
                                                          class="">
                                                          <blockquote
                                                          type="cite"
                                                          class="">
                                                          <div class="">On
                                                          22 Mar 2021,
                                                          at 6:06 PM,
                                                          Michael Balzer
                                                          <<a
                                                          href="mailto:dexter@expeedo.de"
                                                          class=""
                                                          moz-do-not-send="true">dexter@expeedo.de</a>>
                                                          wrote:</div>
                                                          <br
                                                          class="Apple-interchange-newline">
                                                          <div class="">
                                                          <div
                                                          class="content-isolator__container">
                                                          <div
                                                          class="protected-part">
                                                          <div
                                                          class="protected-title">Signed
                                                          PGP part</div>
                                                          <div
                                                          class="protected-content">
                                                          <meta
                                                          http-equiv="Content-Type"
content="text/html; charset=UTF-8" class="">
                                                          <div class="">
                                                          In master,
                                                          running
                                                          commands via
                                                          ssh or
                                                          server-v2
                                                          block, because
                                                          these are
                                                          running
                                                          synchronously
                                                          in the
                                                          mongoose
                                                          context.<br
                                                          class="">
                                                          <br class="">
                                                          Running
                                                          commands via
                                                          web doesn't
                                                          block, as the
                                                          webcommand
                                                          class starts a
                                                          separate task
                                                          for each
                                                          execution.<br
                                                          class="">
                                                          <br class="">
                                                          The firmware
                                                          config page
                                                          does a
                                                          synchronous
                                                          call to
                                                          MyOTA.GetStatus(),
                                                          so that call
                                                          is executed in
                                                          the mongoose
                                                          context. It
                                                          still works in
                                                          master, just
                                                          needs a second
                                                          or two to
                                                          fetch the
                                                          version file.<br
                                                          class="">
                                                          <br class="">
                                                          Regards,<br
                                                          class="">
                                                          Michael<br
                                                          class="">
                                                          <br class="">
                                                          <br class="">
                                                          <div
                                                          class="moz-cite-prefix">Am
                                                          22.03.21 um
                                                          10:38 schrieb
                                                          Mark
                                                          Webb-Johnson:<br
                                                          class="">
                                                          </div>
                                                          <blockquote
                                                          type="cite"
                                                          cite="mid:1ACB6945-97E0-45E7-AA07-4EB5AC42B96F@webb-johnson.net"
                                                          class="">
                                                          <meta
                                                          http-equiv="content-type"
content="text/html; charset=UTF-8" class="">
                                                          <div dir="ltr"
                                                          class="">In
                                                          master branch,
                                                          at the moment,
                                                          if a command
                                                          is run from
                                                          the web shell
                                                          (or server
                                                          v2), surely
                                                          the mongoose
                                                          task will
                                                          block as the
                                                          web server /
                                                          server v2
                                                          blocks waiting
                                                          for the
                                                          command to run
                                                          to completion?</div>
                                                          <div dir="ltr"
                                                          class=""><br
                                                          class="">
                                                          </div>
                                                          <div dir="ltr"
                                                          class="">Doesn’t
                                                          necessarily
                                                          need to be a
                                                          networking
                                                          command.
                                                          Something long
                                                          running like
                                                          the string
                                                          speed tests.</div>
                                                          <div dir="ltr"
                                                          class=""><br
                                                          class="">
                                                          </div>
                                                          <div dir="ltr"
                                                          class="">In
                                                          v3.3 I can
                                                          easily detect
                                                          the task wait
                                                          being
                                                          requested in
                                                          the http
                                                          library (by
                                                          seeing if
                                                          current task
                                                          id == mongoose
                                                          task), and
                                                          fail (which I
                                                          should do
                                                          anyway). But I
                                                          am more
                                                          concerned with
                                                          the general
                                                          case now
                                                          (which I think
                                                          may be wrong
                                                          in both master
                                                          and for-v3.3).</div>
                                                          <div dir="ltr"
                                                          class=""><br
                                                          class="">
                                                          </div>
                                                          <div dir="ltr"
                                                          class="">Regards,
                                                          Mark</div>
                                                          <div dir="ltr"
                                                          class=""><br
                                                          class="">
                                                          </div>
                                                          <div dir="ltr"
                                                          class="">
                                                          <blockquote
                                                          type="cite"
                                                          class="">On 22
                                                          Mar 2021, at
                                                          5:22 PM,
                                                          Michael Balzer
                                                          <a
                                                          class="moz-txt-link-rfc2396E"
href="mailto:dexter@expeedo.de" moz-do-not-send="true"><dexter@expeedo.de></a>
                                                          wrote:<br
                                                          class="">
                                                          <br class="">
                                                          </blockquote>
                                                          </div>
                                                          <blockquote
                                                          type="cite"
                                                          class="">
                                                          <div dir="ltr"
                                                          class="">
                                                          <meta
                                                          http-equiv="Content-Type"
content="text/html; charset=UTF-8" class="">
                                                          I think we
                                                          must avoid
                                                          blocking the
                                                          Mongoose task,
                                                          as that's the
                                                          central
                                                          network
                                                          dispatcher.<br
                                                          class="">
                                                          <br class="">
                                                          Chris had
                                                          implemented a
                                                          workaround in
                                                          one of his PRs
                                                          that could
                                                          allow that to
                                                          be done
                                                          temporarily by
                                                          running a
                                                          local Mongoose
                                                          main loop
                                                          during a
                                                          synchronous
                                                          operation, but
                                                          I still see
                                                          potential
                                                          issues from
                                                          that, as it
                                                          wasn't the
                                                          standard
                                                          handling as
                                                          done by the
                                                          task, and as
                                                          it may need to
                                                          recurse.<br
                                                          class="">
                                                          <br class="">
                                                          Maybe the old
                                                          OvmsHttpClient
                                                          using socket
                                                          I/O is the
                                                          right way for
                                                          synchronous
                                                          network
                                                          operations?<br
                                                          class="">
                                                          <br class="">
                                                          Regards,<br
                                                          class="">
                                                          Michael<br
                                                          class="">
                                                          <br class="">
                                                          <br class="">
                                                          <div
                                                          class="moz-cite-prefix">Am
                                                          22.03.21 um
                                                          07:15 schrieb
                                                          Mark
                                                          Webb-Johnson:<br
                                                          class="">
                                                          </div>
                                                          <blockquote
                                                          type="cite"
                                                          cite="mid:F88B060F-2CB7-4F77-99AD-08ACD03E95B9@webb-johnson.net"
                                                          class="">
                                                          <meta
                                                          http-equiv="Content-Type"
content="text/html; charset=UTF-8" class="">
                                                          Not sure how
                                                          to resolve
                                                          this.
                                                          <div class=""><br
                                                          class="">
                                                          </div>
                                                          <div class="">
                                                          <div
                                                          style="caret-color:
                                                          rgb(0, 0, 0);"
                                                          class="">OvmsSyncHttpClient
                                                          is currently
                                                          used in
                                                          commands from
                                                          ovms_plugins
                                                          and ovms_ota.</div>
                                                          </div>
                                                          <div class=""><br
                                                          class="">
                                                          </div>
                                                          <div class="">I
                                                          could bring
                                                          back
                                                          the OvmsHttpClient
                                                          blocking
                                                          (non-mongoose)
implementation, but I don’t think that would address the core problem
                                                          here:</div>
                                                          <div class=""><br
                                                          class="">
                                                          </div>
                                                          <blockquote
                                                          style="margin:
                                                          0 0 0 40px;
                                                          border: none;
                                                          padding: 0px;"
                                                          class="">
                                                          <div class="">Inside
                                                          a mongoose
                                                          callback
                                                          (inside the
                                                          mongoose
                                                          networking
                                                          task), we are
                                                          making
                                                          blocking calls
                                                          (and in
                                                          particular
                                                          calls that
                                                          could block
                                                          for several
                                                          tens of
                                                          seconds).</div>
                                                          </blockquote>
                                                          <div class=""><br
                                                          class="">
                                                          </div>
                                                          <div class="">But
                                                          fundamentally
                                                          is it ok to
                                                          block the
                                                          mongoose
                                                          networking
                                                          task for
                                                          extended
                                                          periods during
                                                          a mongoose
                                                          event
                                                          callback?</div>
                                                          <div class=""><br
                                                          class="">
                                                          </div>
                                                          <div class="">Mark</div>
                                                          <div class="">
                                                          <div class=""><br
                                                          class="">
                                                          <blockquote
                                                          type="cite"
                                                          class="">
                                                          <div class="">On
                                                          21 Mar 2021,
                                                          at 9:57 PM,
                                                          Michael Balzer
                                                          <<a
                                                          href="mailto:dexter@expeedo.de"
                                                          class=""
                                                          moz-do-not-send="true">dexter@expeedo.de</a>>
                                                          wrote:</div>
                                                          <br
                                                          class="Apple-interchange-newline">
                                                          <div class="">
                                                          <div
                                                          class="content-isolator__container">
                                                          <div
                                                          class="protected-part">
                                                          <div
                                                          class="protected-title">Signed
                                                          PGP part</div>
                                                          <div
                                                          class="protected-content">
                                                          <meta
                                                          http-equiv="Content-Type"
content="text/html; charset=UTF-8" class="">
                                                          <div class="">
                                                          I've found
                                                          opening the
                                                          web UI
                                                          firmware page
                                                          or calling
                                                          "ota status"
                                                          via ssh to
                                                          consistently
                                                          deadlock the
                                                          network on my
                                                          module.<br
                                                          class="">
                                                          <br class="">
                                                          <font class=""
face="monospace">I (130531) webserver: HTTP GET /cfg/firmware<br
                                                          class="">
                                                          D (130531)
                                                          http:
                                                          OvmsSyncHttpClient:
                                                          Connect to <a
href="http://ovms.dexters-web.de/" class="" moz-do-not-send="true">ovms.dexters-web.de:80</a><br
                                                          class="">
                                                          D (130541)
                                                          http:
                                                          OvmsSyncHttpClient:
                                                          waiting for
                                                          completion</font><br
                                                          class="">
                                                          <br class="">
                                                          After that log
                                                          message, the
                                                          network is
                                                          dead, and the
                                                          netmanager
                                                          also doesn't
                                                          respond:<br
                                                          class="">
                                                          <br class="">
                                                          <font class=""
face="monospace">OVMS# network list <br class="">
                                                          ERROR: job
                                                          failed<br
                                                          class="">
                                                          D (183241)
                                                          netmanager:
                                                          send cmd 1
                                                          from
                                                          0x3ffe7054<br
                                                          class="">
                                                          W (193241)
                                                          netmanager:
                                                          ExecuteJob:
                                                          cmd 1: timeout</font><br
                                                          class="">
                                                          <br class="">
                                                          The interfaces
                                                          seem to be
                                                          registered and
                                                          online, but
                                                          nothing gets
                                                          in or out:<br
                                                          class="">
                                                          <br class="">
                                                          <font class=""
face="monospace">OVMS# network status <br class="">
                                                          Interface#3:
                                                          pp3 (ifup=1
                                                          linkup=1)<br
                                                          class="">
                                                            IPv4:
                                                          10.170.195.13/255.255.255.255
                                                          gateway
                                                          10.64.64.64<br
                                                          class="">
                                                          <br class="">
                                                          Interface#2:
                                                          ap2 (ifup=1
                                                          linkup=1)<br
                                                          class="">
                                                            IPv4:
                                                          192.168.4.1/255.255.255.0
                                                          gateway
                                                          192.168.4.1<br
                                                          class="">
                                                          <br class="">
                                                          Interface#1:
                                                          st1 (ifup=1
                                                          linkup=1)<br
                                                          class="">
                                                            IPv4:
                                                          192.168.2.106/255.255.255.0
                                                          gateway
                                                          192.168.2.1<br
                                                          class="">
                                                          <br class="">
                                                          DNS:
                                                          192.168.2.1<br
                                                          class="">
                                                          <br class="">
                                                          Default
                                                          Interface: st1
(192.168.2.106/255.255.255.0 gateway 192.168.2.1)</font><br class="">
                                                          <br class="">
                                                          <br class="">
                                                          A couple of
                                                          minutes later,
                                                          server-v2
                                                          recognizes the
                                                          stale
                                                          connection and
                                                          issues a
                                                          network
                                                          restart, which
                                                          fails
                                                          resulting in
                                                          the same
                                                          behaviour as
                                                          shown below
                                                          with finally
                                                          forced reboot
                                                          by loss of an
                                                          important
                                                          event.<br
                                                          class="">
                                                          <br class="">
                                                          Doing "ota
                                                          status" from
                                                          USB works
                                                          normally, so
                                                          this looks
                                                          like
                                                          OvmsSyncHttpClient
                                                          not being able
                                                          to run from
                                                          within a
                                                          mongoose
                                                          client.<br
                                                          class="">
                                                          <br class="">
                                                          Regards,<br
                                                          class="">
                                                          Michael<br
                                                          class="">
                                                          <br class="">
                                                          <br class="">
                                                          <div
                                                          class="moz-cite-prefix">Am
                                                          18.03.21 um
                                                          08:14 schrieb
                                                          Mark
                                                          Webb-Johnson:<br
                                                          class="">
                                                          </div>
                                                          <blockquote
                                                          type="cite"
                                                          cite="mid:1FD94B8C-1060-44BF-8E3A-6D3534352100@webb-johnson.net"
                                                          class="">
                                                          <meta
                                                          http-equiv="Content-Type"
content="text/html; charset=UTF-8" class="">
                                                          Tried to
                                                          repeat this,
                                                          but not having
                                                          much success.
                                                          Here is my car
                                                          module, with
                                                          network still
                                                          up:
                                                          <div class=""><br
                                                          class="">
                                                          </div>
                                                          <blockquote
                                                          style="margin:
                                                          0 0 0 40px;
                                                          border: none;
                                                          padding: 0px;"
                                                          class="">
                                                          <div class="">
                                                          <div class="">OVMS#
                                                          boot status</div>
                                                          <div class="">Last
                                                          boot was
                                                          262355
                                                          second(s) ago</div>
                                                          </div>
                                                          </blockquote>
                                                          <div class="">
                                                          <div class=""><br
                                                          class="">
                                                          </div>
                                                          <div class="">I
                                                          did manage to
                                                          catch one
                                                          network
                                                          related crash
                                                          after
                                                          repeatedly
                                                          disconnecting
                                                          and
                                                          reconnecting
                                                          the cellular
                                                          antenna. This
                                                          was:</div>
                                                          <div class=""><br
                                                          class="">
                                                          </div>
                                                          </div>
                                                          <blockquote
                                                          style="margin:
                                                          0 0 0 40px;
                                                          border: none;
                                                          padding: 0px;"
                                                          class="">
                                                          <div class="">
                                                          <div class=""><font
                                                          class=""
                                                          face="Andale
                                                          Mono"><span
                                                          style="font-style:
                                                          normal;
                                                          font-size:
                                                          12px;"
                                                          class="">I
                                                          (3717989)
                                                          cellular: PPP
                                                          Connection
                                                          disconnected</span></font></div>
                                                          <div class=""><font
                                                          class=""
                                                          face="Andale
                                                          Mono"><span
                                                          style="font-style:
                                                          normal;
                                                          font-size:
                                                          12px;"
                                                          class="">Guru
                                                          Meditation
                                                          Error: Core  1
                                                          panic'ed
                                                          (LoadProhibited).
                                                          Exception was
                                                          unhandled.</span></font></div>
                                                          </div>
                                                          <div class=""><font
                                                          class=""
                                                          face="Andale
                                                          Mono"><span
                                                          style="font-style:
                                                          normal;
                                                          font-size:
                                                          12px;"
                                                          class=""><br
                                                          class="">
                                                          </span></font></div>
                                                          <div class=""><font
                                                          class=""
                                                          face="Andale
                                                          Mono"><span
                                                          style="font-style:
                                                          normal;
                                                          font-size:
                                                          12px;"
                                                          class="">0x400fe082
                                                          is in
                                                          OvmsNetManager::PrioritiseAndIndicate()
(/home/openvehicles/build/Open-Vehicle-Monitoring-System-pre/vehicle/OVMS.V3/main/ovms_netmanager.cpp:707).</span></font></div>
                                                          </blockquote>
                                                          <blockquote
                                                          style="margin:
                                                          0 0 0 40px;
                                                          border: none;
                                                          padding: 0px;"
                                                          class="">
                                                          <blockquote
                                                          style="margin:
                                                          0 0 0 40px;
                                                          border: none;
                                                          padding: 0px;"
                                                          class="">
                                                          <div class=""><font
                                                          class=""
                                                          face="Andale
                                                          Mono"><span
                                                          style="font-style:
                                                          normal;
                                                          font-size:
                                                          12px;"
                                                          class="">707  
                                                                if
                                                          ((pri->name[0]==search[0])&&</span></font></div>
                                                          </blockquote>
                                                          <font class=""
                                                          face="Andale
                                                          Mono"><span
                                                          style="font-style:
                                                          normal;
                                                          font-size:
                                                          12px;"
                                                          class=""><br
                                                          class="">
                                                          </span></font></blockquote>
                                                          <blockquote
                                                          style="margin:
                                                          0 0 0 40px;
                                                          border: none;
                                                          padding: 0px;"
                                                          class=""><font
                                                          class=""
                                                          face="Andale
                                                          Mono"><span
                                                          style="font-style:
                                                          normal;
                                                          font-size:
                                                          12px;"
                                                          class="">0x400ed360
                                                          is in
                                                          OvmsMetricString::SetValue(std::__cxx11::basic_string<char,
std::char_traits<char>, std::allocator<char> >)
(/home/openvehicles/build/Open-Vehicle-Monitoring-System-pre/vehicle/OVMS.V3/main/ovms_metrics.cpp:1358).</span></font></blockquote>
                                                          <blockquote
                                                          style="margin:
                                                          0 0 0 40px;
                                                          border: none;
                                                          padding: 0px;"
                                                          class="">
                                                          <blockquote
                                                          style="margin:
                                                          0 0 0 40px;
                                                          border: none;
                                                          padding: 0px;"
                                                          class=""><font
                                                          class=""
                                                          face="Andale
                                                          Mono"><span
                                                          style="font-style:
                                                          normal;
                                                          font-size:
                                                          12px;"
                                                          class="">1357
                                                             void
                                                          OvmsMetricString::SetValue(std::string
                                                          value)</span></font></blockquote>
                                                          <font class=""
                                                          face="Andale
                                                          Mono"><span
                                                          style="font-style:
                                                          normal;
                                                          font-size:
                                                          12px;"
                                                          class=""><br
                                                          class="">
                                                          </span></font></blockquote>
                                                          <blockquote
                                                          style="margin:
                                                          0 0 0 40px;
                                                          border: none;
                                                          padding: 0px;"
                                                          class=""><font
                                                          class=""
                                                          face="Andale
                                                          Mono"><span
                                                          style="font-style:
                                                          normal;
                                                          font-size:
                                                          12px;"
                                                          class="">0x4008bdad
                                                          is at
                                                          ../../../../.././newlib/libc/machine/xtensa/strcmp.S:586.</span></font></blockquote>
                                                          <blockquote
                                                          style="margin:
                                                          0 0 0 40px;
                                                          border: none;
                                                          padding: 0px;"
                                                          class=""><font
                                                          class=""
                                                          face="Andale
                                                          Mono"><span
                                                          style="font-style:
                                                          normal;
                                                          font-size:
                                                          12px;"
                                                          class=""><br
                                                          class="">
                                                          </span></font></blockquote>
                                                          <blockquote
                                                          style="margin:
                                                          0 0 0 40px;
                                                          border: none;
                                                          padding: 0px;"
                                                          class=""><font
                                                          class=""
                                                          face="Andale
                                                          Mono"><span
                                                          style="font-style:
                                                          normal;
                                                          font-size:
                                                          12px;"
                                                          class="">0x4008bdd1
                                                          is at
                                                          ../../../../.././newlib/libc/machine/xtensa/strcmp.S:604.</span></font></blockquote>
                                                          <blockquote
                                                          style="margin:
                                                          0 0 0 40px;
                                                          border: none;
                                                          padding: 0px;"
                                                          class=""><font
                                                          class=""
                                                          face="Andale
                                                          Mono"><span
                                                          style="font-style:
                                                          normal;
                                                          font-size:
                                                          12px;"
                                                          class=""><br
                                                          class="">
                                                          </span></font></blockquote>
                                                          <blockquote
                                                          style="margin:
                                                          0 0 0 40px;
                                                          border: none;
                                                          padding: 0px;"
                                                          class=""><font
                                                          class=""
                                                          face="Andale
                                                          Mono"><span
                                                          style="font-style:
                                                          normal;
                                                          font-size:
                                                          12px;"
                                                          class="">0x400fe886
                                                          is in
                                                          OvmsNetManager::ModemDown(std::__cxx11::basic_string<char,
std::char_traits<char>, std::allocator<char> >, void*)
(/home/openvehicles/build/Open-Vehicle-Monitoring-System-pre/vehicle/OVMS.V3/main/ovms_netmanager.cpp:522).</span></font></blockquote>
                                                          <blockquote
                                                          style="margin:
                                                          0 0 0 40px;
                                                          border: none;
                                                          padding: 0px;"
                                                          class="">
                                                          <blockquote
                                                          style="margin:
                                                          0 0 0 40px;
                                                          border: none;
                                                          padding: 0px;"
                                                          class=""><font
                                                          class=""
                                                          face="Andale
                                                          Mono"><span
                                                          style="font-style:
                                                          normal;
                                                          font-size:
                                                          12px;"
                                                          class="">522  
                                                               
                                                          PrioritiseAndIndicate();</span></font></blockquote>
                                                          </blockquote>
                                                          <blockquote
                                                          style="margin:
                                                          0 0 0 40px;
                                                          border: none;
                                                          padding: 0px;"
                                                          class=""><font
                                                          class=""
                                                          face="Andale
                                                          Mono"><span
                                                          style="font-style:
                                                          normal;
                                                          font-size:
                                                          12px;"
                                                          class=""><br
                                                          class="">
                                                          </span></font></blockquote>
                                                          <blockquote
                                                          style="margin:
                                                          0 0 0 40px;
                                                          border: none;
                                                          padding: 0px;"
                                                          class=""><font
                                                          class=""
                                                          face="Andale
                                                          Mono"><span
                                                          style="font-style:
                                                          normal;
                                                          font-size:
                                                          12px;"
                                                          class="">0x400fd752
                                                          is in
                                                          std::_Function_handler<void
(std::__cxx11::basic_string<char, std::char_traits<char>,
                                                          std::allocator<char>
                                                          >, void*),
std::_Bind<std::_Mem_fn<void
(OvmsNetManager::*)(std::__cxx11::basic_string<char,
                                                          std::char_traits<char>,
std::allocator<char> >, void*)> (OvmsNetManager*,
                                                          std::_Placeholder<1>,
std::_Placeholder<2>)> >::_M_invoke(std::_Any_data
                                                          const&,
                                                          std::__cxx11::basic_string<char,
std::char_traits<char>, std::allocator<char> >&&,
void*&&)
(/home/openvehicles/build/xtensa-esp32-elf/xtensa-esp32-elf/include/c++/5.2.0/functional:600).</span></font></blockquote>
                                                          <blockquote
                                                          style="margin:
                                                          0 0 0 40px;
                                                          border: none;
                                                          padding: 0px;"
                                                          class="">
                                                          <blockquote
                                                          style="margin:
                                                          0 0 0 40px;
                                                          border: none;
                                                          padding: 0px;"
                                                          class=""><font
                                                          class=""
                                                          face="Andale
                                                          Mono"><span
                                                          style="font-style:
                                                          normal;
                                                          font-size:
                                                          12px;"
                                                          class="">600  
                                                                    {
                                                          return
(__object->*_M_pmf)(std::forward<_Args>(__args)...); }</span></font></blockquote>
                                                          </blockquote>
                                                          <blockquote
                                                          style="margin:
                                                          0 0 0 40px;
                                                          border: none;
                                                          padding: 0px;"
                                                          class=""><font
                                                          class=""
                                                          face="Andale
                                                          Mono"><span
                                                          style="font-style:
                                                          normal;
                                                          font-size:
                                                          12px;"
                                                          class=""><br
                                                          class="">
                                                          </span></font></blockquote>
                                                          <blockquote
                                                          style="margin:
                                                          0 0 0 40px;
                                                          border: none;
                                                          padding: 0px;"
                                                          class=""><font
                                                          class=""
                                                          face="Andale
                                                          Mono"><span
                                                          style="font-style:
                                                          normal;
                                                          font-size:
                                                          12px;"
                                                          class="">0x400f512e
                                                          is in
                                                          std::function<void
(std::__cxx11::basic_string<char, std::char_traits<char>,
                                                          std::allocator<char>
                                                          >,
                                                          void*)>::operator()(std::__cxx11::basic_string<char,
std::char_traits<char>, std::allocator<char> >, void*)
                                                          const
(/home/openvehicles/build/xtensa-esp32-elf/xtensa-esp32-elf/include/c++/5.2.0/functional:2271).</span></font></blockquote>
                                                          <blockquote
                                                          style="margin:
                                                          0 0 0 40px;
                                                          border: none;
                                                          padding: 0px;"
                                                          class="">
                                                          <blockquote
                                                          style="margin:
                                                          0 0 0 40px;
                                                          border: none;
                                                          padding: 0px;"
                                                          class=""><font
                                                          class=""
                                                          face="Andale
                                                          Mono"><span
                                                          style="font-style:
                                                          normal;
                                                          font-size:
                                                          12px;"
                                                          class="">2271
                                                                 
                                                           return
                                                          _M_invoker(_M_functor,
std::forward<_ArgTypes>(__args)...);</span></font></blockquote>
                                                          </blockquote>
                                                          <blockquote
                                                          style="margin:
                                                          0 0 0 40px;
                                                          border: none;
                                                          padding: 0px;"
                                                          class=""><font
                                                          class=""
                                                          face="Andale
                                                          Mono"><span
                                                          style="font-style:
                                                          normal;
                                                          font-size:
                                                          12px;"
                                                          class=""><br
                                                          class="">
                                                          </span></font></blockquote>
                                                          <blockquote
                                                          style="margin:
                                                          0 0 0 40px;
                                                          border: none;
                                                          padding: 0px;"
                                                          class=""><font
                                                          class=""
                                                          face="Andale
                                                          Mono"><span
                                                          style="font-style:
                                                          normal;
                                                          font-size:
                                                          12px;"
                                                          class="">0x400f52f1
                                                          is in
                                                          OvmsEvents::HandleQueueSignalEvent(event_queue_t*)
(/home/openvehicles/build/Open-Vehicle-Monitoring-System-pre/vehicle/OVMS.V3/main/ovms_events.cpp:283).</span></font></blockquote>
                                                          <blockquote
                                                          style="margin:
                                                          0 0 0 40px;
                                                          border: none;
                                                          padding: 0px;"
                                                          class="">
                                                          <blockquote
                                                          style="margin:
                                                          0 0 0 40px;
                                                          border: none;
                                                          padding: 0px;"
                                                          class=""><font
                                                          class=""
                                                          face="Andale
                                                          Mono"><span
                                                          style="font-style:
                                                          normal;
                                                          font-size:
                                                          12px;"
                                                          class="">283  
                                                                   
                                                          m_current_callback->m_callback(m_current_event,
msg->body.signal.data);</span></font></blockquote>
                                                          </blockquote>
                                                          <blockquote
                                                          style="margin:
                                                          0 0 0 40px;
                                                          border: none;
                                                          padding: 0px;"
                                                          class=""><font
                                                          class=""
                                                          face="Andale
                                                          Mono"><span
                                                          style="font-style:
                                                          normal;
                                                          font-size:
                                                          12px;"
                                                          class=""><br
                                                          class="">
                                                          </span></font></blockquote>
                                                          <blockquote
                                                          style="margin:
                                                          0 0 0 40px;
                                                          border: none;
                                                          padding: 0px;"
                                                          class=""><font
                                                          class=""
                                                          face="Andale
                                                          Mono"><span
                                                          style="font-style:
                                                          normal;
                                                          font-size:
                                                          12px;"
                                                          class="">0x400f53d8
                                                          is in
                                                          OvmsEvents::EventTask()
(/home/openvehicles/build/Open-Vehicle-Monitoring-System-pre/vehicle/OVMS.V3/main/ovms_events.cpp:237).</span></font></blockquote>
                                                          <blockquote
                                                          style="margin:
                                                          0 0 0 40px;
                                                          border: none;
                                                          padding: 0px;"
                                                          class="">
                                                          <blockquote
                                                          style="margin:
                                                          0 0 0 40px;
                                                          border: none;
                                                          padding: 0px;"
                                                          class=""><font
                                                          class=""
                                                          face="Andale
                                                          Mono"><span
                                                          style="font-style:
                                                          normal;
                                                          font-size:
                                                          12px;"
                                                          class="">237  
                                                                     
HandleQueueSignalEvent(&msg);</span></font></blockquote>
                                                          </blockquote>
                                                          <blockquote
                                                          style="margin:
                                                          0 0 0 40px;
                                                          border: none;
                                                          padding: 0px;"
                                                          class=""><font
                                                          class=""
                                                          face="Andale
                                                          Mono"><span
                                                          style="font-style:
                                                          normal;
                                                          font-size:
                                                          12px;"
                                                          class=""><br
                                                          class="">
                                                          </span></font></blockquote>
                                                          <blockquote
                                                          style="margin:
                                                          0 0 0 40px;
                                                          border: none;
                                                          padding: 0px;"
                                                          class=""><font
                                                          class=""
                                                          face="Andale
                                                          Mono"><span
                                                          style="font-style:
                                                          normal;
                                                          font-size:
                                                          12px;"
                                                          class="">0x400f545d
                                                          is in
                                                          EventLaunchTask(void*)
(/home/openvehicles/build/Open-Vehicle-Monitoring-System-pre/vehicle/OVMS.V3/main/ovms_events.cpp:80).</span></font></blockquote>
                                                          <blockquote
                                                          style="margin:
                                                          0 0 0 40px;
                                                          border: none;
                                                          padding: 0px;"
                                                          class="">
                                                          <blockquote
                                                          style="margin:
                                                          0 0 0 40px;
                                                          border: none;
                                                          padding: 0px;"
                                                          class=""><font
                                                          class=""
                                                          face="Andale
                                                          Mono"><span
                                                          style="font-style:
                                                          normal;
                                                          font-size:
                                                          12px;"
                                                          class="">80  
                                                             
                                                           me->EventTask();</span></font></blockquote>
                                                          </blockquote>
                                                          <div class="">
                                                          <div class=""><br
                                                          class="">
                                                          </div>
                                                          <div class="">My
                                                          for_v3.3
                                                          branch does
                                                          include the
                                                          preliminary
                                                          changes to
                                                          support the
                                                          wifi at 20MHz
                                                          bandwidth, and
                                                          perhaps those
                                                          could be
                                                          affecting
                                                          things. I do
                                                          notice that if
                                                          I ‘power wifi
                                                          off’, then
                                                          ‘wifi mode
                                                          client’, it
                                                          can connect to
                                                          the station,
                                                          but not get an
                                                          IP address.
                                                          I’ve just
                                                          tried to merge
                                                          in the latest
                                                          fixes to that,
                                                          and rebuilt a
                                                          release. I
                                                          will continue
                                                          to test with
                                                          that.</div>
                                                          <div class=""><br
                                                          class="">
                                                          </div>
                                                          <div class="">Regards,
                                                          Mark.</div>
                                                          <div class=""><br
                                                          class="">
                                                          <blockquote
                                                          type="cite"
                                                          class="">
                                                          <div class="">On
                                                          12 Mar 2021,
                                                          at 10:32 PM,
                                                          Michael Balzer
                                                          <<a
                                                          href="mailto:dexter@expeedo.de"
                                                          class=""
                                                          moz-do-not-send="true">dexter@expeedo.de</a>>
                                                          wrote:</div>
                                                          <br
                                                          class="Apple-interchange-newline">
                                                          <div class="">
                                                          <div class="">
                                                          <div
                                                          class="content-isolator__container">
                                                          <div
                                                          class="protected-part">
                                                          <div
                                                          class="protected-title">Signed
                                                          PGP part</div>
                                                          <div
                                                          class="protected-content">I
                                                          just tried
                                                          switching to
                                                          for-v3.3 in my
                                                          car module
                                                          after tests on
                                                          my desk module
                                                          were OK, and
                                                          I've run into
                                                          the very same
                                                          problem with
                                                          for-v3.3. So
                                                          the issue
                                                          isn't related
                                                          to esp-idf.<br
                                                          class="">
                                                          <br class="">
                                                          The network
                                                          only
                                                          occasionally
                                                          starts
                                                          normally, but
                                                          even then all
                                                          connectivity
                                                          is lost after
                                                          a couple of
                                                          minutes.<br
                                                          class="">
                                                          <br class="">
                                                          The stale
                                                          connection
                                                          watchdog in
                                                          server-v2
                                                          triggers a
                                                          network
                                                          restart, but
                                                          that also
                                                          doesn't seem
                                                          to succeed:<br
                                                          class="">
                                                          <br class="">
                                                          2021-03-12
                                                          14:53:01.802
                                                          CET W (981652)
ovms-server-v2: Detected stale connection (issue #241), restarting
                                                          network<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:01.802
                                                          CET I (981652)
                                                          esp32wifi:
                                                          Restart<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:01.802
                                                          CET I (981652)
                                                          esp32wifi:
                                                          Stopping WIFI
                                                          station<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:01.812
                                                          CET I (981662)
                                                          wifi:state:
                                                          run -> init
                                                          (0)<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:01.812
                                                          CET I (981662)
                                                          wifi:pm stop,
                                                          total sleep
                                                          time:
                                                          831205045 us /
                                                          975329961 us<br
                                                          class="">
                                                          <br class="">
                                                          2021-03-12
                                                          14:53:01.812
                                                          CET I (981662)
wifi:new:<1,0>, old:<1,1>, ap:<1,1>, sta:<1,1>,
                                                          prof:1<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:01.832
                                                          CET I (981682)
                                                          wifi:flush txq<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:01.842
                                                          CET I (981692)
                                                          wifi:stop sw
                                                          txq<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:01.842
                                                          CET I (981692)
                                                          wifi:lmac stop
                                                          hw txq<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:01.852
                                                          CET I (981702)
                                                          esp32wifi:
                                                          Powering down
                                                          WIFI driver<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:01.852
                                                          CET I (981702)
                                                          wifi:Deinit
                                                          lldesc rx
                                                          mblock:16<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:01.862
                                                          CET I (981712)
                                                          esp32wifi:
                                                          Powering up
                                                          WIFI driver<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:01.862
                                                          CET I (981712)
wifi:nvs_log_init, erase log key successfully, reinit nvs log<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:01.882
                                                          CET I (981732)
                                                          wifi:wifi
                                                          driver task:
                                                          3ffd4d84,
                                                          prio:23,
                                                          stack:3584,
                                                          core=0<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:01.882
                                                          CET I (981732)
                                                          system_api:
                                                          Base MAC
                                                          address is not
                                                          set, read
                                                          default base
                                                          MAC address
                                                          from BLK0 of
                                                          EFUSE<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:01.882
                                                          CET I (981732)
                                                          system_api:
                                                          Base MAC
                                                          address is not
                                                          set, read
                                                          default base
                                                          MAC address
                                                          from BLK0 of
                                                          EFUSE<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:01.902
                                                          CET I (981752)
                                                          wifi:wifi
                                                          firmware
                                                          version:
                                                          30f9e79<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:01.912
                                                          CET I (981762)
                                                          wifi:config
                                                          NVS flash:
                                                          enabled<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:01.912
                                                          CET I (981762)
                                                          wifi:config
                                                          nano
                                                          formating:
                                                          disabled<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:01.912
                                                          CET I (981762)
                                                          wifi:Init data
                                                          frame dynamic
                                                          rx buffer num:
                                                          16<br class="">
                                                          2021-03-12
                                                          14:53:01.912
                                                          CET I (981762)
                                                          wifi:Init
                                                          management
                                                          frame dynamic
                                                          rx buffer num:
                                                          16<br class="">
                                                          2021-03-12
                                                          14:53:01.922
                                                          CET I (981772)
                                                          wifi:Init
                                                          management
                                                          short buffer
                                                          num: 32<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:01.922
                                                          CET I (981772)
                                                          wifi:Init
                                                          dynamic tx
                                                          buffer num: 16<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:01.922
                                                          CET I (981772)
                                                          wifi:Init
                                                          static rx
                                                          buffer size:
                                                          2212<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:01.922
                                                          CET I (981772)
                                                          wifi:Init
                                                          static rx
                                                          buffer num: 16<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:01.922
                                                          CET I (981772)
                                                          wifi:Init
                                                          dynamic rx
                                                          buffer num: 16<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:02.642
                                                          CET I (982492)
                                                          wifi:mode :
                                                          sta
                                                          (30:ae:a4:5f:e7:ec)
                                                          + softAP
                                                          (30:ae:a4:5f:e7:ed)<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:02.652
                                                          CET I (982502)
                                                          wifi:Total
                                                          power save
                                                          buffer number:
                                                          8<br class="">
                                                          2021-03-12
                                                          14:53:02.652
                                                          CET I (982502)
cellular-modem-auto: Restart<br class="">
                                                          2021-03-12
                                                          14:53:02.662
                                                          CET I (982512)
                                                          cellular:
                                                          State: Enter
                                                          PowerOffOn
                                                          state<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:02.662
                                                          CET I (982512)
                                                          gsm-ppp:
                                                          Shutting down
                                                          (hard)...<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:02.662
                                                          CET I (982512)
                                                          gsm-ppp:
                                                          StatusCallBack:
                                                          User Interrupt<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:02.662
                                                          CET I (982512)
                                                          gsm-ppp: PPP
                                                          connection has
                                                          been closed<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:02.662
                                                          CET I (982512)
                                                          gsm-ppp: PPP
                                                          is shutdown<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:02.662
                                                          CET I (982512)
                                                          gsm-ppp:
                                                          Shutting down
                                                          (hard)...<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:02.672
                                                          CET I (982522)
                                                          gsm-ppp:
                                                          StatusCallBack:
                                                          User Interrupt<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:02.672
                                                          CET I (982522)
                                                          gsm-ppp: PPP
                                                          connection has
                                                          been closed<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:02.672
                                                          CET I (982522)
                                                          gsm-ppp: PPP
                                                          is shutdown<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:02.672
                                                          CET I (982522)
                                                          gsm-nmea:
                                                          Shutdown
                                                          (direct)<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:02.672
                                                          CET I (982522)
cellular-modem-auto: Power Cycle<br class="">
                                                          2021-03-12
                                                          14:53:04.682
                                                          CET D (984532)
                                                          events:
                                                          Signal(system.wifi.down)<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:04.682
                                                          CET I (984532)
                                                          netmanager:
                                                          WIFI client
                                                          stop<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:04.682
                                                          CET E (984532)
                                                          netmanager:
                                                          Inconsistent
                                                          state: no
                                                          interface of
                                                          type 'pp'
                                                          found<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:04.682
                                                          CET I (984532)
                                                          netmanager:
                                                          WIFI client
                                                          down (with
                                                          MODEM up):
                                                          reconfigured
                                                          for MODEM
                                                          priority<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:04.692
                                                          CET D (984542)
                                                          events:
                                                          Signal(system.event)<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:04.692
                                                          CET D (984542)
                                                          events:
                                                          Signal(system.wifi.sta.disconnected)<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:04.692
                                                          CET E (984542)
                                                          netmanager:
                                                          Inconsistent
                                                          state: no
                                                          interface of
                                                          type 'pp'
                                                          found<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:04.692
                                                          CET I (984542)
                                                          esp32wifi: STA
                                                          disconnected
                                                          with reason 8
                                                          = ASSOC_LEAVE<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:04.702
                                                          CET D (984552)
                                                          events:
                                                          Signal(system.event)<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:04.702
                                                          CET D (984552)
                                                          events:
                                                          Signal(system.wifi.sta.stop)<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:04.702
                                                          CET E (984552)
                                                          netmanager:
                                                          Inconsistent
                                                          state: no
                                                          interface of
                                                          type 'pp'
                                                          found<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:04.712
                                                          CET D (984562)
                                                          events:
                                                          Signal(system.event)<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:04.712
                                                          CET D (984562)
                                                          events:
                                                          Signal(system.wifi.ap.stop)<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:04.712
                                                          CET E (984562)
                                                          netmanager:
                                                          Inconsistent
                                                          state: no
                                                          interface of
                                                          type 'pp'
                                                          found<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:04.712
                                                          CET I (984562)
                                                          netmanager:
                                                          WIFI access
                                                          point is down<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:04.712
                                                          CET I (984562)
                                                          esp32wifi: AP
                                                          stopped<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:04.722
                                                          CET D (984572)
                                                          events:
                                                          Signal(network.wifi.sta.bad)<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:04.722
                                                          CET D (984572)
                                                          events:
                                                          Signal(system.event)<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:04.722
                                                          CET D (984572)
                                                          events:
                                                          Signal(system.wifi.sta.start)<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:04.732
                                                          CET D (984582)
                                                          events:
                                                          Signal(system.modem.down)<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:04.742
                                                          CET I (984592)
                                                          netmanager:
                                                          MODEM down
                                                          (with WIFI
                                                          client down):
                                                          network
                                                          connectivity
                                                          has been lost<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:04.742
                                                          CET D (984592)
                                                          events:
                                                          Signal(system.modem.down)<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:04.752
                                                          CET D (984602)
                                                          events:
                                                          Signal(system.event)<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:04.752
                                                          CET D (984602)
                                                          events:
                                                          Signal(system.wifi.ap.start)<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:04.752
                                                          CET I (984602)
                                                          netmanager:
                                                          WIFI access
                                                          point is up<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:26.802
                                                          CET E
                                                          (1006652)
                                                          events:
                                                          SignalEvent:
                                                          queue overflow
                                                          (running
                                                          system.wifi.ap.start->netmanager
                                                          for 23 sec),
                                                          event
                                                          'ticker.1'
                                                          dropped<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:27.802
                                                          CET E
                                                          (1007652)
                                                          events:
                                                          SignalEvent:
                                                          queue overflow
                                                          (running
                                                          system.wifi.ap.start->netmanager
                                                          for 24 sec),
                                                          event
                                                          'ticker.1'
                                                          dropped<br
                                                          class="">
                                                          2021-03-12
                                                          14:53:28.802
                                                          CET E
                                                          (1008652)
                                                          events:
                                                          SignalEvent:
                                                          queue overflow
                                                          (running
                                                          system.wifi.ap.start->netmanager
                                                          for 25 sec),
                                                          event
                                                          'ticker.1'
                                                          dropped<br
                                                          class="">
                                                          …and so on
                                                          until<br
                                                          class="">
                                                          2021-03-12
                                                          14:54:01.802
                                                          CET E
                                                          (1041652)
                                                          events:
                                                          SignalEvent:
                                                          lost important
                                                          event =>
                                                          aborting<br
                                                          class="">
                                                          <br class="">
                                                          <br class="">
                                                          I need my car
                                                          now, so will
                                                          switch back to
                                                          master for
                                                          now.<br
                                                          class="">
                                                          <br class="">
                                                          Mark, if
                                                          you've got
                                                          specific debug
                                                          logs I should
                                                          fetch on the
                                                          next try, tell
                                                          me.<br
                                                          class="">
                                                          <br class="">
                                                          Regards,<br
                                                          class="">
                                                          Michael<br
                                                          class="">
                                                          <br class="">
                                                          <br class="">
                                                          Am 12.03.21 um
                                                          05:47 schrieb
                                                          Craig Leres:<br
                                                          class="">
                                                          <blockquote
                                                          type="cite"
                                                          class="">I
                                                          just updated
                                                          to
                                                          3.2.016-68-g8e10c6b7
                                                          and still get
                                                          the network
                                                          hang
                                                          immediately
                                                          after booting
                                                          and logging
                                                          into the web
                                                          gui.<br
                                                          class="">
                                                          <br class="">
                                                          But I see now
                                                          my problem is
                                                          likely that
                                                          I'm not using
                                                          the right
                                                          esp-idf (duh).
                                                          Is there a way
                                                          I can have
                                                          master build
                                                          using
                                                          ~/esp/esp-idf
                                                          and have
                                                          for-v3.3 use a
                                                          different
                                                          path?)<br
                                                          class="">
                                                          <br class="">
                                                                  Craig<br
                                                          class="">
_______________________________________________<br class="">
                                                          OvmsDev
                                                          mailing list<br
                                                          class="">
                                                          <a
                                                          href="mailto:OvmsDev@lists.openvehicles.com"
                                                          class=""
                                                          moz-do-not-send="true">OvmsDev@lists.openvehicles.com</a><br
                                                          class="">
                                                          <a
                                                          href="http://lists.openvehicles.com/mailman/listinfo/ovmsdev"
                                                          class=""
                                                          moz-do-not-send="true">http://lists.openvehicles.com/mailman/listinfo/ovmsdev</a><br
                                                          class="">
                                                          </blockquote>
                                                          <br class="">
                                                          -- <br
                                                          class="">
                                                          Michael Balzer
                                                          * Helkenberger
                                                          Weg 9 *
                                                          D-58256
                                                          Ennepetal<br
                                                          class="">
                                                          Fon 02333 /
                                                          833 5735 *
                                                          Handy 0176 /
                                                          206 989 26<br
                                                          class="">
                                                          <br class="">
                                                          <br class="">
                                                          </div>
                                                          </div>
                                                          <br class="">
                                                          <iframe
                                                          class="content-isolator__isolated-content"
sandbox="allow-scripts" scrolling="auto"
                                                          style="border:none;display:block;overflow:auto;"
data-src="data:text/html;charset=UTF-8;base64,PGlmcmFtZS1jb250ZW50IGRhdGEtaWZyYW1lLWhlaWdodD0idHJ1ZSI+X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX188QlI+T3Ztc0RldiBtYWlsaW5nIGxpc3Q8QlI+T3Ztc0RldkBsaXN0cy5vcGVudmVoaWNsZXMuY29tPEJSPmh0dHA6Ly9saXN0cy5vcGVudmVoaWNsZXMuY29tL21haWxtYW4vbGlzdGluZm8vb3Ztc2RldjxCUj48L2lmcmFtZS1jb250ZW50Pg=="
                                                          width="200"
                                                          height="10"></iframe></div>
                                                          </div>
                                                          </div>
                                                          </blockquote>
                                                          </div>
                                                          <br class="">
                                                          </div>
                                                          <br class="">
                                                          <fieldset
                                                          class="mimeAttachmentHeader"></fieldset>
                                                          <pre class="moz-quote-pre" wrap="">_______________________________________________
OvmsDev mailing list
<a class="moz-txt-link-abbreviated" href="mailto:OvmsDev@lists.openvehicles.com" moz-do-not-send="true">OvmsDev@lists.openvehicles.com</a>
<a class="moz-txt-link-freetext" href="http://lists.openvehicles.com/mailman/listinfo/ovmsdev" moz-do-not-send="true">http://lists.openvehicles.com/mailman/listinfo/ovmsdev</a>
</pre>
                                                          </blockquote>
                                                          <br class="">
                                                          <pre class="moz-signature" cols="72">-- 
Michael Balzer * Helkenberger Weg 9 * D-58256 Ennepetal
Fon 02333 / 833 5735 * Handy 0176 / 206 989 26</pre>
                                                          </div>
                                                          </div>
                                                          </div>
                                                          <br class="">
                                                          <iframe
                                                          class="content-isolator__isolated-content"
sandbox="allow-scripts" scrolling="auto"
                                                          style="border:none;display:block;overflow:auto;"
data-src="data:text/html;charset=UTF-8;base64,PGlmcmFtZS1jb250ZW50IGRhdGEtaWZyYW1lLWhlaWdodD0idHJ1ZSI+X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX188QlI+T3Ztc0RldiBtYWlsaW5nIGxpc3Q8QlI+T3Ztc0RldkBsaXN0cy5vcGVudmVoaWNsZXMuY29tPEJSPmh0dHA6Ly9saXN0cy5vcGVudmVoaWNsZXMuY29tL21haWxtYW4vbGlzdGluZm8vb3Ztc2RldjxCUj48L2lmcmFtZS1jb250ZW50Pg=="
                                                          width="200"
                                                          height="10"></iframe></div>
                                                          </div>
                                                          </blockquote>
                                                          </div>
                                                          <br class="">
                                                          </div>
                                                          <br class="">
                                                          <fieldset
                                                          class="mimeAttachmentHeader"></fieldset>
                                                          <pre class="moz-quote-pre" wrap="">_______________________________________________
OvmsDev mailing list
<a class="moz-txt-link-abbreviated" href="mailto:OvmsDev@lists.openvehicles.com" moz-do-not-send="true">OvmsDev@lists.openvehicles.com</a>
<a class="moz-txt-link-freetext" href="http://lists.openvehicles.com/mailman/listinfo/ovmsdev" moz-do-not-send="true">http://lists.openvehicles.com/mailman/listinfo/ovmsdev</a>
</pre>
                                                          </blockquote>
                                                          <br class="">
                                                          <pre class="moz-signature" cols="72">-- 
Michael Balzer * Helkenberger Weg 9 * D-58256 Ennepetal
Fon 02333 / 833 5735 * Handy 0176 / 206 989 26</pre>
                                                          <span class="">_______________________________________________</span><br
                                                          class="">
                                                          <span class="">OvmsDev
                                                          mailing list</span><br
                                                          class="">
                                                          <span class=""><a
class="moz-txt-link-abbreviated"
                                                          href="mailto:OvmsDev@lists.openvehicles.com"
moz-do-not-send="true">OvmsDev@lists.openvehicles.com</a></span><br
                                                          class="">
                                                          <span class=""><a
class="moz-txt-link-freetext"
                                                          href="http://lists.openvehicles.com/mailman/listinfo/ovmsdev"
moz-do-not-send="true">http://lists.openvehicles.com/mailman/listinfo/ovmsdev</a></span><br
                                                          class="">
                                                          </div>
                                                          </blockquote>
                                                          <br class="">
                                                          <fieldset
                                                          class="mimeAttachmentHeader"></fieldset>
                                                          <pre class="moz-quote-pre" wrap="">_______________________________________________
OvmsDev mailing list
<a class="moz-txt-link-abbreviated" href="mailto:OvmsDev@lists.openvehicles.com" moz-do-not-send="true">OvmsDev@lists.openvehicles.com</a>
<a class="moz-txt-link-freetext" href="http://lists.openvehicles.com/mailman/listinfo/ovmsdev" moz-do-not-send="true">http://lists.openvehicles.com/mailman/listinfo/ovmsdev</a>
</pre>
                                                          </blockquote>
                                                          <br class="">
                                                          <pre class="moz-signature" cols="72">-- 
Michael Balzer * Helkenberger Weg 9 * D-58256 Ennepetal
Fon 02333 / 833 5735 * Handy 0176 / 206 989 26</pre>
                                                          </div>
                                                          </div>
                                                          </div>
                                                          <br class="">
                                                          <iframe
                                                          class="content-isolator__isolated-content"
sandbox="allow-scripts" scrolling="auto"
                                                          style="border:none;display:block;overflow:auto;"
data-src="data:text/html;charset=UTF-8;base64,PGlmcmFtZS1jb250ZW50IGRhdGEtaWZyYW1lLWhlaWdodD0idHJ1ZSI+X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX188QlI+T3Ztc0RldiBtYWlsaW5nIGxpc3Q8QlI+T3Ztc0RldkBsaXN0cy5vcGVudmVoaWNsZXMuY29tPEJSPmh0dHA6Ly9saXN0cy5vcGVudmVoaWNsZXMuY29tL21haWxtYW4vbGlzdGluZm8vb3Ztc2RldjxCUj48L2lmcmFtZS1jb250ZW50Pg=="
                                                          width="200"
                                                          height="10"></iframe></div>
                                                          </div>
                                                          </blockquote>
                                                          </div>
                                                          <br class="">
                                                          </div>
                                                          <br class="">
                                                          <fieldset
                                                          class="mimeAttachmentHeader"></fieldset>
                                                          <pre class="moz-quote-pre" wrap="">_______________________________________________
OvmsDev mailing list
<a class="moz-txt-link-abbreviated" href="mailto:OvmsDev@lists.openvehicles.com" moz-do-not-send="true">OvmsDev@lists.openvehicles.com</a>
<a class="moz-txt-link-freetext" href="http://lists.openvehicles.com/mailman/listinfo/ovmsdev" moz-do-not-send="true">http://lists.openvehicles.com/mailman/listinfo/ovmsdev</a>
</pre>
                                                          </blockquote>
                                                          <br class="">
                                                          <pre class="moz-signature" cols="72">-- 
Michael Balzer * Helkenberger Weg 9 * D-58256 Ennepetal
Fon 02333 / 833 5735 * Handy 0176 / 206 989 26</pre>
                                                          </div>
                                                          </div>
                                                          </div>
                                                          <br class="">
                                                          <iframe
                                                          class="content-isolator__isolated-content"
sandbox="allow-scripts" scrolling="auto"
                                                          style="border:none;display:block;overflow:auto;"
data-src="data:text/html;charset=UTF-8;base64,PGlmcmFtZS1jb250ZW50IGRhdGEtaWZyYW1lLWhlaWdodD0idHJ1ZSI+X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX188QlI+T3Ztc0RldiBtYWlsaW5nIGxpc3Q8QlI+T3Ztc0RldkBsaXN0cy5vcGVudmVoaWNsZXMuY29tPEJSPmh0dHA6Ly9saXN0cy5vcGVudmVoaWNsZXMuY29tL21haWxtYW4vbGlzdGluZm8vb3Ztc2RldjxCUj48L2lmcmFtZS1jb250ZW50Pg=="
                                                          width="200"
                                                          height="10"></iframe></div>
                                                          </div>
                                                          </blockquote>
                                                          </div>
                                                          <br class="">
                                                          </div>
                                                          </div>
                                                        </div>
                                                      </div>
                                                      <br class="">
                                                      <iframe
                                                        class="content-isolator__isolated-content"
sandbox="allow-scripts" scrolling="auto"
                                                        style="border:none;display:block;overflow:auto;"
data-src="data:text/html;charset=UTF-8;base64,PGlmcmFtZS1jb250ZW50IGRhdGEtaWZyYW1lLWhlaWdodD0idHJ1ZSI+X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX188QlI+T3Ztc0RldiBtYWlsaW5nIGxpc3Q8QlI+T3Ztc0RldkBsaXN0cy5vcGVudmVoaWNsZXMuY29tPEJSPmh0dHA6Ly9saXN0cy5vcGVudmVoaWNsZXMuY29tL21haWxtYW4vbGlzdGluZm8vb3Ztc2RldjxCUj48L2lmcmFtZS1jb250ZW50Pg=="
                                                        width="200"
                                                        height="10"></iframe></div>
                                                  </div>
                                                </blockquote>
                                              </div>
                                              <br class="">
                                            </div>
                                          </div>
                                        </div>
                                      </div>
                                      <br class="">
                                      <iframe
                                        class="content-isolator__isolated-content"
                                        sandbox="allow-scripts"
                                        scrolling="auto"
                                        style="border:none;display:block;overflow:auto;"
data-src="data:text/html;charset=UTF-8;base64,PGlmcmFtZS1jb250ZW50IGRhdGEtaWZyYW1lLWhlaWdodD0idHJ1ZSI+X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX188QlI+T3Ztc0RldiBtYWlsaW5nIGxpc3Q8QlI+T3Ztc0RldkBsaXN0cy5vcGVudmVoaWNsZXMuY29tPEJSPmh0dHA6Ly9saXN0cy5vcGVudmVoaWNsZXMuY29tL21haWxtYW4vbGlzdGluZm8vb3Ztc2RldjxCUj48L2lmcmFtZS1jb250ZW50Pg=="
                                        width="200" height="10"></iframe></div>
                                  </div>
                                </blockquote>
                              </div>
                              <br class="">
                            </div>
                          </div>
                          <br class="">
                          <fieldset class="mimeAttachmentHeader"></fieldset>
                          <pre class="moz-quote-pre" wrap="">_______________________________________________
OvmsDev mailing list
<a class="moz-txt-link-abbreviated" href="mailto:OvmsDev@lists.openvehicles.com" moz-do-not-send="true">OvmsDev@lists.openvehicles.com</a>
<a class="moz-txt-link-freetext" href="http://lists.openvehicles.com/mailman/listinfo/ovmsdev" moz-do-not-send="true">http://lists.openvehicles.com/mailman/listinfo/ovmsdev</a>
</pre>
                        </blockquote>
                        <br class="">
                        <pre class="moz-signature" cols="72">-- 
Michael Balzer * Helkenberger Weg 9 * D-58256 Ennepetal
Fon 02333 / 833 5735 * Handy 0176 / 206 989 26</pre>
                      </div>
                    </div>
                  </div>
                  <br class="">
                  <iframe class="content-isolator__isolated-content"
                    sandbox="allow-scripts" scrolling="auto"
                    style="border:none;display:block;overflow:auto;"
data-src="data:text/html;charset=UTF-8;base64,PGlmcmFtZS1jb250ZW50IGRhdGEtaWZyYW1lLWhlaWdodD0idHJ1ZSI+X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX188QlI+T3Ztc0RldiBtYWlsaW5nIGxpc3Q8QlI+T3Ztc0RldkBsaXN0cy5vcGVudmVoaWNsZXMuY29tPEJSPmh0dHA6Ly9saXN0cy5vcGVudmVoaWNsZXMuY29tL21haWxtYW4vbGlzdGluZm8vb3Ztc2RldjxCUj48L2lmcmFtZS1jb250ZW50Pg=="
                    width="200" height="10"></iframe></div>
              </div>
            </blockquote>
          </div>
          <br class="">
        </div>
      </div>
      <br>
      <fieldset class="mimeAttachmentHeader"></fieldset>
      <pre class="moz-quote-pre" wrap="">_______________________________________________
OvmsDev mailing list
<a class="moz-txt-link-abbreviated" href="mailto:OvmsDev@lists.openvehicles.com">OvmsDev@lists.openvehicles.com</a>
<a class="moz-txt-link-freetext" href="http://lists.openvehicles.com/mailman/listinfo/ovmsdev">http://lists.openvehicles.com/mailman/listinfo/ovmsdev</a>
</pre>
    </blockquote>
    <br>
    <pre class="moz-signature" cols="72">-- 
Michael Balzer * Helkenberger Weg 9 * D-58256 Ennepetal
Fon 02333 / 833 5735 * Handy 0176 / 206 989 26</pre>
  </body>
</html>