[Ovmsdev] OVMS going comatose

Mon Mar 29 01:52:32 HKT 2021

Michael,

Thanks for that info.  I think I should build again with the
configuration changed to not drop into the gdb stub since I'm not
actively using that for debugging.  Then if the problem is a panic or
other crash and I'm just not able to get any response because gdb gets
stuck somehow at least OVMS will recover.  Maybe if the server gets a
useful crash report we'll learn something.

BTW, I did also get a WDT error after resetting on the previous lockup
(before file logging), and after the reset this time there was a hang
that did not last long enough to trigget the WDT.  Log segment below.

                                                        -- Steve

2021-03-27 15:39:20.750 PDT I (15000) ovms-server-v2: Send MP-0 S55.0,M,65535,0.00,done,standard,120,118,32,0,0,290,7,4,0,0,0,0,0.00,0,0,0,0,0,0,0,0,0,0,0,0,0.00,0.00,0,0.00,0.00
2021-03-27 15:39:20.750 PDT I (15000) ovms-server-v2: Send MP-0 D65,128,5,39,59,38,1341,615196,0,14,31,2,1,1,12.91,0,12.6,32,39,0,0
2021-03-27 15:39:20.770 PDT I (15020) ovms-server-v2: Send MP-0 L37.346294,-122.037178,77,71,1,1,0.0,1341,0,0.387,0,0,0,0,,0,0,0
2021-03-27 15:39:20.770 PDT I (15020) ovms-server-v2: Send MP-0 Y4,FL,FR,RL,RR,0,-1,0,-1,0,-1,0,-1
2021-03-27 15:39:20.770 PDT I (15020) ovms-server-v2: Send MP-0 W0,0,0,0,0,0,0,0,-1
2021-03-27 15:39:20.770 PDT I (15020) ovms-server-v2: Send MP-0 F3.2.016-49-gb10a3583/ota_1/main (build idf v3.3.4-845-gd59ed8bba-dirty Mar 21 2021 10:57:09),5YJRE11B181000033,28,1,TR1N,Revelstoke,-1,-1
2021-03-27 15:39:20.780 PDT I (15030) ovms-server-v2: Send MP-0 PINot charging|SOC: -
2021-03-27 15:39:37.740 PDT I (31990) simcom: State timeout, transition to 2
2021-03-27 15:39:37.740 PDT I (31990) simcom: State: Enter PoweringOn state
2021-03-27 15:39:37.740 PDT I (31990) simcom: Power Cycle
2021-03-27 15:39:38.410 PDT W (32660) websocket: WebSocketHandler[0x3f84b22c]: job queue overflow detected
2021-03-27 15:39:38.420 PDT I (32670) webserver: HTTP GET /cfg/logging
2021-03-27 15:39:40.570 PDT W (34820) websocket: WebSocketHandler[0x3f84b22c]: job queue overflow detected
2021-03-27 15:39:42.690 PDT W (36940) websocket: WebSocketHandler[0x3f84b22c]: job queue overflow detected
2021-03-27 15:39:44.650 PDT I (38900) simcom: State: Enter PoweredOn state
2021-03-27 15:39:46.970 PDT W (41220) websocket: WebSocketHandler[0x3f84b22c]: job queue overflow detected
2021-03-27 15:39:49.170 PDT W (43420) websocket: WebSocketHandler[0x3f84b22c]: job queue overflow detected
2021-03-27 15:39:49.180 PDT W (43430) websocket: WebSocketHandler[0x3f84b22c]: job queue overflow resolved, 72 drops
2021-03-27 15:39:51.310 PDT W (45560) websocket: WebSocketHandler[0x3f84b22c]: job queue overflow detected
2021-03-27 15:39:51.320 PDT W (45570) websocket: WebSocketHandler[0x3f84b22c]: job queue overflow resolved, 8 drops
2021-03-27 15:39:53.490 PDT W (47740) websocket: WebSocketHandler[0x3f84b22c]: job queue overflow detected
2021-03-27 15:39:53.500 PDT W (47750) websocket: WebSocketHandler[0x3f84b22c]: job queue overflow resolved, 7 drops
2021-03-27 15:39:54.740 PDT W (48990) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:39:55.620 PDT W (49870) websocket: WebSocketHandler[0x3f84b22c]: job queue overflow detected
2021-03-27 15:39:55.630 PDT W (49880) websocket: WebSocketHandler[0x3f84b22c]: job queue overflow resolved, 9 drops
2021-03-27 15:39:55.740 PDT W (49990) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:39:56.740 PDT W (50990) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:39:56.740 PDT W (50990) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:39:57.680 PDT W (51930) websocket: WebSocketHandler[0x3f84b22c]: job queue overflow detected
2021-03-27 15:39:57.690 PDT W (51940) websocket: WebSocketHandler[0x3f84b22c]: job queue overflow resolved, 11 drops
2021-03-27 15:39:57.740 PDT W (51990) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:39:58.740 PDT W (52990) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:39:59.740 PDT W (53990) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:39:59.800 PDT W (54050) websocket: WebSocketHandler[0x3f84b22c]: job queue overflow resolved, 11 drops
2021-03-27 15:39:59.810 PDT W (54060) websocket: WebSocketHandler[0x3f84b22c]: job queue overflow detected
2021-03-27 15:40:00.740 PDT W (54990) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:40:00.750 PDT W (55000) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:40:01.740 PDT W (55990) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:40:01.890 PDT W (56140) websocket: WebSocketHandler[0x3f84b22c]: job queue overflow detected
2021-03-27 15:40:01.900 PDT W (56150) websocket: WebSocketHandler[0x3f84b22c]: job queue overflow resolved, 12 drops
2021-03-27 15:40:02.740 PDT W (56990) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:40:03.740 PDT W (57990) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:40:03.740 PDT I (57990) simcom: State: Enter MuxStart state
2021-03-27 15:40:03.750 PDT I (58000) gsm-mux: Start MUX
2021-03-27 15:40:03.750 PDT W (58000) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:40:03.750 PDT I (58000) gsm-mux: Channel #0 is open
2021-03-27 15:40:03.760 PDT I (58010) gsm-mux: Channel #1 is open
2021-03-27 15:40:03.770 PDT I (58020) gsm-mux: Channel #2 is open
2021-03-27 15:40:03.770 PDT I (58020) gsm-mux: Channel #3 is open
2021-03-27 15:40:03.780 PDT I (58030) gsm-mux: Channel #4 is open
2021-03-27 15:40:03.970 PDT W (58220) websocket: WebSocketHandler[0x3f84b22c]: job queue overflow detected
2021-03-27 15:40:03.990 PDT W (58240) websocket: WebSocketHandler[0x3f84b22c]: job queue overflow resolved, 18 drops
2021-03-27 15:40:04.740 PDT I (58990) simcom: State: Enter NetWait state
2021-03-27 15:40:04.740 PDT W (58990) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:40:04.750 PDT W (59000) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:40:05.740 PDT W (59990) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:40:06.100 PDT W (60350) websocket: WebSocketHandler[0x3f84b22c]: job queue overflow detected
2021-03-27 15:40:06.120 PDT W (60370) websocket: WebSocketHandler[0x3f84b22c]: job queue overflow resolved, 13 drops
2021-03-27 15:40:08.230 PDT I (62480) webserver: HTTP POST /cfg/logging
2021-03-27 15:40:08.230 PDT W (62480) webserver: HandleLogin: auth failure for username 'admin'
2021-03-27 15:40:08.240 PDT W (62490) websocket: WebSocketHandler[0x3f84b22c]: job queue overflow detected
2021-03-27 15:40:08.260 PDT W (62510) websocket: WebSocketHandler[0x3f84b22c]: job queue overflow resolved, 7 drops
2021-03-27 15:40:10.300 PDT W (64550) websocket: WebSocketHandler[0x3f84b22c]: job queue overflow detected
2021-03-27 15:40:12.420 PDT W (66670) websocket: WebSocketHandler[0x3f84b22c]: job queue overflow detected
2021-03-27 15:40:12.440 PDT W (66690) websocket: WebSocketHandler[0x3f84b22c]: job queue overflow resolved, 17 drops
2021-03-27 15:40:14.510 PDT W (68760) websocket: WebSocketHandler[0x3f84b22c]: job queue overflow detected
2021-03-27 15:40:14.520 PDT W (68770) websocket: WebSocketHandler[0x3f84b22c]: job queue overflow resolved, 7 drops
2021-03-27 15:40:16.630 PDT I (70880) webserver: HTTP POST /cfg/logging
2021-03-27 15:40:16.640 PDT I (70890) webserver: HandleLogin: 'admin' logged in, sid 847393266b07789
2021-03-27 15:40:16.650 PDT W (70900) websocket: WebSocketHandler[0x3f84b22c]: job queue overflow detected
2021-03-27 15:40:18.810 PDT W (73060) websocket: WebSocketHandler[0x3f84b22c]: job queue overflow detected
2021-03-27 15:40:20.820 PDT I (75070) webserver: HTTP GET /menu
2021-03-27 15:40:20.850 PDT W (75100) websocket: WebSocketHandler[0x3f84b22c]: job queue overflow detected
2021-03-27 15:40:20.860 PDT I (75110) webserver: HTTP GET /cfg/logging
2021-03-27 15:40:33.650 PDT W (87900) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:40:33.660 PDT W (87910) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:40:33.660 PDT W (87910) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:40:33.660 PDT W (87910) script: DuktapeDispatch: msg type 2 lost, queue full
2021-03-27 15:40:33.670 PDT W (87920) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:40:33.670 PDT W (87920) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:40:33.680 PDT W (87930) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:40:33.690 PDT W (87940) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:40:33.690 PDT W (87940) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:40:33.700 PDT W (87950) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:40:33.710 PDT W (87960) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:40:33.710 PDT W (87960) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:40:33.720 PDT W (87970) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:40:33.720 PDT W (87970) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:40:33.730 PDT W (87980) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:40:33.730 PDT I (87980) simcom: CREG Network Registration: RegisteredRoaming
2021-03-27 15:40:33.740 PDT W (87990) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:40:33.740 PDT I (87990) simcom: State: Enter NetStart state
2021-03-27 15:40:33.750 PDT W (88000) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:40:33.750 PDT W (88000) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:40:33.760 PDT W (88010) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:40:33.770 PDT W (88020) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:40:33.770 PDT W (88020) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:40:33.780 PDT W (88030) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:40:33.780 PDT W (88030) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:40:33.790 PDT W (88040) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:40:33.790 PDT W (88040) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:40:33.800 PDT W (88050) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:40:33.800 PDT W (88050) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:40:33.810 PDT W (88060) script: DuktapeDispatch: msg type 3 lost, queue full
2021-03-27 15:40:33.810 PDT I (88060) simcom: PPP Connection is ready to start
2021-03-27 15:40:33.810 PDT I (88060) simcom: State: Enter NetMode state
2021-03-27 15:40:33.810 PDT I (88060) gsm-ppp: Initialising...
2021-03-27 15:40:36.620 PDT I (90870) gsm-ppp: StatusCallBack: None
2021-03-27 15:40:36.620 PDT I (90870) gsm-ppp: status_cb: Connected
2021-03-27 15:40:36.620 PDT I (90870) gsm-ppp:    our_ipaddr  = 10.170.41.247
2021-03-27 15:40:36.620 PDT I (90870) gsm-ppp:    his_ipaddr  = 10.64.64.64
2021-03-27 15:40:36.620 PDT I (90870) gsm-ppp:    netmask     = 255.255.255.255
2021-03-27 15:40:36.620 PDT I (90870) gsm-ppp:    DNS#0       = 212.9.0.135
2021-03-27 15:40:36.620 PDT I (90870) gsm-ppp:    DNS#1       = 212.9.0.136
2021-03-27 15:40:36.620 PDT I (90870) gsm-ppp:    our6_ipaddr = ::
2021-03-27 15:40:36.630 PDT I (90880) netmanager: MODEM up (with WIFI client up): staying with WIFI client priority
2021-03-27 15:41:15.890 PDT I (130140) webserver: HTTP GET /status
2021-03-27 15:41:41.690 PDT I (155940) ovms-server-v2: Incoming Msg: MP-0 Z1
2021-03-27 15:41:41.690 PDT I (155940) ovms-server-v2: One or more peers have connected
2021-03-27 15:41:41.740 PDT I (155990) ovms-server-v2: Send MP-0 S55.0,M,65535,0.00,done,standard,120,118,32,0,0,290,7,4,0,0,0,0,0.00,0,0,0,0,0,0,0,0,0,0,0,0,0.00,0.00,0,0.00,0.00
2021-03-27 15:41:41.750 PDT I (156000) ovms-server-v2: Send MP-0 D65,128,5,39,59,38,1341,615196,0,155,31,2,1,1,12.88,0,12.6,32,39,0,0
2021-03-27 15:41:41.760 PDT I (156010) ovms-server-v2: Send MP-0 L37.346313,-122.037216,77,87,1,1,0.0,1341,0,0.000,0,0,0,0,,0,0,0
2021-03-27 15:41:41.760 PDT I (156010) ovms-server-v2: Send MP-0 Y4,FL,FR,RL,RR,0,-1,0,-1,0,-1,0,-1
2021-03-27 15:41:41.760 PDT I (156010) ovms-server-v2: Send MP-0 W0,0,0,0,0,0,0,0,-1
2021-03-27 15:41:41.760 PDT I (156010) ovms-server-v2: Send MP-0 F3.2.016-49-gb10a3583/ota_1/main (build idf v3.3.4-845-gd59ed8bba-dirty Mar 21 2021 10:57:09),5YJRE11B181000033,28,1,TR1N,Revelstoke,-1,-1
2021-03-27 15:41:47.740 PDT I (161990) ovms-server-v2: Send MP-0 L37.346313,-122.037216,77,87,0,1,0.0,1341,0,0.000,0,0,0,0,,0,0,0