April 2018 - OvmsDev - Open Vehicles

Firmware updates, EU server
by Michael Balzer 30 Apr '18

30 Apr '18

It seems users are not aware they should do a firmware update ASAP after receiving the module. I have advised the german users to do so, maybe we should add that to the manual as well. I now provide the following URLs for firmware updates on my server: * The latest official release: o ovms.dexters-web.de/f/v3.1/release.bin * My latest build: o ovms.dexters-web.de/f/v3.1/current.bin o …with git log since release at: https://ovms.dexters-web.de/f/v3.1/current.log Regards, Michael -- Michael Balzer * Helkenberger Weg 9 * D-58256 Ennepetal Fon 02333 / 833 5735 * Handy 0176 / 206 989 26

1 1

Mongoose update
by Michael Balzer 29 Apr '18

29 Apr '18

Netmanager/Mongoose: use interface specific DNS servers Note: *mongoose update involved*, issue "*git submodule update*". This switches mongoose to use LWIP getaddrinfo() as it is superior to the mongoose resolver. Netmanager then stores DNS servers acquired by connections and restores them accordingly as the default interface changes. Should solve issue #43 <https://github.com/openvehicles/Open-Vehicle-Monitoring-System-3/issues/43>. Regards, Michael -- Michael Balzer * Helkenberger Weg 9 * D-58256 Ennepetal Fon 02333 / 833 5735 * Handy 0176 / 206 989 26

1 1

Re: [Ovmsdev] PCAP CAN bus dump
by Tom Parker 28 Apr '18

28 Apr '18

https://carrott.org/pcaps/ These were captured with tcpdump and an USB can interface with slcan driver. I post processed them to byte swap the can ID with https://carrott.org/git/leaf-can-dissector.git/blob/HEAD:/pcap-canid-endian… I don't know why tcpdump and wireshark disagree on the byte order of the can id. On Apr 27, 2018 5:24 PM, Mark Webb-Johnson <mark(a)webb-johnson.net> wrote: > > > Has anybody got an example of a PCAP format canbus dump file? Some dump from a car in a suitable format for loading into wireshark (pcap not pcapng). > > If so, please eMail to me (mark(a)webb-johnson.net) or give me a link to where I can download from. > > I need it to verify that OVMS can read/write to that format. > > Thanks, Mark. >

3 5

PCAP CAN bus dump
by Mark Webb-Johnson 27 Apr '18

27 Apr '18

Has anybody got an example of a PCAP format canbus dump file? Some dump from a car in a suitable format for loading into wireshark (pcap not pcapng). If so, please eMail to me (mark(a)webb-johnson.net <mailto:mark@webb-johnson.net>) or give me a link to where I can download from. I need it to verify that OVMS can read/write to that format. Thanks, Mark.

1 0

Memory leak
by Michael Balzer 26 Apr '18

26 Apr '18

There seems to be a memory leak, after running the module over the past hours in my car, ssh couldn't allocate 4K for a new session and I had this status: OVMS > mo m Free 8-bit *14600*/281968, 32-bit 8052/24308, SPIRAM 4129588/4194252 --Task-- Total DRAM D/IRAM IRAM SPIRAM +/- DRAM D/IRAM IRAM SPIRAM no task* 5348 0 0 0 +5348 +0 +0 +0 main* 18084 0 0 0 +18084 +0 +0 +0 esp_timer 39268 0 644 23436 +39268 +0 +644 +23436 OVMS Events 53304 65064 0 10076 +53304 +65064 +0 +10076 ipc0 7776 0 0 0 +7776 +0 +0 +0 ipc1 12 0 0 0 +12 +0 +0 +0 tiT 232 908 0 6376 +232 +908 +0 +6376 OVMS SIMCOM 0 4512 0 0 +0 +4512 +0 +0 wifi 1464 64 0 3512 +1464 +64 +0 +3512 OVMS Console 0 20 0 0 +0 +20 +0 +0 OVMS NetMan 0 12688 0 68 +0 +12688 +0 +68 mo m 0 0 15488 12000 +0 +0 +15488 +12000 OVMS > mo t Number of Tasks = 20 Stack: Now Max Total Heap 32-bit SPIRAM 3FFAFB48 1 Blk esp_timer 388 644 4096 39268 644 23436 3FFBDE54 2 Blk eventTask 448 1328 4608 0 0 0 3FFBFC50 3 Blk OVMS Events 444 3932 6144 118368 0 10076 3FFC4974 4 Blk OVMS CanRx 432 544 1024 0 0 0 3FFC9090 5 Blk ipc0 396 444 1024 7776 0 0 3FFC9690 6 Blk ipc1 396 444 1024 12 0 0 3FFCB4B8 9 Rdy IDLE 356 484 1024 0 0 0 3FFCBA4C 10 Rdy IDLE 360 488 1024 0 0 0 3FFCC7E0 11 Blk Tmr Svc 396 1820 3072 0 0 0 3FFC98FC 16 Blk tiT 496 2272 3072 1136 0 6576 3FFD7540 17 Blk OVMS SIMCOM 460 3020 4096 4512 0 0 3FFD951C 18 Blk wifi 424 2168 4096 1528 0 3512 3FFDBCB4 19 Blk pmT 416 576 2560 0 0 0 3FFDDABC 20 Blk OVMS Vehicle 456 2008 3072 0 0 0 3FFDFE38 21 Blk OVMS COrx 452 580 3072 0 0 0 3FFE1C88 22 Blk OVMS COwrk 532 532 1536 0 0 0 3FFE3E78 23 Blk OVMS Console 548 1716 6144 20 0 0 3FFE9430 24 Blk OVMS NetMan 732 5980 7168 12692 0 68 3FFEA9C8 25 Blk mdns 404 1724 4096 0 0 0 3FFFCD14 36 Rdy mo t 704 1936 5120 72 0 0 Nothing special to see. +14k on the events task vs. a fresh boot, but nothing that can explain the loss of more than 40k. Odd, I'll watch this. Regards, Michael -- Michael Balzer * Helkenberger Weg 9 * D-58256 Ennepetal Fon 02333 / 833 5735 * Handy 0176 / 206 989 26

3 24

Lessons learnt, production batch #2 and onwards
by Mark Webb-Johnson 24 Apr '18

24 Apr '18

Well, it has been an interesting few weeks as the first production batch of OVMS v3 came online. I don’t know about for others helping out with support tickets, but I’ve sure learned a lot - especially about what can go wrong for inexperienced users trying to setup a complex product. 14 support tickets were opened, along with another perhaps 6 calls for help via other means, and here are the most common problems encountered: Switched from Access Point mode to Client mode, and lost access. Can’t get into module via USB (drivers seem ok, but terminal emulators, and baud rates, are beyond most people’s understanding). Too hard for most to do a factory reset. Can’t see modem ICCID when powered off. Modem powered off by default, unless the little tick box is clicked. Server v2 off by default, unless the little tick box is clicked. Upper vs lower case on command execution. Unable to do firmware update in Access Point mode. Password confusion (wifi client vs module vs server vehicle vs server account vs access point vs OVMSinit vs etc etc). wifi vs modem switches and DNS settings. Modem SIM registration issues (can’t see, or don’t know how to see, status of simcom). Don’t understand how to check status. While some of these issues have been addressed, I am reluctant to release a new batch of modules to the world, especially this time with less technically capable users coming online. It is probably not ‘fun’ work, but I think we can make this much simpler for new users. We can lead them through the setup in the following stages: Require, as a pre-requisite, users to initially setup the module within range of a home wifi / cellular hotspot connection. Factory default, use Access Point mode, SSID OVMS password “OVMSinit”, and no module password. Have them connect to the module over wifi Access Point, and http://192.168.4.1/ <http://192.168.4.1/>. The web interface then shows them a list of WiFi access points in range, and asks them to choose one and enter the password for that access point (clearly labelled as SSID, and "<SSID> Password”). The module then reconfigures as Client + Access Point mode, and tries to connect to the client wifi, as well as keeping the access point connection open. If not ok, tell them and go back to #3 for them to try again. When ok, proceed to ask them to update the firmware. This will do a simple OTA download over HTTP, then reboot. When back up, in one screen ask them to enter all the details for their network, and configure appropriately: Use Wifi? WiFi Mode (AccessPoint+SpecificClient, or ScanningClient) OVMS Access Point SSID New OVMS Access Point password (as OVMSinit is insecure beyond initial setup) DNS (default: google, or custom) Module password (as default empty is insecure beyond initial setup) Use OVMS Server v2? Vehicle type Vehicle ID Vehicle Server password Vehicle server (openvehicles, dexter, or custom) Use modem? Modem APN, username and password (default: hologram) Test each of the above, and show them the results. Set auto appropriately, and disable quickstart then reboot. The point is to lead them through each of the steps, test each setting and show them the result. Technically, my only concern is the switch from AP to AP+client mode and whether the existing wifi connection will die or survive the channel switch. We also have to do a wifi scan, in Access Point mode, but I think we can do that by just temporarily turning off access point or doing it before the access point is brought up. Both these will depend on how ESP32 handles it. I’m happy to do a lot (if not all) of the above, but will definitely need help with the web side. But, first let’s agree on the proper list of questions to ask and flow to follow. Regards, Mark.

5 7

Getting started
by Craig Leres 23 Apr '18

23 Apr '18

Although experienced with J1850/Class 2, ovms is completely new to me. I have a friend with a V1 module in his roadster and it's great that the V3 module is finally out! I've figured out a fair amount on my own but it's probably time for me to start asking questions (and providing some feedback). I got my module up on the bench without too much trouble. The V2 and V3 server config was confusing to me since I knew almost nothing. I think I had read that V2 was legacy and V3 was where new development effort was happening so I thought that's what I wanted. But I didn't find much info on io.adafruit.com vs. ovms so I ended up configuring the V2 server for starters. My canbus car is a second generation CTS-V. Once I plugged that in I could see my car with the iphone app. But the app didn't show much (I completely understand that most work so far as been on plugin vehicles). Once I turned the car on the battery percentage starting showing how full my gas tank was. I'm still a bit confused about how GPS works. I was expecting it to use the GPS periodically but what I've found is if I don't turn on the GPS at startup, I never see location info even when I'm driving. And if I enable GPS at startup, it seems to always be on even when the car is not. Maybe this is because my car isn't supported and the module doesn't know when it's running? I also found that trying to press any of the homelink options crashes the iphone app. Initially I could not get ssh to work. This wasn't surprising since my FreeBSD desktop runs openssh 7.7p1 and I know there is a push to disable or even remove less secure and insecure crypto. But after joining the ovmsdev list the solution was revealed (create a Host block with "Ciphers aes128-cbc") so that is working for me now. I like the way ssh.keys work (mapping the remote username) but I use hard tokens with ssh it sure would be nice if you could configure more than one ssh key. When learning about how ssh works I was using the google doc (15Mar18) and it says when you login you start in non-secure mode. I find ssh always puts me in secure mode. The section about SD cards in the google doc is empty; I made assumptions and got a couple class 10 64G cards. I don't know if this is a good size or way to big to be useful. Today I brought up a mqtt server (mosquitto). In verbose mode I can see my v3 module posting things to it but I don't know what tools I can use with my server. I'd like to get a build environment up. The only info I could find was: https://github.com/openvehicles/Open-Vehicle-Monitoring-System/blob/master/… which is geared towards v2 (which I saw is pic based). What do I need to be able to build for v3? I normally work/play on FreeBSD but I have an ubuntu system handy for when I need it. I noticed lists.openvehicles.com uses http; if I try to force https I end up on a different website. Looks like apache is in use; I have a lot of experience with apache and lets encrypt ssl certs and would be happy to share the setup I use. I'm also wondering about https support for the ovms module itself. Is that on the roadmap? I know the esp32 can do it; I have done a *lot* with atmega arduino clones but have recently started using esp8266 and esp32 modules because I can network them (and with https). Craig

3 2

OT: A tool for exploring data graphically
by Stephen Casner 23 Apr '18

23 Apr '18

Another software project I've been working on recently (timesharing computer time with OVMS) is a little data graphing program named "graf" for use in X11 environments. It's one that I've used for work and personal data exploration over the past couple of decades, but recently I added several enhancements. It is quite lightweight, using only the base Xlib library and protocol, so it can display large datasets without choking. You folks may have your own favorite fancy graphing tools; this one has a somewhat different purpose than most. It is designed for data exploration more than presentation, using mouse functions to measure the distance between points or the slope of a line or calculate the least-squares regression line for a dataset or to zoom in on a section of the graph for a closer view. It takes a simple text file as input with an (x,y) pair of numbers on each line so it is easy to feed it with the output of a script, or it will accept multiple files as input to show each as a separate line on the graph. One unusual feature that was part of the recent enhancements is the ability to interpret Unix-style timestamps (based at 1970-01-01 00:00:00 GMT) as dates and times and to generate dynamic grid labels with varying temporal resolution depending upon what unit boundary the grid line represents. The motivation for varying the resolution is that to show a complete date and time down to microseconds takes too many characters to fit on each grid line. Each grid line label on the X axis shows the increment of time at the scale that allows the labels to fit, while at the left and right edges an additional label shows the remaining date and time information not included in the grid line labels. The format of the labels will vary to show a larger scale value on the even boundaries and as you zoom in the detail changes. Examples: 09/01 2014 03/01 06/01 09/01 2013 2014 22:30 23:00 23:30 04/26 00:30 01:00 2014-04-25 2014-04-26 45.000 50.000 55.000 23:56 05.000 10.000 15.000 20.000 25.000 2014-04-25 23:55: 2014-04-25 23:56: Although this varying format is not common, I think it is a pretty neat idea. In the actual graph window I use three levels of gray for the grid labels so the major boundaries are emphasized. And in local time, the DST transitions are handled properly (that was a challenge) by varying the grid spacing if needed. If you have an X11-Unix-ish environment and would like to try it out, the source is here (build it with ./configure then make): https://github.com/kernelsid/graf Or, I have MacOS and linux (CentOS) binaries here: http://casners.us/macos/graf http://casners.us/linxu/graf Try "graf -h" to see the usage text and Ctrl-H, ? or F1 in the window when running to pop up another window describing the mouse and keyboard functions. A three-button mouse or simulation thereof is needed to access the functions on the middle button. I've attached two data files that you could try along with a third that you could download since it is bigger than I want to put in email: 1) The first graph has a bunch of data lines for all the telemetry parameters collected from my Tesla Roadster log while driving on the track at Laguna Seca in the time trial event at ReFuel 2011. 2) The second dataset contains timestamps with fractional second resolution. This produces a graph of the difference between the internal-clock-based timestamps contained in the datastream generated by the little 8-pin PIC microcontroller that I used to extract the data from the two meters on our home solar PV system and NTP-derived timestamps in the computer that collects the datastream. The latter timestamps only have a resolution of one second, hence the +/-500ms noise. This is a good dataset for testing the linear regression function. 3) The third graph shows the output of the solar PV system on our home for a period of 7 days as measured in Amps as displayed on the meters connected to the left and right strings of panels in our system. This dataset demonstrates graf's speed since it contains 1.2 million datapoints, but that means the file is 49MB so rather than attaching it to this email I have it available for download from: http://casners.us/amps.graf If you want to run graf with these datasets, I suggest invoking it with "graf -Lmt" plus the dataset filename to select the X axis date display in local time and to show a small icon at each datapoint. I usually also include -t because I prefer just tickmarks rather than full grid lines most of the time. I also attached a screenshot of the first graph so you can at least see a static image if you don't want to try to run the program. -- Steve

1 1

T down
by Mark Webb-Johnson 22 Apr '18

22 Apr '18

1 0

Please update mongoose submodule
by Stephen Casner 20 Apr '18

20 Apr '18

I have changed the mongoose mg_send() function to return the number of bytes appended or zero if buffer allocation fails. The code in console_ssh now depends upon this to avoid corrupting the ssh packet stream if the system runs low on free memory. Thus, if you update the the latest OVMS master branch, please remember to "git submodule update" as well. -- Steve

1 0