I want to create log file from can messages while Lexia connected to obd, but many message has dropped. My sd card is too slow to write all data? I start logging with can log crtd /sd/lexia.crtd command Closing log: Type:crtd; Path:'/sd/lexia.crtd'; Filter:off; Vehicle:MI; Statistics: total messages: 3334194, dropped: 2707476 = 81.2% In can log i can see the incoming messages? This is a RX message: 175594.785 1R11 346 27 10 40 00 00 00 00 42 if 1R11 is 1T11 this is a TX message on CAN1? How can i download the log file, the easiest way, because if i use browser and add the file url (ip/lexia.crtd) the browser load its content.
Tamás, Yes, it seems SD CARD is too slow. Can you check ‘config list sdcard’ and see if you have a ‘maxfreq.khz’ value set? The default is 16000. If you have a reasonably modern OVMS module, or are running from USB power (even if 12v is connected as well), you can set: config set sdcard maxfreq.khz 20000 and reboot, to improve the SD CARD write speed. The 1R11 means reception of a 11bit (standard) CAN message on CAN1 bus. A 1T11 would mean transmission. I think you should be able to download via the browser - personally, I just scp the files off the module over wifi. Regards, Mark.
On 15 Jun 2019, at 1:58 AM, Tamás Kovács <kommykt@gmail.com> wrote:
I want to create log file from can messages while Lexia connected to obd, but many message has dropped. My sd card is too slow to write all data?
I start logging with can log crtd /sd/lexia.crtd command
Closing log: Type:crtd; Path:'/sd/lexia.crtd'; Filter:off; Vehicle:MI; Statistics: total messages: 3334194, dropped: 2707476 = 81.2%
In can log i can see the incoming messages? This is a RX message: 175594.785 1R11 346 27 10 40 00 00 00 00 42 if 1R11 is 1T11 this is a TX message on CAN1? How can i download the log file, the easiest way, because if i use browser and add the file url (ip/lexia.crtd) the browser load its content.
_______________________________________________ OvmsDev mailing list OvmsDev@lists.openvehicles.com http://lists.openvehicles.com/mailman/listinfo/ovmsdev
Now i remove the SD card in my Mac the speed is 10MB/s / 80MB /s (W/R). I have a 1.5 year old modell with the following numbers (2018020219PTWU) If run ‘config list sdcard’ only show 'sdcard (readable writeable)' if i run 'config set sdcard maxfreq.khz 16000' now show this value for ‘config list sdcard’. For download, if i copy the log to another folder than sd root, i can browse the folder tree, and download directly. Mark Webb-Johnson <mark@webb-johnson.net> ezt írta (időpont: 2019. jún. 18., K, 2:14):
Tamás,
Yes, it seems SD CARD is too slow.
Can you check ‘config list sdcard’ and see if you have a ‘maxfreq.khz’ value set? The default is 16000.
If you have a reasonably modern OVMS module, or are running from USB power (even if 12v is connected as well), you can set:
config set sdcard maxfreq.khz 20000
and reboot, to improve the SD CARD write speed.
The 1R11 means reception of a 11bit (standard) CAN message on CAN1 bus. A 1T11 would mean transmission. I think you should be able to download via the browser - personally, I just scp the files off the module over wifi.
Regards, Mark.
On 15 Jun 2019, at 1:58 AM, Tamás Kovács <kommykt@gmail.com> wrote:
I want to create log file from can messages while Lexia connected to obd, but many message has dropped. My sd card is too slow to write all data?
I start logging with can log crtd /sd/lexia.crtd command
Closing log: Type:crtd; Path:'/sd/lexia.crtd'; Filter:off; Vehicle:MI;
Statistics: total messages: 3334194, dropped: 2707476 = 81.2%
In can log i can see the incoming messages?
This is a RX message:
175594.785 1R11 346 27 10 40 00 00 00 00 42
if 1R11 is 1T11 this is a TX message on CAN1?
How can i download the log file, the easiest way, because if i use browser and add the file url (ip/lexia.crtd) the browser load its content.
_______________________________________________ OvmsDev mailing list OvmsDev@lists.openvehicles.com http://lists.openvehicles.com/mailman/listinfo/ovmsdev
_______________________________________________ OvmsDev mailing list OvmsDev@lists.openvehicles.com http://lists.openvehicles.com/mailman/listinfo/ovmsdev
-- Üdvözlettel: Kovács Tamás
The Mac processor and I/O is a little bit faster than the little esp32. You can try to set to 20000 then reboot. Should be about 5 times faster than default. But if running old hardware without 5v usb connected, then may crash. Recent modules, or when you have USB connected, can operate at high speed. Regards, Mark
On 18 Jun 2019, at 11:56 AM, Tamás Kovács <kommykt@gmail.com> wrote:
Now i remove the SD card in my Mac the speed is 10MB/s / 80MB /s (W/R). I have a 1.5 year old modell with the following numbers (2018020219PTWU) If run ‘config list sdcard’ only show 'sdcard (readable writeable)' if i run 'config set sdcard maxfreq.khz 16000' now show this value for ‘config list sdcard’.
For download, if i copy the log to another folder than sd root, i can browse the folder tree, and download directly.
Mark Webb-Johnson <mark@webb-johnson.net <mailto:mark@webb-johnson.net>> ezt írta (időpont: 2019. jún. 18., K, 2:14): Tamás,
Yes, it seems SD CARD is too slow.
Can you check ‘config list sdcard’ and see if you have a ‘maxfreq.khz’ value set? The default is 16000.
If you have a reasonably modern OVMS module, or are running from USB power (even if 12v is connected as well), you can set:
config set sdcard maxfreq.khz 20000
and reboot, to improve the SD CARD write speed.
The 1R11 means reception of a 11bit (standard) CAN message on CAN1 bus. A 1T11 would mean transmission. I think you should be able to download via the browser - personally, I just scp the files off the module over wifi.
Regards, Mark.
On 15 Jun 2019, at 1:58 AM, Tamás Kovács <kommykt@gmail.com <mailto:kommykt@gmail.com>> wrote:
I want to create log file from can messages while Lexia connected to obd, but many message has dropped. My sd card is too slow to write all data?
I start logging with can log crtd /sd/lexia.crtd command
Closing log: Type:crtd; Path:'/sd/lexia.crtd'; Filter:off; Vehicle:MI; Statistics: total messages: 3334194, dropped: 2707476 = 81.2%
In can log i can see the incoming messages? This is a RX message: 175594.785 1R11 346 27 10 40 00 00 00 00 42 if 1R11 is 1T11 this is a TX message on CAN1? How can i download the log file, the easiest way, because if i use browser and add the file url (ip/lexia.crtd) the browser load its content.
_______________________________________________ OvmsDev mailing list OvmsDev@lists.openvehicles.com <mailto:OvmsDev@lists.openvehicles.com> http://lists.openvehicles.com/mailman/listinfo/ovmsdev <http://lists.openvehicles.com/mailman/listinfo/ovmsdev>
_______________________________________________ OvmsDev mailing list OvmsDev@lists.openvehicles.com <mailto:OvmsDev@lists.openvehicles.com> http://lists.openvehicles.com/mailman/listinfo/ovmsdev <http://lists.openvehicles.com/mailman/listinfo/ovmsdev>
-- Üdvözlettel: Kovács Tamás
_______________________________________________ OvmsDev mailing list OvmsDev@lists.openvehicles.com http://lists.openvehicles.com/mailman/listinfo/ovmsdev
Now set 20000, and now the dropped package about 25%. Mark Webb-Johnson <mark@webb-johnson.net> ezt írta (időpont: 2019. jún. 18., K, 7:14):
The Mac processor and I/O is a little bit faster than the little esp32.
You can try to set to 20000 then reboot. Should be about 5 times faster than default. But if running old hardware without 5v usb connected, then may crash. Recent modules, or when you have USB connected, can operate at high speed.
Regards, Mark
On 18 Jun 2019, at 11:56 AM, Tamás Kovács <kommykt@gmail.com> wrote:
Now i remove the SD card in my Mac the speed is 10MB/s / 80MB /s (W/R). I have a 1.5 year old modell with the following numbers (2018020219PTWU) If run ‘config list sdcard’ only show 'sdcard (readable writeable)' if i run 'config set sdcard maxfreq.khz 16000' now show this value for ‘config list sdcard’.
For download, if i copy the log to another folder than sd root, i can browse the folder tree, and download directly.
Mark Webb-Johnson <mark@webb-johnson.net> ezt írta (időpont: 2019. jún. 18., K, 2:14):
Tamás,
Yes, it seems SD CARD is too slow.
Can you check ‘config list sdcard’ and see if you have a ‘maxfreq.khz’ value set? The default is 16000.
If you have a reasonably modern OVMS module, or are running from USB power (even if 12v is connected as well), you can set:
config set sdcard maxfreq.khz 20000
and reboot, to improve the SD CARD write speed.
The 1R11 means reception of a 11bit (standard) CAN message on CAN1 bus. A 1T11 would mean transmission. I think you should be able to download via the browser - personally, I just scp the files off the module over wifi.
Regards, Mark.
On 15 Jun 2019, at 1:58 AM, Tamás Kovács <kommykt@gmail.com> wrote:
I want to create log file from can messages while Lexia connected to obd, but many message has dropped. My sd card is too slow to write all data?
I start logging with can log crtd /sd/lexia.crtd command
Closing log: Type:crtd; Path:'/sd/lexia.crtd'; Filter:off; Vehicle:MI;
Statistics: total messages: 3334194, dropped: 2707476 = 81.2%
In can log i can see the incoming messages?
This is a RX message:
175594.785 1R11 346 27 10 40 00 00 00 00 42
if 1R11 is 1T11 this is a TX message on CAN1?
How can i download the log file, the easiest way, because if i use browser and add the file url (ip/lexia.crtd) the browser load its content.
_______________________________________________ OvmsDev mailing list OvmsDev@lists.openvehicles.com http://lists.openvehicles.com/mailman/listinfo/ovmsdev
_______________________________________________ OvmsDev mailing list OvmsDev@lists.openvehicles.com http://lists.openvehicles.com/mailman/listinfo/ovmsdev
-- Üdvözlettel: Kovács Tamás
_______________________________________________ OvmsDev mailing list OvmsDev@lists.openvehicles.com http://lists.openvehicles.com/mailman/listinfo/ovmsdev
_______________________________________________ OvmsDev mailing list OvmsDev@lists.openvehicles.com http://lists.openvehicles.com/mailman/listinfo/ovmsdev
-- Üdvözlettel: Kovács Tamás
25% is better than 81.2% :-) Sounds like the SD CARD just can’t keep up with logging volume. You could try to use RETOOLS ’serve’ mode to log over wifi. Alternatively, the new code I just committed can log in pcap mode, which may be less cpu intensive (as crtd is a textual format), but won’t do anything for SD speed. Regards, Mark.
On 19 Jun 2019, at 12:23 PM, Tamás Kovács <kommykt@gmail.com> wrote:
Now set 20000, and now the dropped package about 25%.
Mark Webb-Johnson <mark@webb-johnson.net <mailto:mark@webb-johnson.net>> ezt írta (időpont: 2019. jún. 18., K, 7:14): The Mac processor and I/O is a little bit faster than the little esp32.
You can try to set to 20000 then reboot. Should be about 5 times faster than default. But if running old hardware without 5v usb connected, then may crash. Recent modules, or when you have USB connected, can operate at high speed.
Regards, Mark
On 18 Jun 2019, at 11:56 AM, Tamás Kovács <kommykt@gmail.com <mailto:kommykt@gmail.com>> wrote:
Now i remove the SD card in my Mac the speed is 10MB/s / 80MB /s (W/R). I have a 1.5 year old modell with the following numbers (2018020219PTWU) If run ‘config list sdcard’ only show 'sdcard (readable writeable)' if i run 'config set sdcard maxfreq.khz 16000' now show this value for ‘config list sdcard’.
For download, if i copy the log to another folder than sd root, i can browse the folder tree, and download directly.
Mark Webb-Johnson <mark@webb-johnson.net <mailto:mark@webb-johnson.net>> ezt írta (időpont: 2019. jún. 18., K, 2:14): Tamás,
Yes, it seems SD CARD is too slow.
Can you check ‘config list sdcard’ and see if you have a ‘maxfreq.khz’ value set? The default is 16000.
If you have a reasonably modern OVMS module, or are running from USB power (even if 12v is connected as well), you can set:
config set sdcard maxfreq.khz 20000
and reboot, to improve the SD CARD write speed.
The 1R11 means reception of a 11bit (standard) CAN message on CAN1 bus. A 1T11 would mean transmission. I think you should be able to download via the browser - personally, I just scp the files off the module over wifi.
Regards, Mark.
On 15 Jun 2019, at 1:58 AM, Tamás Kovács <kommykt@gmail.com <mailto:kommykt@gmail.com>> wrote:
I want to create log file from can messages while Lexia connected to obd, but many message has dropped. My sd card is too slow to write all data?
I start logging with can log crtd /sd/lexia.crtd command
Closing log: Type:crtd; Path:'/sd/lexia.crtd'; Filter:off; Vehicle:MI; Statistics: total messages: 3334194, dropped: 2707476 = 81.2%
In can log i can see the incoming messages? This is a RX message: 175594.785 1R11 346 27 10 40 00 00 00 00 42 if 1R11 is 1T11 this is a TX message on CAN1? How can i download the log file, the easiest way, because if i use browser and add the file url (ip/lexia.crtd) the browser load its content.
_______________________________________________ OvmsDev mailing list OvmsDev@lists.openvehicles.com <mailto:OvmsDev@lists.openvehicles.com> http://lists.openvehicles.com/mailman/listinfo/ovmsdev <http://lists.openvehicles.com/mailman/listinfo/ovmsdev>
_______________________________________________ OvmsDev mailing list OvmsDev@lists.openvehicles.com <mailto:OvmsDev@lists.openvehicles.com> http://lists.openvehicles.com/mailman/listinfo/ovmsdev <http://lists.openvehicles.com/mailman/listinfo/ovmsdev>
-- Üdvözlettel: Kovács Tamás
_______________________________________________ OvmsDev mailing list OvmsDev@lists.openvehicles.com <mailto:OvmsDev@lists.openvehicles.com> http://lists.openvehicles.com/mailman/listinfo/ovmsdev <http://lists.openvehicles.com/mailman/listinfo/ovmsdev>
_______________________________________________ OvmsDev mailing list OvmsDev@lists.openvehicles.com <mailto:OvmsDev@lists.openvehicles.com> http://lists.openvehicles.com/mailman/listinfo/ovmsdev <http://lists.openvehicles.com/mailman/listinfo/ovmsdev>
-- Üdvözlettel: Kovács Tamás
_______________________________________________ OvmsDev mailing list OvmsDev@lists.openvehicles.com http://lists.openvehicles.com/mailman/listinfo/ovmsdev
Possibly a Captain Obvious statement, but you also should disable SD logging while doing anything that needs full speed capacity. And for the web access, see the server docs: you can't get a directory listing of the root directory, as that has the same URL as the framework index page. You can access files if their paths do not match any internal page path though, so you can access a root level file by its name. Regards, Michael Am 19.06.19 um 06:23 schrieb Tamás Kovács:
Now set 20000, and now the dropped package about 25%.
Mark Webb-Johnson <mark@webb-johnson.net <mailto:mark@webb-johnson.net>> ezt írta (időpont: 2019. jún. 18., K, 7:14):
The Mac processor and I/O is a little bit faster than the little esp32.
You can try to set to 20000 then reboot. Should be about 5 times faster than default. But if running old hardware without 5v usb connected, then may crash. Recent modules, or when you have USB connected, can operate at high speed.
Regards, Mark
On 18 Jun 2019, at 11:56 AM, Tamás Kovács <kommykt@gmail.com <mailto:kommykt@gmail.com>> wrote:
Now i remove the SD card in my Mac the speed is 10MB/s / 80MB /s (W/R). I have a 1.5 year old modell with the following numbers (2018020219PTWU) If run ‘config list sdcard’ only show 'sdcard (readable writeable)' if i run 'config set sdcard maxfreq.khz 16000' now show this value for ‘config list sdcard’.
For download, if i copy the log to another folder than sd root, i can browse the folder tree, and download directly.
Mark Webb-Johnson <mark@webb-johnson.net <mailto:mark@webb-johnson.net>> ezt írta (időpont: 2019. jún. 18., K, 2:14):
Tamás,
Yes, it seems SD CARD is too slow.
Can you check ‘config list sdcard’ and see if you have a ‘maxfreq.khz’ value set? The default is 16000.
If you have a reasonably modern OVMS module, or are running from USB power (even if 12v is connected as well), you can set:
config set sdcard maxfreq.khz 20000
and reboot, to improve the SD CARD write speed.
The 1R11 means reception of a 11bit (standard) CAN message on CAN1 bus. A 1T11 would mean transmission. I think you should be able to download via the browser - personally, I just scp the files off the module over wifi.
Regards, Mark.
On 15 Jun 2019, at 1:58 AM, Tamás Kovács <kommykt@gmail.com <mailto:kommykt@gmail.com>> wrote:
I want to create log file from can messages while Lexia connected to obd, but many message has dropped. My sd card is too slow to write all data?
I start logging with can log crtd /sd/lexia.crtd command
Closing log: Type:crtd; Path:'/sd/lexia.crtd'; Filter:off; Vehicle:MI;
Statistics: total messages: 3334194, dropped: 2707476 = 81.2%
In can log i can see the incoming messages? This is a RX message: 175594.785 1R11 346 27 10 40 00 00 00 00 42 if 1R11 is 1T11 this is a TX message on CAN1? How can i download the log file, the easiest way, because if i use browser and add the file url (ip/lexia.crtd) the browser load its content.
_______________________________________________ OvmsDev mailing list OvmsDev@lists.openvehicles.com <mailto:OvmsDev@lists.openvehicles.com> http://lists.openvehicles.com/mailman/listinfo/ovmsdev
_______________________________________________ OvmsDev mailing list OvmsDev@lists.openvehicles.com <mailto:OvmsDev@lists.openvehicles.com> http://lists.openvehicles.com/mailman/listinfo/ovmsdev
-- Üdvözlettel: Kovács Tamás
_______________________________________________ OvmsDev mailing list OvmsDev@lists.openvehicles.com <mailto:OvmsDev@lists.openvehicles.com> http://lists.openvehicles.com/mailman/listinfo/ovmsdev
_______________________________________________ OvmsDev mailing list OvmsDev@lists.openvehicles.com <mailto:OvmsDev@lists.openvehicles.com> http://lists.openvehicles.com/mailman/listinfo/ovmsdev
-- Üdvözlettel: Kovács Tamás
_______________________________________________ OvmsDev mailing list OvmsDev@lists.openvehicles.com http://lists.openvehicles.com/mailman/listinfo/ovmsdev
-- Michael Balzer * Helkenberger Weg 9 * D-58256 Ennepetal Fon 02333 / 833 5735 * Handy 0176 / 206 989 26
On 2019-06-17 18:56, Tamás Kovács wrote:
I have a 1.5 year old modell with the following numbers (2018020219PTWU)
What class is your micro SD card? I tried searching for the number you gave but google didn't find it. These days I always try to get class 10 cards (C10). I haven't done any serious logging but this is what I'm using in my module: https://www.amazon.com/gp/product/9973399986/ Even within class 10 there U and V speeds: https://www.techspot.com/guides/1591-microsd-buying-guide/ (Scroll down to the table in the "Getting to the microSD cards..." section) But what is the maximum throughput possible with the ovms module? This page: https://panasonic.net/cns/sdcard/industrial_sd/performance.html seems to show that the clock frequency is twice the bus speed. So with maxfreq.khz set to 20 MHz as suggested does that mean we cannot expect to see more than 10 MB/s? This would make me think that any class 10 card (10MB/s minimum sequential writes) would at least not limit the write speed. Craig
participants (4)
-
Craig Leres -
Mark Webb-Johnson -
Michael Balzer -
Tamás Kovács