Welcome Mavic Pilot!
Jump in and join our free DJI Mavic community today!
Sign up

Reverse engineering DJI's TXT log format

finlayson

Well-Known Member
Joined
Oct 15, 2016
Messages
76
Reaction score
46
Age
59
FYI, I have reverse-engineered DJI’s “.txt” log file format, and have made available Open Source code for (command-line) applications that:
  1. Read a DJI “.txt” file, outputting a ‘comma-separated value’ (CSV) file (that can be input to a spreadsheet), and
  2. Read a CSV file, outputting a KML-format file (that can be read by Google Earth, to display your drone’s track).
(These two applications can be combined (piped) together, so you can generate a KML-format file directly from a DJI “.txt” file.)

You can find this (documentation plus source code) online at:
http://djilogs.live555.com/

We also have a public mailing list - "[email protected]555.com” - that people can use to discuss this software (and the “.txt” log format in general). Information about this mailing list can be found at the web site noted above.

(Note that I won’t be posting much more on this thread - so if you have any questions/comments about this software, please use our mailing list, rather than this thread.)

Ross.
 
  • Like
Reactions: UAVNV

sar104

Dic mihi solum facta, domina.
Premium Pilot
Joined
May 27, 2017
Messages
7,123
Reaction score
7,321
Loc
Los Alamos, NM
How is this different to uploading the .txt file into AirData, and downloading the .csv and .kml file?
AirData only converts a small fraction of the available data fields into the csv file.
 

finlayson

Well-Known Member
Joined
Oct 15, 2016
Messages
76
Reaction score
46
Age
59
Dunno Bro?? I've been using this for ages...
CsvView/DatCon
That's good. I see that he has source code (in Java) for his DAT -> CSV conversion tool. This will be useful (for documenting the DAT file format).

But he didn't have any source code for his TXT -> CSV conversion tool. For that, he just used the separate "TXTlogToCSVtool.exe" Windows application - which didn't have source code. That's where I've filled the gap. My TXT -> CSV conversion tool has full source code.
 

Simmo

Learning every day!!
Premium Pilot
Joined
Nov 2, 2017
Messages
2,202
Reaction score
1,315
Age
54
Loc
FNQ Australia
OK! I dont know what I am supposed to do now.....
Like at Church.. do I clap???
 

dvarapala

Well-Known Member
Joined
Nov 21, 2017
Messages
295
Reaction score
223
Age
65
Subscribed.

It pisses me off that DJI tries to lock me out of my own data by obfuscating/encrypting it. Any effort to "jailbreak" our flight data has my support.
 

Simmo

Learning every day!!
Premium Pilot
Joined
Nov 2, 2017
Messages
2,202
Reaction score
1,315
Age
54
Loc
FNQ Australia
Subscribed.

It pisses me off that DJI tries to lock me out of my own data by obfuscating/encrypting it. Any effort to "jailbreak" our flight data has my support.
Are you serious??? Are not we talking about the TXT file here???
 

BudWalker

Well-Known Member
Premium Pilot
Joined
Oct 24, 2016
Messages
1,281
Reaction score
761
Age
70
Loc
Arroyo Grande, California
That's good. I see that he has source code (in Java) for his DAT -> CSV conversion tool. This will be useful (for documenting the DAT file format).
........
The record structure is well known. You're probably referring to the specific fields within a particular record type. Documenting these will be tough. Every platform-FW combination can be different. And, it's a moving target.

For each record type in a .DAT DatCon will look for different ways to parse that particular record type. If it can't find one that it likes that record type won't be parsed and won't appear in the generated .csv.

The .DAT files are kinda self documenting. You can see this by telling DatCon to produce a RecDefs file.
upload_2018-7-20_8-11-27.png
 

n8r0n74

New Member
Joined
Jun 8, 2018
Messages
3
Reaction score
1
Age
45
FYI, I have reverse-engineered DJI’s “.txt” log file format, and have made available Open Source code for (command-line) applications that:
  1. Read a DJI “.txt” file, outputting a ‘comma-separated value’ (CSV) file (that can be input to a spreadsheet), and
  2. Read a CSV file, outputting a KML-format file (that can be read by Google Earth, to display your drone’s track).
(These two applications can be combined (piped) together, so you can generate a KML-format file directly from a DJI “.txt” file.)

You can find this (documentation plus source code) online at:
http://djilogs.live555.com/

We also have a public mailing list - "[email protected]555.com” - that people can use to discuss this software (and the “.txt” log format in general). Information about this mailing list can be found at the web site noted above.

(Note that I won’t be posting much more on this thread - so if you have any questions/comments about this software, please use our mailing list, rather than this thread.)

Ross.
Has this website been moved elsewhere? Don't see the live555.com server up any more. This would be super useful, thanks for the reverse engineering effort.
 

finlayson

Well-Known Member
Joined
Oct 15, 2016
Messages
76
Reaction score
46
Age
59
Has this website been moved elsewhere? Don't see the live555.com server up any more. This would be super useful, thanks for the reverse engineering effort.
The server was down for a few hours today (due to a server problem). It's up again now.