YUV buffer has 2048 additional bytes on Mini 2

[kripper]

Describe the bug

RawVideoStreamer plugin sends 2048 additional bytes.

To fix, you should check the source code that grabs and sends the video frame and find out what format it is using, in order to decode it correctly on the receiving end (vision landing).

I have a "DJI Mini SE" and it works fine (without this issue).

[OMAHDrone]

Thank you very much kripper
The problem is still there:
yuv_mat = yuv_mat.reshape((h + h // 2, w))
ValueError: cannot reshape array of size 1384448 into shape (1080,1280)

when I set the fps to 30 in the app, the received video almost never get updated. There is something wrong with video streaming of dji mini2.

[kripper]

Maybe the rendering of the images using X11 is slow. The same happens here with the example.
I don't render the images on the screen using X11 on visual landing. It's just an example.
You could disable the code to render the images and only measure the time it takes to receive the images. Should be 15 fps, or 30 fps if you set it to 30 fps.

Regarding the format, I'm sorry but I cannot debug/fix it without having a Mini 2 for testing.
Should probably be very easy to fix though.

If it lags for more than some [ms], it could mean that it is waiting for more data to receive (network layer).

[OMAHDrone]

Thank you very much kripper
I have tested the app and code with dji air 2 and dji phantom 4. The high latency is still there (around 30 seconds at 30 fps). I noticed that dji phantom 4 needs the 2048 hack but dji air 2 doest not.
Thank you very much for your help
My pleasure

[kripper]

If you don't consume the frames at time (becasue of #151 (comment)) whey will stack up and latency will increase until the phone crashes or disconnects.

[kripper]

I did some tests with my VisionLanding lab and got less than 1 [s] total latency (action + perception).

[kripper]

Please create a different issue for latency.

[Ugzuzg]

Do you still need help with this? I have a Mini 2 and can run thet test.

[kripper]

More than testing, you could try fixing the mini 2 video compatibility problem by checking this repo:
https://github.com/m4xw/rosettadrone_mini2