I'm completely new to video formats. I'm recording videos with raspberry pi, each frame has different motion attributes and I need to record that and pass it to the remote viewer, is there any space left or designed for this in the data block of each frame? Or, is there any space for this at the file level, so that I could separate the video into 12 frames per file and add all the motion attributes to the file?
And also, how bad do you think to achieve the same thing by streaming separate jpegs? If bandwidth is not a problem, and I'm not writing them to the disk either.