RED Camera Video Format Extraction Utility
PROJECT INFORMATION
Project Title: RED Camera Video Format Extraction Utility
Project Start Date: 2016/08
Project Completion Date or Expected Completion Date: 2016/10
Field of Science or Technology: Software Engineering and Technology
Purpose of work
To achieve technological advancement for the purpose of creating new or improving existing materials, devices, products or processes.
Experimental Development:
Overcoming Uncertainties, Work Performed, Achievements, and Outcome
Background:
The RED video format is a proprietary RAW format that is used in high quality, professional video production. A client submitted a RAID array that hosted the storage for their video production files. The files had apparently disappeared and at some point, the file system was reformatted and partially overwritten. Metadata and other structures were overwritten therefore the only solution was a raw file recovery.
The format is undocumented therefore we would have to examine and reverse engineer the RED format by utilizing video files provided by the client, using the same equipment. Due to the proprietary nature and hence lack of technical support, we would have to break down the video header and other structures without any assistance or technical documentation.
Goal:
We had the client supply us with a number of RED video files that were produced using the same camera as that of the files to be recovered.
After deciphering the higher-level file structures, we wrote an initial scanning program used to log the location of all RED video file headers on the volume.
The first task was to extract all fragments utilizing the file start locations written to the scan logs. With the assistance of the client, we viewed the extracted fragments to determine which were complete and those that were truncated (due to interleaving of other file data within the file system).
With feedback from the client, we were informed that many fragments had flicker when played using their video editor and many were also much shorter in time in comparison the actual physical size of the video file.
After examining these files further using an openly available RED video viewer, we were able to determine the exact frames that were causing the flicker. In conjunction with the raw video data, we used this information in order to find the approximate location of the corruption within the file. This information then allowed us to accurately locate stream and frame headers, and then further break these structures down. One of the most important data values we were able to extract from the structures was the video frame timestamp and frame size. Using the timestamp and size, we could locate and identify following frames and determine if they were interrupted by other file data or overwrite.
We broke down the frame metadata further and found that there was unique data for each video file that was useful in segregating the hundreds of individual video files created during production. Our scan utility was enhanced to scan the entire volume containing the deleted RED file fragments and find the locations of continuous video frames utilizing the new information we discovered in the frame metadata.
After gathering the locations of all video fragments, we were able to piece together the majority of the lost files. When verifying the recovered files in the RED viewer, we found that some video files would not load and would hang the viewer during the frame indexing operation. After closer examination, we found that the problematic files had missing frames, likely due to overwrite of some frames. We experimented with good files by adding invalid data to the files as well as removing frames. We found that the viewer could tolerate extra invalid data and was able to resync the video, however a missing frame would cause severe issues with playback.
Since we needed to provide working files to our client, we had to devise a method to patch files that contained missing frames. We experimented by adding frames with a recreated frame header and then padded the data portion with zeroes. The solution now allowed the video to be played, so we went further by copying the preceding frame in to the missing frame (with a corrected frame header) and found the video played flawlessly without flicker.
We are successfully able to recover RED video format files which have been deleted or lost from a working file system. We have obtained enough knowledge regarding the internal RED format structures in order to create other enhanced or custom recovery tools depending on a client’s recovery situation.
Great company!
I think it is the best company in the world regarding data recovery. They take all types of recovery cases with great responsibility and ensure they work with the best possible solution for your specific case. I highly recommend it.
Superb effort
Superb effort from werecoverdata. I had no idea how to fix it when I faced a horrible problem with my RAID NAS. But they solved it very quickly and superbly. I recommend them!
Fantastic results
Thanks to all staff of werecoverdata for excellent work and for getting my company data back! I got frustrated when a deadly drop damaged my hard drive. But they solved it!
Thanks
Few days ago my raid server is crashed dangerously. It was not starting any more. I tried in a various way whatever I know but I could not fix it. My uncle told me about WeRecoverdata. Then contact with them and they repaired it. Thank you guys.
Recover service
Those are suffering bad experience of getting a reliable and professional recovery service provider, definitely, they can choose werecoverdata. I highly recommend it.
Thanks a lot
The location is a bit hard to find out but eventually, I did. They recovered my hard drive, which was mostly dead. Thanks a lot.
Great response
Definitely weRecover team is great to solve that kind of hard drive problem. Great response and remarkable. They recovered my all data successfully within short time. I wanna give special thank to David. Thanks a lot man.
Liked Your Service
I have been using my HP laptop since 2016. Few months ago I could not open my laptop. After pressing the power button its showing nothing. My friend told me about that company. They recovered my laptop. Now its working perfectly. Thanks a lot WeRecoverData.
Pretty good experience
It was really pretty good experience. They are so professional, punctual and reliable. I strongly recommend it.
Remarkable Work
A lot of thanks to werecoverdata. You did really remarkable work. I was frustrated when lost my important data from a hard drive. I sent my hard drive to WRD then they got all the data back. At first, I couldn’t believe anyone can recover it since my computer tech said he can’t do it. All credit goes to werecoverdata.
Gorgeous service
Fantastic service from all the guys at werecoverdata. I was having pressure when corrupted data from my hard drive .Then I went there and they fixed it superbly.Thanks for removing the pressure!
Extremely well
I faced horrible problem but they solved it extremely well.My problem was that hard drive crashed dangerously.At this moment I thought the sky was broken on my head.Thank you for that.
Sensible
Thanks to WeRecoverData. You fixed the hard drive problem promptly. I am impressed… Anybody can rely on werecoverdata.
Well done
Thank you
Great work
Obviously great work from werecoverdata.Definitely no doubt about this company because they take seriously to solve any kinds of problem.I have lot of assurance at them.A lot of thanks to them.
Fantastic work
Oh Tom really fantastic work. You saved my important days. Raid 5 server damaged dangerously few days ago. But you fixed it well. Thank you for that!
Great efforts
All credits goes to werecoverdata for recovering raid server.I thought impossible to repair it but they was taken sensible and fixed it.Now I can fully trust on werecoverdata.All thanks to them.
Helpful Work
Werecoverdata, you did a really very helpful work.I was angry when my hard drive got dropped from my mistakes. I recommend the company and give a lot of thanks to werecoverdata.
Best service
After my hard drive crashed I was going to be totally mad. One of mu cousin suggested me to meet that company. I did and got the best service ever I had.
Remarkable Job
AWESOME service from WeRecoverData. I was almost mad when my pc crashed. A lot of valuable data in my hard drive. One of my friend recommend it. I thought it will not be possible.
But after all I got back my all data. Thank You WeRecoverData.