So I made a video rendered on Roblox which can render videos in 480P / 30FPS.
It manages to do this performantly by A. Doing a lot of optimisation checks to reduce redundancy which is calculated via multithreading and B. Compress images via Lossy compression simularly to JPEG.
It represents 8x8 pixels in one single image via an image label.
Here are the sprite maps
Here is a partial demonstration, note the images are random images as I havent uploaded each JPEG image indivitually.
But my question is how do I convert real videos to this format. It’s also harder because I would somehow do this lossy compressions smartly which seems really hard.
What should I do?