as a matter of fact i talked to a remotion employee about it a while ago:

How about going with something like mediabunny instead? I haven't checked in details, but it does seem to be fairly efficient and open-source.

I have worked with Mediabunny before. I really liked it, so this may be a viable option indeed.

i already have an implementation for Mediabunny (and many more cool changes) in the nightly branch! see the branch or the deployment