I can't see a problem.
I have just imported about 20 videos in one hit, no matter how they were sorted in the folder on my computer, they were always sorted into alphanumeric order when I imported them to OpenLP. So I tried a different method.
I added 5 videos initially and, as expected, they appeared in OpenLP in alphanumeric order. I followed that by importing another 10 videos; they slotted into place.
Have I misunderstood what you're asking, or the problem you're encountering?
I'm using OpenLP 3.1.7 on macOS 15.4.1