We have tested the Java version of Minecraft 1.17, but we were not able to recreate your issue.
It might be a problem with the graphics driver.
Please uninstall the graphics driver completely.
And then, please install the latest version of the graphics driver and try recording again.
If it does not seem to help, please let us know the download link of Minecraft 1.8.9 so that we can test it again.
Also, please let us know your PC specs.