I'm packaging python-vblf as a workaround; this other library allows me to skip only one bad record, not the full remaining of the file.
I can now pinpoint the exact record out of thousands of other records which makes python-can crash. I will come back at this later.
