Interesting approach, but I am not sure it can be more precise than PyAnnote. Have you tried both and compared?