I know some people had trouble in the past with SKR boards and LEDs causing some sort of problem:
I had a RAMBo board on my last build, and didn’t have that same issue, but I would read through that thread, as it may contain some solutions.