It looks almost as if there is radial friction, like if the belt teeth are slightly gripped by the pulley teeth, pulling them toward the pulley when the belt leaves the pulley, and pushing away slightly when the belt enters the pulley.
Maybe some graphite lubricant might help? Although if belt tension is high enough I would think it shouldn’t matter.