If you have a group of elements that act as a link or trigger for an interaction, the cursor will jump from default to pointer as it hovers over the elements and the space between them.
For example, I have an icon and text element that I want to act as one link. before. mov shows the issue. after. mov shows the improvement.
The solution is to select the group and check Crop selected content.