A/B Testing Question

I’m running an experiment in an online application funnel.

We have a ID (let’s call it Pseudo ID) which represents a customer, that has their session(s) as another ID inside of it.

We’re seeing about 4% of the sessions have the same Pseudo ID. We think it’s because it’s the same customer switching between desktop and mobile devices, but hard to tell.

Should we exclude the duplicate Pseudo IDs? The lift of the experiment is positive if you include or …

a/b testing b testing datascience testing