Skip to content
This repository has been archived by the owner on Jun 1, 2021. It is now read-only.

If PlanOut is deterministic, why I see different result from the tech talk video #140

Open
xinallume opened this issue Aug 2, 2019 · 0 comments

Comments

@xinallume
Copy link

I am using python 3.6.8 with planout-0.6.0. In my local box I ran the following block:

class SignupExperiment(SimpleExperiment):
  def assign(self, params, cookieid):
    params.button_color = UniformChoice(
      choices=["#ff0000", "#00ff00"],
      unit=cookieid)
    params.button_text = UniformChoice(
      choices=["Join now", "Sign me up!"],
      unit=cookieid) 
e = SignupExperiment(cookieid=4)
print(e.get('button_text'))
print(e.get('button_color'))

which give me:

Sign me up!
#ff0000

However, the video (https://www.youtube.com/watch?v=Ayd4sqPH2DE) shows

Sign me up!
#00ff00

This made me worried that whether I should trust deterministic claim and not logging user bucket during experiment. Any insights?

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant