Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rollout "day zero" experiment #979

Merged
merged 2 commits into from
Apr 11, 2024
Merged

Rollout "day zero" experiment #979

merged 2 commits into from
Apr 11, 2024

Conversation

DJAndries
Copy link
Collaborator

No description provided.

@DJAndries DJAndries marked this pull request as ready for review April 5, 2024 20:07
@DJAndries DJAndries requested a review from a team as a code owner April 5, 2024 20:07
Copy link
Member

@kjozwiak kjozwiak left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM 👍 Merging into staging now that brave/brave-core#22768 was uplifted/merged into 1.65.x. Once we get a new RC with brave/brave-core#22768, we'll run through the above study on main (staging).

@kjozwiak kjozwiak merged commit 18aa0ce into main Apr 11, 2024
6 checks passed
@kjozwiak kjozwiak deleted the day-zero branch April 11, 2024 05:32
@kjozwiak
Copy link
Member

kjozwiak commented Apr 17, 2024

Quick Note: Currently there's no feature(s) that are using DayZeroStudyWindows so with the following verifications, ensured that you're placed into the different cohorts that are available. The P3A portion was verified via brave/brave-browser#36243.

Win 11 x64 verification(s):

Verification PASSED on Win 11 x64 using the following build(s):

Brave | 1.65.114 Chromium: 124.0.6367.60 (Official Build) (64-bit)
-- | --
Revision | f1e2cbb65e11340d9040d5ef0b0115c7a5206207
OS | Windows 11 Version 23H2 (Build 22631.3447)

Release channel - DayZeroStudyWindows:Default

  • launched/re-launched 1.65.114 Chromium: 124.0.6367.60 using brave.exe --enable-logging=stderr --reset-variation-state --variations-server-url=https://variations.bravesoftware.com/seed

image

Release channel - DayZeroStudyWindows:EnabledA

  • launched/re-launched 1.65.114 Chromium: 124.0.6367.60 using brave.exe --enable-logging=stderr --reset-variation-state --variations-server-url=https://variations.bravesoftware.com/seed

image

Release channel - DayZeroStudyWindows:EnabledB

  • launched/re-launched 1.65.114 Chromium: 124.0.6367.60 using brave.exe --enable-logging=stderr --reset-variation-state --variations-server-url=https://variations.bravesoftware.com/seed

image

BETA channel - DayZeroStudyWindows should be used/visible (only on Release)

Verification PASSED on Win 11 x64 using the following build(s):

Brave | 1.66.80 Chromium: 124.0.6367.29 (Official Build) beta (64-bit)
-- | --
Revision | 2d822a1940c9159c1f307cd1c0a8f58fcfb50fe0
OS | Windows 11 Version 23H2 (Build 22631.3447)
  • launched/re-launched 1.66.80 Chromium: 124.0.6367.29 using brave.exe --enable-logging=stderr --variations-server-url=https://variations.bravesoftware.com/seed
  • ensured that DayZeroStudyWindows doesn't appear within brave://version

image

Nightly channel - DayZeroStudyWindows should be used/visible (only on Release)

Verification PASSED on Win 11 x64 using the following build(s):

Brave | 1.67.15 Chromium: 124.0.6367.29 (Official Build) nightly (64-bit)
-- | --
Revision | eb30d51fbd9c8d0f2960f50f9df8d07a44a87694
OS | Windows 11 Version 23H2 (Build 22631.3447)
  • launched/re-launched 1.67.15 Chromium: 124.0.6367.29 using brave.exe --enable-logging=stderr --variations-server-url=https://variations.bravesoftware.com/seed
  • ensured that DayZeroStudyWindows doesn't appear within brave://version

nightly

@kjozwiak
Copy link
Member

Quick Note: Currently there's no feature(s) that are using DayZeroStudyAndroid so with the following verifications, ensured that you're placed into the different cohorts that are available. The P3A portion was verified via brave/brave-browser#36243.

Android verification(s):

Verification PASSED on Pixel 6 running Android 14 using the following build(s):

Brave | 1.65.114 Chromium: 124.0.6367.60 (Official Build) (64-bit)
--- | ---
Revision | f1e2cbb65e11340d9040d5ef0b0115c7a5206207
OS | Android 14; Build/AP21.240305.005; 34; REL

Release channel - DayZeroStudyAndroid:Default

  • launched/re-launched 1.65.114 Chromium: 124.0.6367.60

Screenshot_20240417-015040

Release channel - DayZeroStudyAndroid:EnabledA

  • launched/re-launched 1.65.114 Chromium: 124.0.6367.60

Screenshot_20240417-014841

BETA channel - DayZeroStudyAndroid should be used/visible (only on Release)

Verification PASSED on Pixel 6 running Android 14 using the following build(s):

Brave | 1.66.80 Chromium: 124.0.6367.29 (Official Build) beta (64-bit)
--- | ---
Revision | 2d822a1940c9159c1f307cd1c0a8f58fcfb50fe0
OS | Android 14; Build/AP21.240305.005; 34; REL
  • launched/re-launched 1.66.80 Chromium: 124.0.6367.29
  • ensured that DayZeroStudyAndroid doesn't appear within brave://version

Screenshot_20240417-022918

Nightly channel - DayZeroStudyAndroid should be used/visible (only on Release)

Verification PASSED on Pixel 6 running Android 14 using the following build(s):

Brave | 1.67.17 Chromium: 124.0.6367.60 (Official Build) canary (64-bit)
--- | ---
Revision | 72a32ca8d6807602548c9ef315099e87bdf97946
OS | Android 14; Build/AP21.240305.005; 34; REL
  • launched/re-launched 1.67.17 Chromium: 124.0.6367.60
  • ensured that DayZeroStudyAndroid doesn't appear within brave://version

Screenshot_20240417-023355

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants