Firefox Essentials - New Project Checkin

[tyler-thorne]

Checklist for reviewer:

When adding a new derived dataset:

• Ensure that the data is not available already (fully or partially) and recommend extending an existing dataset in favor of creating new ones. Data may be available in bigquery-etl repository, looker-hub or in looker-spoke-default.
• Avoid merging a PR that includes the logic of a core metric or complex business logic. The recommendation is to implement core business logic in bigquery-etl. E.g. The type of search or the calculation of DAU or visited URIs.
• Avoid merging code in Looker Explores/Views that implement analysis with multiple lines of code or that will be likely replicated in the future. Instead, aim for extending an existing dataset to include the required logic, and use Looker aggregates to facilitate the analysis.
• Avoid merging a PR with logic that requires validation and health checks. It is recommended to implement it in bigquery-etl for full test coverage and failure alerts.

Additional context:

• This new project is intended to improve Firefox Essentials data insights by building a focused, scalable, yet flexible platform for exploring specific subsets of telemetry.
• The base 5% sample size and 2-year time series limit are deliberately lightweight and compact. This project is NOT intended to reproduce product-level representations of key metrics like DAU or retention, but rather to grant improved visibility into specific sets of probes by product vertical (media, webcompat, performance, etc.), combined with predefined client attributes in data sets such as clients_last_seen (i.e. is_regular_user, days_since_first_seen, et al).
• To this end, the primary differentiator of this new project versus other related projects such as Firefox Desktop is the lower level of base granularity (client-date), allowing us to roll reporting up to coarse dimensions like country or OS, while keeping visibility into highly specific probe activity (HDR video consumption, webcompat reports, etc.).

We are excited to build a more self-sufficient and effective level of data insights for Firefox Essentials, in alignment with the data org's best practices and long term goals. Please advise if you have any questions, feedback, concerns, or would like to discuss.

I appreciate your time,
-Tyler