Skip to content

Commit

Permalink
Update schema
Browse files Browse the repository at this point in the history
  • Loading branch information
@actions-user
actions-user committed Nov 10, 2024
1 parent f2b1edb commit c5acb7b
Show file tree
Hide file tree
Showing 7 changed files with 3,809 additions and 196 deletions.
3,707 changes: 3,660 additions & 47 deletions SCHEMA.all.md
View file

Large diffs are not rendered by default.

94 changes: 47 additions & 47 deletions schema/beacon_api_.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -34,9 +34,9 @@ Contains beacon API /eth/v1/beacon/states/{state_id}/committees data from each s
### Availability
Data is partitioned **hourly** on **slot_start_date_time** for the following networks:

- **mainnet**: `2023-09-05` to `2024-11-07`
- **holesky**: `2023-12-25` to `2024-11-07`
- **sepolia**: `2023-12-24` to `2024-11-07`
- **mainnet**: `2023-09-05` to `2024-11-08`
- **holesky**: `2023-12-25` to `2024-11-08`
- **sepolia**: `2023-12-24` to `2024-11-08`

### Examples

Expand All @@ -48,7 +48,7 @@ Data is partitioned **hourly** on **slot_start_date_time** for the following net
docker run --rm -it clickhouse/clickhouse-server clickhouse local --query --query="""
SELECT
*
FROM url('https://data.ethpandaops.io/xatu/mainnet/databases/default/beacon_api_eth_v1_beacon_committee/2024/11/2/0.parquet', 'Parquet')
FROM url('https://data.ethpandaops.io/xatu/mainnet/databases/default/beacon_api_eth_v1_beacon_committee/2024/11/3/0.parquet', 'Parquet')
LIMIT 10
FORMAT Pretty
"""
Expand Down Expand Up @@ -132,9 +132,9 @@ Contains beacon API eventstream "attestation" data from each sentry client attac
### Availability
Data is partitioned **hourly** on **slot_start_date_time** for the following networks:

- **mainnet**: `2023-06-05` to `2024-11-07`
- **holesky**: `2023-09-29` to `2024-11-07`
- **sepolia**: `2023-09-01` to `2024-11-07`
- **mainnet**: `2023-06-05` to `2024-11-08`
- **holesky**: `2023-09-29` to `2024-11-08`
- **sepolia**: `2023-09-01` to `2024-11-08`

### Examples

Expand All @@ -146,7 +146,7 @@ Data is partitioned **hourly** on **slot_start_date_time** for the following net
docker run --rm -it clickhouse/clickhouse-server clickhouse local --query --query="""
SELECT
*
FROM url('https://data.ethpandaops.io/xatu/mainnet/databases/default/beacon_api_eth_v1_events_attestation/2024/11/2/0.parquet', 'Parquet')
FROM url('https://data.ethpandaops.io/xatu/mainnet/databases/default/beacon_api_eth_v1_events_attestation/2024/11/3/0.parquet', 'Parquet')
LIMIT 10
FORMAT Pretty
"""
Expand Down Expand Up @@ -235,9 +235,9 @@ Contains beacon API eventstream "blob_sidecar" data from each sentry client atta
### Availability
Data is partitioned **daily** on **slot_start_date_time** for the following networks:

- **mainnet**: `2024-03-13` to `2024-11-07`
- **holesky**: `2024-02-07` to `2024-11-07`
- **sepolia**: `2024-01-30` to `2024-11-07`
- **mainnet**: `2024-03-13` to `2024-11-08`
- **holesky**: `2024-02-07` to `2024-11-08`
- **sepolia**: `2024-01-30` to `2024-11-08`

### Examples

Expand All @@ -249,7 +249,7 @@ Data is partitioned **daily** on **slot_start_date_time** for the following netw
docker run --rm -it clickhouse/clickhouse-server clickhouse local --query --query="""
SELECT
*
FROM url('https://data.ethpandaops.io/xatu/mainnet/databases/default/beacon_api_eth_v1_events_blob_sidecar/2024/11/2.parquet', 'Parquet')
FROM url('https://data.ethpandaops.io/xatu/mainnet/databases/default/beacon_api_eth_v1_events_blob_sidecar/2024/11/3.parquet', 'Parquet')
LIMIT 10
FORMAT Pretty
"""
Expand Down Expand Up @@ -336,9 +336,9 @@ Contains beacon API eventstream "block" data from each sentry client attached to
### Availability
Data is partitioned **daily** on **slot_start_date_time** for the following networks:

- **mainnet**: `2023-02-28` to `2024-11-07`
- **holesky**: `2023-12-24` to `2024-11-07`
- **sepolia**: `2023-12-24` to `2024-11-07`
- **mainnet**: `2023-02-28` to `2024-11-08`
- **holesky**: `2023-12-24` to `2024-11-08`
- **sepolia**: `2023-12-24` to `2024-11-08`

### Examples

Expand All @@ -350,7 +350,7 @@ Data is partitioned **daily** on **slot_start_date_time** for the following netw
docker run --rm -it clickhouse/clickhouse-server clickhouse local --query --query="""
SELECT
*
FROM url('https://data.ethpandaops.io/xatu/mainnet/databases/default/beacon_api_eth_v1_events_block/2024/11/2.parquet', 'Parquet')
FROM url('https://data.ethpandaops.io/xatu/mainnet/databases/default/beacon_api_eth_v1_events_block/2024/11/3.parquet', 'Parquet')
LIMIT 10
FORMAT Pretty
"""
Expand Down Expand Up @@ -435,9 +435,9 @@ Contains beacon API eventstream "chain reorg" data from each sentry client attac
### Availability
Data is partitioned **daily** on **slot_start_date_time** for the following networks:

- **mainnet**: `2023-03-01` to `2024-11-07`
- **holesky**: `2024-02-05` to `2024-11-07`
- **sepolia**: `2024-05-23` to `2024-11-07`
- **mainnet**: `2023-03-01` to `2024-11-08`
- **holesky**: `2024-02-05` to `2024-11-08`
- **sepolia**: `2024-05-23` to `2024-11-08`

### Examples

Expand All @@ -449,7 +449,7 @@ Data is partitioned **daily** on **slot_start_date_time** for the following netw
docker run --rm -it clickhouse/clickhouse-server clickhouse local --query --query="""
SELECT
*
FROM url('https://data.ethpandaops.io/xatu/mainnet/databases/default/beacon_api_eth_v1_events_chain_reorg/2024/11/2.parquet', 'Parquet')
FROM url('https://data.ethpandaops.io/xatu/mainnet/databases/default/beacon_api_eth_v1_events_chain_reorg/2024/11/3.parquet', 'Parquet')
LIMIT 10
FORMAT Pretty
"""
Expand Down Expand Up @@ -538,9 +538,9 @@ Contains beacon API eventstream "contribution and proof" data from each sentry c
### Availability
Data is partitioned **daily** on **contribution_slot_start_date_time** for the following networks:

- **mainnet**: `2023-08-31` to `2024-11-07`
- **holesky**: `2023-12-24` to `2024-11-07`
- **sepolia**: `2023-12-24` to `2024-11-07`
- **mainnet**: `2023-08-31` to `2024-11-08`
- **holesky**: `2023-12-24` to `2024-11-08`
- **sepolia**: `2023-12-24` to `2024-11-08`

### Examples

Expand All @@ -552,7 +552,7 @@ Data is partitioned **daily** on **contribution_slot_start_date_time** for the f
docker run --rm -it clickhouse/clickhouse-server clickhouse local --query --query="""
SELECT
*
FROM url('https://data.ethpandaops.io/xatu/mainnet/databases/default/beacon_api_eth_v1_events_contribution_and_proof/2024/11/2.parquet', 'Parquet')
FROM url('https://data.ethpandaops.io/xatu/mainnet/databases/default/beacon_api_eth_v1_events_contribution_and_proof/2024/11/3.parquet', 'Parquet')
LIMIT 10
FORMAT Pretty
"""
Expand Down Expand Up @@ -642,9 +642,9 @@ Contains beacon API eventstream "finalized checkpoint" data from each sentry cli
### Availability
Data is partitioned **daily** on **epoch_start_date_time** for the following networks:

- **mainnet**: `2023-04-10` to `2024-11-07`
- **holesky**: `2023-03-26` to `2024-11-07`
- **sepolia**: `2023-03-26` to `2024-11-07`
- **mainnet**: `2023-04-10` to `2024-11-08`
- **holesky**: `2023-03-26` to `2024-11-08`
- **sepolia**: `2023-03-26` to `2024-11-08`

### Examples

Expand All @@ -656,7 +656,7 @@ Data is partitioned **daily** on **epoch_start_date_time** for the following net
docker run --rm -it clickhouse/clickhouse-server clickhouse local --query --query="""
SELECT
*
FROM url('https://data.ethpandaops.io/xatu/mainnet/databases/default/beacon_api_eth_v1_events_finalized_checkpoint/2024/11/2.parquet', 'Parquet')
FROM url('https://data.ethpandaops.io/xatu/mainnet/databases/default/beacon_api_eth_v1_events_finalized_checkpoint/2024/11/3.parquet', 'Parquet')
LIMIT 10
FORMAT Pretty
"""
Expand Down Expand Up @@ -739,9 +739,9 @@ Contains beacon API eventstream "head" data from each sentry client attached to
### Availability
Data is partitioned **daily** on **slot_start_date_time** for the following networks:

- **mainnet**: `2023-08-30` to `2024-11-07`
- **holesky**: `2023-12-05` to `2024-11-07`
- **sepolia**: `2023-12-05` to `2024-11-07`
- **mainnet**: `2023-08-30` to `2024-11-08`
- **holesky**: `2023-12-05` to `2024-11-08`
- **sepolia**: `2023-12-05` to `2024-11-08`

### Examples

Expand All @@ -753,7 +753,7 @@ Data is partitioned **daily** on **slot_start_date_time** for the following netw
docker run --rm -it clickhouse/clickhouse-server clickhouse local --query --query="""
SELECT
*
FROM url('https://data.ethpandaops.io/xatu/mainnet/databases/default/beacon_api_eth_v1_events_head/2024/11/2.parquet', 'Parquet')
FROM url('https://data.ethpandaops.io/xatu/mainnet/databases/default/beacon_api_eth_v1_events_head/2024/11/3.parquet', 'Parquet')
LIMIT 10
FORMAT Pretty
"""
Expand Down Expand Up @@ -841,8 +841,8 @@ Contains beacon API eventstream "voluntary exit" data from each sentry client at
### Availability
Data is partitioned **daily** on **wallclock_epoch_start_date_time** for the following networks:

- **mainnet**: `2020-12-01` to `2024-11-07`
- **holesky**: `2023-10-01` to `2024-11-07`
- **mainnet**: `2020-12-01` to `2024-11-08`
- **holesky**: `2023-10-01` to `2024-11-08`
- **sepolia**: `2023-10-01` to `null`

### Examples
Expand All @@ -855,7 +855,7 @@ Data is partitioned **daily** on **wallclock_epoch_start_date_time** for the fol
docker run --rm -it clickhouse/clickhouse-server clickhouse local --query --query="""
SELECT
*
FROM url('https://data.ethpandaops.io/xatu/mainnet/databases/default/beacon_api_eth_v1_events_voluntary_exit/2024/11/2.parquet', 'Parquet')
FROM url('https://data.ethpandaops.io/xatu/mainnet/databases/default/beacon_api_eth_v1_events_voluntary_exit/2024/11/3.parquet', 'Parquet')
LIMIT 10
FORMAT Pretty
"""
Expand Down Expand Up @@ -941,9 +941,9 @@ Contains beacon API validator attestation data from each sentry client attached
### Availability
Data is partitioned **daily** on **slot_start_date_time** for the following networks:

- **mainnet**: `2023-08-31` to `2024-11-07`
- **holesky**: `2023-12-24` to `2024-11-07`
- **sepolia**: `2023-12-24` to `2024-11-07`
- **mainnet**: `2023-08-31` to `2024-11-08`
- **holesky**: `2023-12-24` to `2024-11-08`
- **sepolia**: `2023-12-24` to `2024-11-08`

### Examples

Expand All @@ -955,7 +955,7 @@ Data is partitioned **daily** on **slot_start_date_time** for the following netw
docker run --rm -it clickhouse/clickhouse-server clickhouse local --query --query="""
SELECT
*
FROM url('https://data.ethpandaops.io/xatu/mainnet/databases/default/beacon_api_eth_v1_validator_attestation_data/2024/11/2.parquet', 'Parquet')
FROM url('https://data.ethpandaops.io/xatu/mainnet/databases/default/beacon_api_eth_v1_validator_attestation_data/2024/11/3.parquet', 'Parquet')
LIMIT 10
FORMAT Pretty
"""
Expand Down Expand Up @@ -1048,9 +1048,9 @@ Contains beacon API /eth/v2/beacon/blocks/{block_id} data from each sentry clien
### Availability
Data is partitioned **daily** on **slot_start_date_time** for the following networks:

- **mainnet**: `2023-11-14` to `2024-11-07`
- **holesky**: `2023-12-24` to `2024-11-07`
- **sepolia**: `2023-12-24` to `2024-11-07`
- **mainnet**: `2023-11-14` to `2024-11-08`
- **holesky**: `2023-12-24` to `2024-11-08`
- **sepolia**: `2023-12-24` to `2024-11-08`

### Examples

Expand All @@ -1062,7 +1062,7 @@ Data is partitioned **daily** on **slot_start_date_time** for the following netw
docker run --rm -it clickhouse/clickhouse-server clickhouse local --query --query="""
SELECT
*
FROM url('https://data.ethpandaops.io/xatu/mainnet/databases/default/beacon_api_eth_v2_beacon_block/2024/11/2.parquet', 'Parquet')
FROM url('https://data.ethpandaops.io/xatu/mainnet/databases/default/beacon_api_eth_v2_beacon_block/2024/11/3.parquet', 'Parquet')
LIMIT 10
FORMAT Pretty
"""
Expand Down Expand Up @@ -1166,9 +1166,9 @@ Contains a proposer duty from a beacon block.
### Availability
Data is partitioned **daily** on **slot_start_date_time** for the following networks:

- **mainnet**: `2024-04-03` to `2024-11-07`
- **holesky**: `2024-04-03` to `2024-11-07`
- **sepolia**: `2024-04-03` to `2024-11-07`
- **mainnet**: `2024-04-03` to `2024-11-08`
- **holesky**: `2024-04-03` to `2024-11-08`
- **sepolia**: `2024-04-03` to `2024-11-08`

### Examples

Expand All @@ -1180,7 +1180,7 @@ Data is partitioned **daily** on **slot_start_date_time** for the following netw
docker run --rm -it clickhouse/clickhouse-server clickhouse local --query --query="""
SELECT
*
FROM url('https://data.ethpandaops.io/xatu/mainnet/databases/default/beacon_api_eth_v1_proposer_duty/2024/11/2.parquet', 'Parquet')
FROM url('https://data.ethpandaops.io/xatu/mainnet/databases/default/beacon_api_eth_v1_proposer_duty/2024/11/3.parquet', 'Parquet')
LIMIT 10
FORMAT Pretty
"""
Expand Down
Loading

0 comments on commit c5acb7b

Please sign in to comment.