Skip to content

Commit

Permalink
Add sidecar datatypes parsing to msak experiment (#428)
Browse files Browse the repository at this point in the history
* Add msak's annotation2 datatype to config.yml

* Remove daily_only

* Add hopannotation2, scamper1 and pcap parsing for msak experiment.

* Add tcpinfo parsing too

* s/NDT/ANNOTATION/

* Add join targets for msak's tcpinfo and scamper1
  • Loading branch information
robertodauria authored Aug 8, 2023
1 parent 4bc6c60 commit 48dcf95
Showing 1 changed file with 34 additions and 0 deletions.
34 changes: 34 additions & 0 deletions config/config.yml
Original file line number Diff line number Diff line change
Expand Up @@ -83,3 +83,37 @@ sources:
raw: raw_wehe
join: wehe
daily_only: true
## MSAK
- bucket: archive-{{ANNOTATION_SOURCE_PROJECT}}
experiment: msak
datatype: annotation2
target_datasets:
tmp: tmp_msak
raw: raw_msak
- bucket: archive-{{ANNOTATION_SOURCE_PROJECT}}
experiment: msak
datatype: scamper1
target_datasets:
tmp: tmp_msak
raw: raw_msak
join: msak
- bucket: archive-{{ANNOTATION_SOURCE_PROJECT}}
experiment: msak
datatype: hopannotation2
target_datasets:
tmp: tmp_msak
raw: raw_msak
- bucket: archive-{{ANNOTATION_SOURCE_PROJECT}}
experiment: msak
datatype: pcap
target_datasets:
tmp: tmp_msak
raw: raw_msak
daily_only: true
- bucket: archive-{{ANNOTATION_SOURCE_PROJECT}}
experiment: msak
datatype: tcpinfo
target_datasets:
tmp: tmp_msak
raw: raw_msak
join: msak

0 comments on commit 48dcf95

Please sign in to comment.