Application Security Engine Support

[buixor]

Add a new datasource that:

• Receives HTTP requests from remediation components
• Apply rules on them to determine whether they are malicious or not
• Rules can be evaluated in-band (the remediation component will block the request directly) or out-band (the RC will let the request through, but crowdsec can still process the rule matches with scenarios)

The PR also adds support for 2 new hub items:

• appsec-configs: Configure the Application Security Engine (which rules to load, in which phase)
• appsec-rules: a rule that is added in the Application Security Engine (can use either our own format, or seclang)

[github-actions]

@buixor: There are no 'kind' label on this PR. You need a 'kind' label to generate the release automatically.

• /kind feature
• /kind enhancement
• /kind fix
• /kind chore
• /kind dependencies

Details

I am a bot created to help the crowdsecurity developers manage community feedback and contributions. You can check out my manifest file to understand my behavior and what I can do. If you want to use this for your project, you can check out the BirthdayResearch/oss-governance-bot repository.

[github-actions]

@buixor: There are no area labels on this PR. You can add as many areas as you see fit.

• /area agent
• /area local-api
• /area cscli
• /area security
• /area configuration

Details

I am a bot created to help the crowdsecurity developers manage community feedback and contributions. You can check out my manifest file to understand my behavior and what I can do. If you want to use this for your project, you can check out the BirthdayResearch/oss-governance-bot repository.

[buixor]

/area agent
/kind feature

[codecov]

Codecov Report

Attention: 1360 lines in your changes are missing coverage. Please review.

Comparison is base (90d3a21) 58.31% compared to head (692d96b) 47.97%.

Files	Patch %	Lines
pkg/appsec/appsec.go	0.00%	350 Missing ⚠️
pkg/hubtest/hubtest_item.go	0.00%	219 Missing ⚠️
pkg/types/appsec_event.go	0.00%	140 Missing ⚠️
pkg/appsec/coraza_logger.go	0.00%	119 Missing ⚠️
pkg/appsec/request.go	54.24%	92 Missing and 5 partials ⚠️
pkg/appsec/appsec_rules_collection.go	0.00%	74 Missing ⚠️
pkg/hubtest/coverage.go	0.00%	47 Missing ⚠️
pkg/appsec/waf_helpers.go	0.00%	46 Missing ⚠️
pkg/appsec/tx.go	0.00%	43 Missing ⚠️
pkg/hubtest/nucleirunner.go	0.00%	41 Missing ⚠️
... and 13 more

Additional details and impacted files

@@             Coverage Diff             @@
##           master    #2273       +/-   ##
===========================================
- Coverage   58.31%   47.97%   -10.35%     
===========================================
  Files         201      129       -72     
  Lines       27045    16831    -10214     
===========================================
- Hits        15771     8074     -7697     
+ Misses       9725     7871     -1854     
+ Partials     1549      886      -663     

Flag	Coverage Δ
bats	?
unit-linux	?
unit-windows	47.97% <12.59%> (-3.53%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.