-
Notifications
You must be signed in to change notification settings - Fork 6
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
190 changed files
with
16,740 additions
and
4 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,82 @@ | ||
--- | ||
title: "This Week in Fluvio #67" | ||
date: 2024-12-17 | ||
weight: 20 | ||
--- | ||
Fluvio is a distributed, programmable streaming platform written in Rust. | ||
|
||
--- | ||
We released **Fluvio 0.14.0** last week. | ||
|
||
## New release | ||
Fluvio **v0.14.0** is now available! | ||
|
||
To update you can run `fvm update` | ||
|
||
```bash | ||
$ fvm update | ||
|
||
info: Updating fluvio stable to version 0.14.0. Current version is 0.12.1. | ||
info: Downloading (1/5): [email protected] | ||
info: Downloading (2/5): [email protected] | ||
info: Downloading (3/5): [email protected] | ||
info: Downloading (4/5): [email protected] | ||
info: Downloading (5/5): [email protected] | ||
done: Installed fluvio version 0.14.0 | ||
done: Now using fluvio version 0.14.0 | ||
|
||
``` | ||
|
||
If you don't have Fluvio in your machine run: | ||
|
||
``` | ||
curl -fsS https://hub.infinyon.cloud/install/install.sh | bash | ||
``` | ||
|
||
If you are enjoying Fluvio please share with your friends! | ||
|
||
:::info | ||
Also check out the Stateful Data Flow (SDF) streaming analytics in beta [SDF Examples](https://github.com/infinyon/stateful-dataflows-examples) | ||
::: | ||
|
||
## New features | ||
Notable changes in this new version: | ||
|
||
- Added graceful shutdown for connectors, ensuring they finish the process of the messages before shutting down. | ||
- Changed the default log level to `info` for CDK connector deployment, providing clearer deployment insights. | ||
- Expanded support for the new organization features on Fluvio Cloud, enhancing functionality for managing organizations. | ||
|
||
## Bug fixes | ||
This release resolves important issues: | ||
|
||
- Fixed the sorting order in the `fluvio profile list` command output. | ||
- Improved connector deployment by checking for existing connectors and preventing duplicates with the same name. | ||
|
||
See the [CHANGELOG] for details | ||
|
||
## Good First Issues | ||
We love our open source community contributors. Here are some issues that you could contribute to. All the best. | ||
|
||
- [Profiles in alphabetical order by name] | ||
- [Improve fluvio topic describe with additional information] | ||
- [Different default SPU port] | ||
|
||
|
||
--- | ||
|
||
Get in touch with us on [Github Discussions] or join [our Discord channel] and come say hello! | ||
|
||
For the full list of changes this week, be sure to check out [our CHANGELOG]. | ||
|
||
[Fluvio open source]: https://github.com/infinyon/fluvio | ||
[our CHANGELOG]: https://github.com/infinyon/fluvio/blob/master/CHANGELOG.md | ||
[our Discord channel]: https://discordapp.com/invite/bBG2dTz | ||
[Github Discussions]: https://github.com/infinyon/fluvio/discussions | ||
|
||
[this form]: https://infinyon.com/request/ss-early-access/ | ||
[CHANGELOG]: https://github.com/infinyon/fluvio/blob/v0.14.0/CHANGELOG.md | ||
[When a topic is deleted, connected clients should have their connection closed]: https://github.com/infinyon/fluvio/issues/3836 | ||
[Remove localhost from fluvio in favor of 127.0.0.1]: https://github.com/infinyon/fluvio/issues/3866 | ||
[Profiles in alphabetical order by name]: https://github.com/infinyon/fluvio/issues/4246 | ||
[Improve fluvio topic describe with additional information]: https://github.com/infinyon/fluvio/issues/3968 | ||
[Different default SPU port]: https://github.com/infinyon/fluvio/issues/3739 |
1 change: 1 addition & 0 deletions
1
versioned_docs/version-0.14.0/_embeds/cmds/cdk-deploy-start-http-sink-generic.bash
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
cdk deploy start --ipkg infinyon-http-sink-0.2.11.ipkg --config <CONFIG> |
1 change: 1 addition & 0 deletions
1
versioned_docs/version-0.14.0/_embeds/cmds/cdk-deploy-start-http-source-cat-facts-xform.bash
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
cdk deploy start --ipkg infinyon-http-source-0.3.8.ipkg --config ./http-cat-facts-transform.yaml |
1 change: 1 addition & 0 deletions
1
versioned_docs/version-0.14.0/_embeds/cmds/cdk-deploy-start-http-source-cat-facts.bash
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
cdk deploy start --ipkg infinyon-http-source-0.3.8.ipkg --config ./http-cat-facts.yaml |
1 change: 1 addition & 0 deletions
1
versioned_docs/version-0.14.0/_embeds/cmds/cdk-deploy-start-http-source-quotes.bash
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
cdk deploy start --ipkg infinyon-http-source-0.3.8.ipkg -c quotes-source-connector.yml |
1 change: 1 addition & 0 deletions
1
versioned_docs/version-0.14.0/_embeds/cmds/cdk-deploy-start-http-source-string-quotes.bash
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
cdk deploy start --ipkg infinyon-http-source-0.3.8.ipkg -c string-quotes-source-connector.yml |
1 change: 1 addition & 0 deletions
1
versioned_docs/version-0.14.0/_embeds/cmds/cdk-deploy-start-sql-sink-cat-facts.bash
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
cdk deploy start --ipkg infinyon-sql-sink-0.4.3.ipkg --config ./sql-cat-fact.yaml |
1 change: 1 addition & 0 deletions
1
versioned_docs/version-0.14.0/_embeds/cmds/cdk-hub-download-http-sink.bash
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
cdk hub download infinyon/[email protected] |
5 changes: 5 additions & 0 deletions
5
versioned_docs/version-0.14.0/_embeds/cmds/cdk-hub-download-http-source-output.bash
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,5 @@ | ||
trying connection to fluvio router.infinyon.cloud:9003 | ||
downloading infinyon/[email protected] to infinyon-jolt-0.4.1.ipkg | ||
... downloading complete | ||
... checking package | ||
... cluster smartmodule install complete |
1 change: 1 addition & 0 deletions
1
versioned_docs/version-0.14.0/_embeds/cmds/cdk-hub-download-http-source.bash
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
cdk hub download infinyon/[email protected] |
1 change: 1 addition & 0 deletions
1
versioned_docs/version-0.14.0/_embeds/cmds/cdk-hub-download-sql-sink.bash
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
cdk hub download infinyon/[email protected] |
13 changes: 13 additions & 0 deletions
13
versioned_docs/version-0.14.0/_embeds/cmds/hub-conn-list.bash
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,13 @@ | ||
fluvio hub connector list | ||
CONNECTOR Visibility | ||
infinyon-labs/[email protected] public | ||
infinyon/[email protected] public | ||
infinyon/[email protected] public | ||
infinyon/[email protected] public | ||
infinyon/[email protected] public | ||
infinyon/[email protected] public | ||
infinyon/[email protected] public | ||
infinyon/[email protected] public | ||
infinyon/[email protected] public | ||
infinyon/[email protected] public | ||
qdrant/[email protected] public |
5 changes: 5 additions & 0 deletions
5
versioned_docs/version-0.14.0/_embeds/cmds/hub-sm-download-jolt-output.bash
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,5 @@ | ||
trying connection to fluvio router.infinyon.cloud:9003 | ||
downloading infinyon/[email protected] to infinyon-jolt-0.4.1.ipkg | ||
... downloading complete | ||
... checking package | ||
... cluster smartmodule install complete |
1 change: 1 addition & 0 deletions
1
versioned_docs/version-0.14.0/_embeds/cmds/hub-sm-download-jolt.bash
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
fluvio hub smartmodule download infinyon/[email protected] |
5 changes: 5 additions & 0 deletions
5
versioned_docs/version-0.14.0/_embeds/cmds/hub-sm-download-json-sql-output.bash
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,5 @@ | ||
trying connection to fluvio router.infinyon.cloud:9003 | ||
downloading infinyon/[email protected] to infinyon-json-sql-0.2.1.ipkg | ||
... downloading complete | ||
... checking package | ||
... cluster smartmodule install complete |
1 change: 1 addition & 0 deletions
1
versioned_docs/version-0.14.0/_embeds/cmds/hub-sm-download-json-sql.bash
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
fluvio hub sm download infinyon/[email protected] |
4 changes: 4 additions & 0 deletions
4
versioned_docs/version-0.14.0/_embeds/cmds/hub-sm-list-jolt.bash
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,4 @@ | ||
fluvio hub smartmodule list | ||
SMARTMODULE Visibility | ||
infinyon/[email protected] public | ||
... |
15 changes: 15 additions & 0 deletions
15
versioned_docs/version-0.14.0/_embeds/cmds/hub-sm-list.bash
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,15 @@ | ||
fluvio hub smartmodule list | ||
SMARTMODULE Visibility | ||
infinyon-labs/[email protected] public | ||
infinyon-labs/[email protected] public | ||
infinyon-labs/[email protected] public | ||
infinyon-labs/[email protected] public | ||
infinyon-labs/[email protected] public | ||
infinyon-labs/[email protected] public | ||
infinyon-labs/[email protected] public | ||
infinyon-labs/[email protected] public | ||
infinyon-labs/[email protected] public | ||
infinyon/[email protected] public | ||
infinyon/[email protected] public | ||
infinyon/[email protected] public | ||
infinyon/[email protected] public |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,3 @@ | ||
fluvio smartmodule list | ||
SMARTMODULE SIZE | ||
infinyon/[email protected] 589.3 KB |
4 changes: 4 additions & 0 deletions
4
versioned_docs/version-0.14.0/_embeds/cmds/sm-list-json-sql-jolt.bash
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,4 @@ | ||
fluvio sm list | ||
SMARTMODULE SIZE | ||
infinyon/[email protected] 559.6 KB | ||
infinyon/[email protected] 589.3 KB |
11 changes: 11 additions & 0 deletions
11
versioned_docs/version-0.14.0/_embeds/connectors/http-cat-fact-basic.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,11 @@ | ||
apiVersion: 0.1.0 | ||
meta: | ||
version: 0.3.8 | ||
name: cat-facts | ||
type: http-source | ||
topic: cat-facts | ||
create-topic: true | ||
|
||
http: | ||
endpoint: "https://catfact.ninja/fact" | ||
interval: 10s |
18 changes: 18 additions & 0 deletions
18
versioned_docs/version-0.14.0/_embeds/connectors/http-cat-fact-transform.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,18 @@ | ||
apiVersion: 0.1.0 | ||
meta: | ||
version: 0.3.8 | ||
name: cat-facts-transformed | ||
type: http-source | ||
topic: cat-facts-data-transform | ||
|
||
http: | ||
endpoint: https://catfact.ninja/fact | ||
interval: 10s | ||
|
||
transforms: | ||
- uses: infinyon/[email protected] | ||
with: | ||
spec: | ||
- operation: default | ||
spec: | ||
source: "http" |
17 changes: 17 additions & 0 deletions
17
versioned_docs/version-0.14.0/_embeds/connectors/http-source-quotes-transform.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,17 @@ | ||
# string-quotes-source-connector.yml | ||
apiVersion: 0.1.0 | ||
meta: | ||
version: 0.3.8 | ||
name: string-quotes | ||
type: http-source | ||
topic: string-quotes | ||
http: | ||
endpoint: https://demo-data.infinyon.com/api/quote | ||
interval: 3s | ||
transforms: | ||
- uses: infinyon/[email protected] | ||
with: | ||
spec: | ||
- operation: shift | ||
spec: | ||
quote: "" |
10 changes: 10 additions & 0 deletions
10
versioned_docs/version-0.14.0/_embeds/connectors/http-source-quotes.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,10 @@ | ||
# quotes-source-connector.yml | ||
apiVersion: 0.1.0 | ||
meta: | ||
version: 0.3.8 | ||
name: http-quotes | ||
type: http-source | ||
topic: quotes | ||
http: | ||
endpoint: https://demo-data.infinyon.com/api/quote | ||
interval: 3s |
27 changes: 27 additions & 0 deletions
27
versioned_docs/version-0.14.0/_embeds/connectors/sql-cat-fact.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,27 @@ | ||
# sql.yaml | ||
apiVersion: 0.1.0 | ||
meta: | ||
name: simple-cat-facts-sql | ||
type: sql-sink | ||
version: 0.4.3 | ||
topic: cat-facts | ||
sql: | ||
url: "postgres://user:[email protected]/dbname" | ||
transforms: | ||
- uses: infinyon/[email protected] | ||
invoke: insert | ||
with: | ||
mapping: | ||
table: "animalfacts" | ||
map-columns: | ||
"length": | ||
json-key: "length" | ||
value: | ||
type: "int" | ||
default: "0" | ||
required: true | ||
"raw_fact_json": | ||
json-key: "$" | ||
value: | ||
type: "jsonb" | ||
required: true |
8 changes: 8 additions & 0 deletions
8
versioned_docs/version-0.14.0/_embeds/transforms/infinyon-jolt.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,8 @@ | ||
#transforms.yml | ||
transforms: | ||
- uses: infinyon/[email protected] | ||
with: | ||
spec: | ||
- operation: shift | ||
spec: | ||
quote: "" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,5 @@ | ||
const versions = { | ||
infinyon_http_source: '[email protected]', | ||
} | ||
|
||
export default versions; |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,5 @@ | ||
{ | ||
"label": "Cloud CLI", | ||
"collapsed": true, | ||
"position": 30 | ||
} |
Oops, something went wrong.