Custom kamelets

[Elias-Swais]

im trying to create custom kamelets on my camel karavan application, the problem that im facing is that whenever i try to create an integration and use the custom kamelet that i have created, when i deploy that project that has this integration , i get the error that no such file found for the resource : /scripts/kamelets , i was wondering where can i find this /scripts folder or atleast can someone explain how to deploy an integration that has a custom kamelet , because in the code it always exports the kamelets into this directory /scripts/kamelets

[davsclaus]

In settings for karavan in VSCode, there is a option to set a custom folder for custom kamelets. Have you configured this.

However maybe you are using karavan web which may need to be improved to support custom kamelets better (@mgubaidullin)

[mgubaidullin]

@Elias-Swais are you using web-app or vs-code extension?

[Elias-Swais]

the problem is that it works fine with the kamelets that are from the camel -k repo, all the original kamelets work fine and they deploy fine only the custom kamelets that i make dont get deployed

[mgubaidullin]

Do you have both folders kamelets and your_projet_name pushed in git repository?

[Elias-Swais]

yes before i even deploy anything theres a button inside the project that allows me to commit to git repo

[Elias-Swais]

hi @mgubaidullin i checked the repo and i have found both my project and also the /scripts file but the /scripts file is empty, i tried manually uploading my customkamelet.kamelet.yaml file there and i still get the same error

[mgubaidullin]

@Elias-Swais

1. Check that you use latest karavan 3.21.0
2. Git repository should have kamelets folder with kamelets and your-project-folder with your project files.
3. There should not be any /scripts file in your git repository. /scripts is a git check-out folder in the Docker container for Pipeline Task

   camel-karavan/karavan-cli/src/main/resources/quarkus-builder-script-kubernetes.sh

   Line 2 in 2ffe150

   CHECKOUT_DIR="/scripts"

[mgubaidullin]

Kamelet filename and kamelet metadata name should be consistent, ex. kamalets in the file aws-ddb-streams-source.kamelet.yaml shoudl have the fllowing metadata name:

metadata:
  name: aws-ddb-streams-source

[Elias-Swais]

i made sure that they are the same name and with the extension .kamelet.yaml

[aijaiswa]

@mgubaidullin We have created two projects 1. kamelets 2. Project Folder
kamlets folder we have kept the custom kamelets which we want to create. We have taken a copy of current kamelets "timer-source" and changed below content
metadata:
name: custom-timer
title: Timer
File Name: custom-timer.kamelet.yaml
Rest of the data is same. After commiting it into GIT, I can see custom-timer is appearing in kamelets catalogs as custom kamelets.
We can also drag and drop the in karavan designer. We have created a route with the help of "custom-timer" kamelets.
It got build successfully, we are using kubernets cluster. When our pod is getting initializing we are getting below error

Resource not found: classpath:/kamelets/custom-timer.kamelet.yaml

If you can advise us why it is failing it would be great. I am attaching the full stack trace below

2023-08-22 14:08:27,530 ERROR [org.apa.cam.qua.mai.CamelMainRuntime] (main) Failed to start application: org.apache.camel.RuntimeCamelException: org.apache.camel.VetoCamelContextStartException: Failure creating route from template: custom-timer
at org.apache.camel.RuntimeCamelException.wrapRuntimeException(RuntimeCamelException.java:66)
at org.apache.camel.support.service.BaseService.doFail(BaseService.java:413)
at org.apache.camel.impl.engine.AbstractCamelContext.doFail(AbstractCamelContext.java:3620)
at org.apache.camel.support.service.BaseService.fail(BaseService.java:342)
at org.apache.camel.impl.engine.AbstractCamelContext.failOnStartup(AbstractCamelContext.java:5313)
at org.apache.camel.impl.engine.AbstractCamelContext.init(AbstractCamelContext.java:2691)
at org.apache.camel.support.service.BaseService.start(BaseService.java:111)
at org.apache.camel.impl.engine.AbstractCamelContext.start(AbstractCamelContext.java:2698)
at org.apache.camel.impl.DefaultCamelContext.start(DefaultCamelContext.java:262)
at org.apache.camel.quarkus.main.CamelMain.doStart(CamelMain.java:94)
at org.apache.camel.support.service.BaseService.start(BaseService.java:119)
at org.apache.camel.quarkus.main.CamelMain.startEngine(CamelMain.java:140)
at org.apache.camel.quarkus.main.CamelMainRuntime.start(CamelMainRuntime.java:49)
at org.apache.camel.quarkus.core.CamelBootstrapRecorder.start(CamelBootstrapRecorder.java:45)
at io.quarkus.deployment.steps.CamelBootstrapProcessor$boot173480958.deploy_0(Unknown Source)
at io.quarkus.deployment.steps.CamelBootstrapProcessor$boot173480958.deploy(Unknown Source)
at io.quarkus.runner.ApplicationImpl.doStart(Unknown Source)
at io.quarkus.runtime.Application.start(Application.java:101)
at io.quarkus.runtime.ApplicationLifecycleManager.run(ApplicationLifecycleManager.java:108)
at io.quarkus.runtime.Quarkus.run(Quarkus.java:71)
at io.quarkus.runtime.Quarkus.run(Quarkus.java:44)
at io.quarkus.runtime.Quarkus.run(Quarkus.java:124)
at io.quarkus.runner.GeneratedMain.main(Unknown Source)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at io.quarkus.bootstrap.runner.QuarkusEntryPoint.doRun(QuarkusEntryPoint.java:61)
at io.quarkus.bootstrap.runner.QuarkusEntryPoint.main(QuarkusEntryPoint.java:32)
Caused by: org.apache.camel.VetoCamelContextStartException: Failure creating route from template: custom-timer
at org.apache.camel.component.kamelet.KameletComponent$LifecycleHandler.onContextInitialized(KameletComponent.java:433)
at org.apache.camel.impl.engine.AbstractCamelContext.doInit(AbstractCamelContext.java:3017)
at org.apache.camel.quarkus.core.FastCamelContext.doInit(FastCamelContext.java:174)
at org.apache.camel.support.service.BaseService.init(BaseService.java:83)
at org.apache.camel.impl.engine.AbstractCamelContext.init(AbstractCamelContext.java:2679)
... 23 more
Caused by: java.io.FileNotFoundException: Resource not found: classpath:/kamelets/custom-timer.kamelet.yaml
at org.apache.camel.dsl.yaml.YamlRoutesBuilderLoaderSupport.doLoadRouteBuilder(YamlRoutesBuilderLoaderSupport.java:76)
at org.apache.camel.dsl.support.RouteBuilderLoaderSupport.loadRoutesBuilder(RouteBuilderLoaderSupport.java:102)
at org.apache.camel.impl.engine.DefaultRoutesLoader.findRoutesBuilders(DefaultRoutesLoader.java:125)
at org.apache.camel.spi.RoutesLoader.findRoutesBuilders(RoutesLoader.java:120)
at org.apache.camel.spi.RoutesLoader.loadRoutes(RoutesLoader.java:75)
at org.apache.camel.support.RouteTemplateHelper.loadRouteTemplateFromLocation(RouteTemplateHelper.java:106)
at org.apache.camel.component.kamelet.KameletComponent$LifecycleHandler.createRouteForEndpoint(KameletComponent.java:403)
at org.apache.camel.component.kamelet.KameletComponent$LifecycleHandler.onContextInitialized(KameletComponent.java:430)
... 27 more

2023-08-22 14:08:27,656 ERROR [io.qua.run.Application] (main) Failed to start application (with profile [prod]): java.io.FileNotFoundException: Resource not found: classpath:/kamelets/custom-timer.kamelet.yaml
at org.apache.camel.dsl.yaml.YamlRoutesBuilderLoaderSupport.doLoadRouteBuilder(YamlRoutesBuilderLoaderSupport.java:76)
at org.apache.camel.dsl.support.RouteBuilderLoaderSupport.loadRoutesBuilder(RouteBuilderLoaderSupport.java:102)
at org.apache.camel.impl.engine.DefaultRoutesLoader.findRoutesBuilders(DefaultRoutesLoader.java:125)
at org.apache.camel.spi.RoutesLoader.findRoutesBuilders(RoutesLoader.java:120)
at org.apache.camel.spi.RoutesLoader.loadRoutes(RoutesLoader.java:75)
at org.apache.camel.support.RouteTemplateHelper.loadRouteTemplateFromLocation(RouteTemplateHelper.java:106)
at org.apache.camel.component.kamelet.KameletComponent$LifecycleHandler.createRouteForEndpoint(KameletComponent.java:403)
at org.apache.camel.component.kamelet.KameletComponent$LifecycleHandler.onContextInitialized(KameletComponent.java:430)
at org.apache.camel.impl.engine.AbstractCamelContext.doInit(AbstractCamelContext.java:3017)
at org.apache.camel.quarkus.core.FastCamelContext.doInit(FastCamelContext.java:174)
at org.apache.camel.support.service.BaseService.init(BaseService.java:83)
at org.apache.camel.impl.engine.AbstractCamelContext.init(AbstractCamelContext.java:2679)
at org.apache.camel.support.service.BaseService.start(BaseService.java:111)
at org.apache.camel.impl.engine.AbstractCamelContext.start(AbstractCamelContext.java:2698)
at org.apache.camel.impl.DefaultCamelContext.start(DefaultCamelContext.java:262)
at org.apache.camel.quarkus.main.CamelMain.doStart(CamelMain.java:94)
at org.apache.camel.support.service.BaseService.start(BaseService.java:119)
at org.apache.camel.quarkus.main.CamelMain.startEngine(CamelMain.java:140)
at org.apache.camel.quarkus.main.CamelMainRuntime.start(CamelMainRuntime.java:49)
at org.apache.camel.quarkus.core.CamelBootstrapRecorder.start(CamelBootstrapRecorder.java:45)
at io.quarkus.deployment.steps.CamelBootstrapProcessor$boot173480958.deploy_0(Unknown Source)
at io.quarkus.deployment.steps.CamelBootstrapProcessor$boot173480958.deploy(Unknown Source)
at io.quarkus.runner.ApplicationImpl.doStart(Unknown Source)
at io.quarkus.runtime.Application.start(Application.java:101)
at io.quarkus.runtime.ApplicationLifecycleManager.run(ApplicationLifecycleManager.java:108)
at io.quarkus.runtime.Quarkus.run(Quarkus.java:71)
at io.quarkus.runtime.Quarkus.run(Quarkus.java:44)
at io.quarkus.runtime.Quarkus.run(Quarkus.java:124)
at io.quarkus.runner.GeneratedMain.main(Unknown Source)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at io.quarkus.bootstrap.runner.QuarkusEntryPoint.doRun(QuarkusEntryPoint.java:61)
at io.quarkus.bootstrap.runner.QuarkusEntryPoint.main(QuarkusEntryPoint.java:32)

[thomas-gantenbein-tga]

@Elias-Swais, I guess #913 will resolve your (and my) issue once it's done.

[aijaiswa]

@thomas-gantenbein-tga @mgubaidullin Thanks I have fixed the issue by adding below code at quarkus-builder-script-kubernetes.sh
cd src/main/resources/camel
count=ls -1 *.kamelet.yaml 2>/dev/null | wc -l
if [ $count != 0 ]
then
cd ..
mkdir kamelets
cd kamelets
cp -R ../camel/*.kamelet.yaml .
else
echo "no custom kamelets"
fi

[davsclaus]

Karavan 4.1 supports creating and editing custom kamelets.