ComfyUI Integration with Custom Node Creation Bounty [$3000]

[JJassonn69]

To ease the process of onboarding many more creators and enthusiasts, we aim to construct a ComfyUI custom node that is tightly integrated with Livepeer network for processing AI workflow commands from ComfyUI dashboard. Since, many creators 🧑‍🎨 rely on ComfyUI for incorporating open-source models into their workflows, this enhancement would significantly improve user experience and drive adoption. 🚀

We are calling on the community to implement this important tool to AI-network so that we can empower the creators with the open source, decentralised and cost effective access to the models on the Livepeer Network. Successfully integrating with ComfyUI by creating this custom node will provide opportunity for further utilisation of our pipelines and bolster Livepeer as top network for AI infrastructure. 🔥

---

Required Skillset

• Strong Python and Javascript programming skills.
• Familiar with ComfyUI and its workflows.
• Basic background with developing SaaS products.

---

Bounty Requirements

1. Implementation: Develop a working custom node to ComfyUI workflows that uses Livepeer AI pipelines for task completion. One should be able to host ComfyUI interface and use the custom build node to leverage Livepeer network. Create also a sample workflow that demonstrates the use of the custom node with multiple pipelines from Livepeer together (e.g. text-to-image and image-to-video) similar to this example.
2. Functionality: The custom node should provide functionality that pipelines in AI-network are able to handle. It should also be modular such that it also needs to be easily extendable to other pipelines and additional functionalities and features.
3. Documentation and Testing: The bounty will be considered complete with clear documentation for implementation and use. The node should be thoroughly tested across a wide range of use cases to ensure reliability, performance, and real-world applicability, making it user-friendly and encouraging adoption by creators.
4. License: The software should be published on a public GitHub repository under an MIT license.

---

Scope Exclusions

• This bounty does NOT cover the hosting and providing SaaS product for ComfyUI interface. But can be handled if interested with a separate bounty.

---

Implementation Tips

To learn how to create a custom node for ComfyUI, refer to their documentation and explore the examples in their GitHub repository. Additionally, be sure to review the Livepeer AI API Reference documentation for guidance on how to call the Livepeer AI pipelines.

---

How to Apply

1. Express Your Interest: Comment on this issue to indicate your interest and explain why you're the ideal candidate for the task.
2. Wait for Review: Our team will review expressions of interest and select the best candidate.
3. Get Assigned: If selected, we'll assign the GitHub issue to you.
4. Start Working: Dive into your task! If you need assistance or guidance, comment on the issue or join the discussions in the #developer-lounge channel on our Discord server.
5. Submit Your Work: Create a pull request in the relevant repository and request a review.
6. Notify Us: Comment on this GitHub issue when your pull request is ready for review.
7. Receive Your Bounty: We'll arrange the bounty payment once your pull request is approved.
8. Gain Recognition: Your valuable contributions will be showcased in our project's changelog.

Thank you for your interest in contributing to our project! 💛

Warning

Please wait for the issue to be assigned to you before starting work. To prevent duplication of effort, submissions for unassigned issues will not be accepted.

[brymut]

Hi @JJassonn69, I'm interested in taking this on. I'm a web developer with an interest in web3 tech, with experience developing in Typescript and Python. I'm also familiar with the Livepeer network and have taken some time to familiarise myself at a basic level with the AI video. As for comfyui, I've also dabbled with it in the past and got the general gist of it. I also got to see it being used in a project on the corridor crew's cool project using it to spoof about sequel movies here: https://www.youtube.com/watch?v=PrPY_USgngg. I've had a look at the spec provided above & I believe I can take this on and would like to be assigned.

Typescript Work

• Designed & built a Voting Delegation Dashboard for the APWine DAO using React/Typescript/Tailwind - https://vote-delegation-dashboard.vercel.app/
• Browser plugin related. Added support for Zora NFTs viewing & the Celo blockchain onto the Mask.io browser plugin - DimensionDev/Maskbook@810999f & DimensionDev/Maskbook@c5cfdf3
• Contributions to the Shapeshift Web App & related KeepKey hardware wallet features. - https://github.com/shapeshift/web/commits?author=brymut

Python Work

• Integrating price data for Superfluid tokens into the Gnosis Safe web app backend - Feat: Add Superfluid Oracle token adapter  safe-global/safe-eth-py#381
• Pylint plugin for improving code analysis for when using Django, forked from pydev - https://github.com/brymut/pylint-django

You can also have a look at my Dework page: https://app.dework.xyz/profile/BryanMutai
Discord Handle: bryanmutai

Ready when you are :)

[brymut]

Hi @rickstaa, maybe you could check this on this?

Hi @JJassonn69, I'm interested in taking this on. I'm a web developer with an interest in web3 tech, with experience developing in Typescript and Python. I'm also familiar with the Livepeer network and have taken some time to familiarise myself at a basic level with the AI video. As for comfyui, I've also dabbled with it in the past and got the general gist of it. I also got to see it being used in a project on the corridor crew's cool project using it to spoof about sequel movies here: https://www.youtube.com/watch?v=PrPY_USgngg. I've had a look at the spec provided above & I believe I can take this on and would like to be assigned.

Typescript Work

• Designed & built a Voting Delegation Dashboard for the APWine DAO using React/Typescript/Tailwind - https://vote-delegation-dashboard.vercel.app/
• Browser plugin related. Added support for Zora NFTs viewing & the Celo blockchain onto the Mask.io browser plugin - DimensionDev/Maskbook@810999f & DimensionDev/Maskbook@c5cfdf3
• Contributions to the Shapeshift Web App & related KeepKey hardware wallet features. - https://github.com/shapeshift/web/commits?author=brymut

Python Work

• Integrating price data for Superfluid tokens into the Gnosis Safe web app backend - Feat: Add Superfluid Oracle token adapter  safe-global/safe-eth-py#381
• Pylint plugin for improving code analysis for when using Django, forked from pydev - https://github.com/brymut/pylint-django

You can also have a look at my Dework page: https://app.dework.xyz/profile/BryanMutai Discord Handle: bryanmutai

Ready when you are :)

[rickstaa]

@brymut Thank you for your interest in contributing to our open-source ecosystem! 🚀 I’ve reviewed your profile and am confident that you’re well-suited for this task. I’ve gone ahead and assigned the issue to you. If you have any questions or need any assistance, feel free to reach out to me on Discord or here.

[rickstaa]

@brymut how is your bounty hunt going? Is there anything we can do to help you out 🫡?

[RUFFY-369]

Hi @brymut, It would really be great if you could update on the current state of your ComfyUI Integration work as the community is really interested to get this done.
As bounty hunts are taking a long time without much regular updates so it would be really helpful if you could provide an update regarding the work on your part.

Also, if you are unable to continue the work, please update with that as well because the ComfyUI is one of the things with great potential and we(personally me too) would love to get this integrated by the potential willing developers
Thanks
Cheers! 😄

cc @rickstaa

[brymut]

Hi @RUFFY-369, @rickstaa. I apologise for the delay, unfortunately some personal conflicts came up back I'm back on it. Will update within 24 hours.

[Nightrider0098]

Hi @RUFFY-369, @rickstaa
if @brymut is not able to work on this issue can I start working, I am a web developer who has experience in JS and Python.
I worked on module federation, Server Actions, and Live streaming. I have more than three years of experience in development.