Skip to content

Latest commit

 

History

History
17 lines (16 loc) · 767 Bytes

README.md

File metadata and controls

17 lines (16 loc) · 767 Bytes

Secure Gateway based GenAI

HCX (Hyper Clova X) & GPT & Anthropic Claude & Gemini Pro Vision Generative AI Application

[Generative AI app]

  • Scenario: auto review generation, Cloud based Assistant
  • Secure Gateway: Nginx based Security Headers add & LLM based Prompt Injection module
  • LLM: HCX, GPT, Anthropic Claude, sLLM (Llama 3.1 8B Instruct), Gemini Pro Vision
  • Process: RAG, Multimodal RAG
  • Advanced RAG: Rerank
  • Embedding: OpenAI, Amazon Titan, NCP, HuggingFace (nomic embed text)
  • Vector DB: Chroma, FAISS, PGVector, Milvus
  • Backend: LangChain
  • Frontend: Nginx based Streamlit
  • Production & Deployment: LangSmith, RDB (SQLite3)

  • TO DO 1: Production Level Vector DB merge
  • TO DO 2: LangSmith customizing - token count & price (OpenAI to HCX)