Search-engine

A powerful full stack Search Engine

THIS IS STILL IN DEVELOPMENT

Plan

• Crate database structure and indexes
• Lingual Tokenizer made in python (used to break English text down to tokens)
  • Basic tokenization
  • Refine
• Web Crawler made in NodeJS
  • Find and isolate all written content
  • Tokenise all content
  • Get all links on a given webpage
    • Crawl through the
  • Save all tokens and links to database
• Engine made in Golang
  • HTTP server
  • Create database query
  • Execute and return response