wip notes

meta-introspector · Jul 14, 2024 · 9900fe4 · 9900fe4
1 parent f6da87f
commit 9900fe4
Show file tree

Hide file tree

Showing 21 changed files with 154 additions and 1 deletion.
diff --git a/.gitmodules b/.gitmodules
@@ -13613,3 +13613,42 @@
 [submodule "2024/07/08/dmlc-core"]
 	path = 2024/07/08/dmlc-core
 	url = https://github.com/dmlc/dmlc-core
+[submodule "2024/07/11/unilm"]
+	path = 2024/07/11/unilm
+	url = https://github.com/microsoft/unilm
+[submodule "2024/07/11/ArXivQA"]
+	path = 2024/07/11/ArXivQA
+	url = https://github.com/taesiri/ArXivQA
+[submodule "2024/07/11/NeMo"]
+	path = 2024/07/11/NeMo
+	url = https://github.com/NVIDIA/NeMo
+[submodule "2024/07/11/read_paper"]
+	path = 2024/07/11/read_paper
+	url = https://github.com/riron1206/read_paper/
+[submodule "2024/07/11/distilabel"]
+	path = 2024/07/11/distilabel
+	url = https://github.com/argilla-io/distilabel
+[submodule "2024/07/11/gritlm"]
+	path = 2024/07/11/gritlm
+	url = https://github.com/ContextualAI/gritlm
+[submodule "2024/07/11/contrastors"]
+	path = 2024/07/11/contrastors
+	url = https://github.com/nomic-ai/contrastors
+[submodule "2024/07/11/skypilot"]
+	path = 2024/07/11/skypilot
+	url = https://github.com/skypilot-org/skypilot
+[submodule "2024/07/13/scheme-lsp-server"]
+	path = 2024/07/13/scheme-lsp-server
+	url = https://codeberg.org/rgherdt/scheme-lsp-server.git
+[submodule "2024/07/14/scheme-lsp"]
+	path = 2024/07/14/scheme-lsp
+	url = https://github.com/konst-aa/scheme-lsp
+[submodule "2024/07/14/racket-langserver"]
+	path = 2024/07/14/racket-langserver
+	url = https://github.com/jeapostrophe/racket-langserver/
+[submodule "2024/07/14/zls"]
+	path = 2024/07/14/zls
+	url = https://github.com/zigtools/zls
+[submodule "2024/07/14/guile-language-server"]
+	path = 2024/07/14/guile-language-server
+	url = https://github.com/Johni0702/guile-language-server
diff --git a/2024/05/30/mes b/2024/05/30/mes
diff --git a/2024/07/05/notes.org b/2024/07/05/notes.org
@@ -0,0 +1,11 @@
+Idea:
+
+Trace execution for finding attention points using perf.
+Build model on foundational functions.
+Looking at guix, what are the key functions.
+
+Create a stack of pdf files, one per block of functions in a hierarchy dependencies
+that contain all the data needed. 
+
+Lets consider starting with our divergent ideas and how we can reach
+consensus using llms.
diff --git a/2024/07/11/ArXivQA b/2024/07/11/ArXivQA
diff --git a/2024/07/11/NeMo b/2024/07/11/NeMo
diff --git a/2024/07/11/contrastors b/2024/07/11/contrastors
diff --git a/2024/07/11/distilabel b/2024/07/11/distilabel
diff --git a/2024/07/11/gritlm b/2024/07/11/gritlm
diff --git a/2024/07/11/notes.org b/2024/07/11/notes.org
@@ -0,0 +1,47 @@
+* ideas of the day
+
+** starting point for people
+
+Many people ask me what are the key technologies to learn, and they are changing all the time.
+It is hard to commit to a specific thing, because of the fluid nature of the market.
+But let me tell you what I feel is important,
+
+*** Freedom
+
+The freedom to develop without restriction I feel is key,
+if we try to avoid depending on accepting licenses and restrictions
+while if we do have to accept it, we can work to remove them, isolating them into boxes.
+
+
+The things that go against this freedom are :
+
+**** GPU and CPU.
+
+This reliance on GPUS from nvidia and chips from Intel and AMD
+represent one of the biggest strangleholds on our market.
+
+***** nvidia cuda
+
+This is one of the main pain points of development with AI.
+It has all types of restrictions associated with it.
+
+**** Cloud services.
+***** AWS
+**** Code hosting
+***** Github
+
+**** Networking services
+***** Cloudflare
+***** Verizon fios
+***** Tailscale
+***** DNS services
+
+***** libp2p
+
+
+**** AI inference
+***** Bing copilot
+This is a very good AI service but it also has all types of downsides.
+
+* Computational complexity
+
diff --git a/2024/07/11/read_paper b/2024/07/11/read_paper
diff --git a/2024/07/11/skypilot b/2024/07/11/skypilot
diff --git a/2024/07/11/unilm b/2024/07/11/unilm
diff --git a/2024/07/13/OLSP b/2024/07/13/OLSP
diff --git a/2024/07/13/emacs-lsp-scheme b/2024/07/13/emacs-lsp-scheme
diff --git a/2024/07/13/monitors4codegen b/2024/07/13/monitors4codegen
diff --git a/2024/07/13/notes.org b/2024/07/13/notes.org
@@ -0,0 +1,40 @@
+* idea
+
+Consider a closed world model where all variables are defined and know.
+
+We have an application that we can run and it does the same thing over again.
+We can trace the steps of the execution and inspect them.
+
+
+Extract a list of logical chunks, and give the count of chunks
+Extract a list of logical chunks, and list the bullet points
+Extract a list of logical chunks, and display chunk number N
+
+We can then look at each chunk of the code and ask:
+
+Explain this.
+Rewrite this into language:
+   python, json, yaml, coq, haskell, ocaml, c++,
+   prolog, scheme, owl ontology, x86 assembly, shell,
+   wasm, emojilang, math, goedel numbers
+
+Extract a list of features from this
+Extract a list of types from this
+Extract a list of propositions from this
+Extract a list of named entities from this
+Extract a list of classes
+Extract a list of functions
+Extract a list of modules
+Extract a list of questions and answers about this code
+Extract a list of dependencies
+Extract a list of prerequisites
+
+In the format : json, yaml, sexpressions, turtle/rdf, dot(graphviz), emojis, godel number, pytorch
+
+
+* implementation
+
+find a guile scheme lsp and apply it to itself.
+
+use lsp interface to traverse the program.
+construct a dag of dependendences
diff --git a/2024/07/13/scheme-lsp-server b/2024/07/13/scheme-lsp-server
diff --git a/2024/07/14/guile-language-server b/2024/07/14/guile-language-server
diff --git a/2024/07/14/racket-langserver b/2024/07/14/racket-langserver
diff --git a/2024/07/14/scheme-lsp b/2024/07/14/scheme-lsp
diff --git a/2024/07/14/zls b/2024/07/14/zls