# This is a combination of 97 commits.

# This is the 1st commit message: general updates # This is the commit message #2: minor updates # This is the commit message #3: add build no to js # This is the commit message #4: minor change # This is the commit message #5: minor change # This is the commit message #6: minor change # This is the commit message #7: Update integrations.yml # This is the commit message #8: Jina updates # This is the commit message #9: Jina updates # This is the commit message #10: General updates regarding Haystack # This is the commit message #11: Update integrations.yml # This is the commit message #12: Update layout-documentation.html # This is the commit message #13: Update layout-documentation.html # This is the commit message #14: Tweaked some grammar # This is the commit message #15: Tweaked some grammar # This is the commit message #16: created new webpage for google summer of code # This is the commit message #17: update gsoc page # This is the commit message #18: Tweaked some reading/writing flow # This is the commit message #19: Tweaked some grammar, reading/writing flow # This is the commit message #20: Tweaked some grammar and writing/reading flow # This is the commit message #21: Tweaked typos and writing flow # This is the commit message #22: Fixed some typos, grammar, writing flow Note: I left a placeholder for the Horizontal Scaling issue as I was unsure how that should be described now that it exists. # This is the commit message #23: Added a missing word and tweaked grammar # This is the commit message #24: Fixed typo and workflow suggestion # This is the commit message #25: Tweaked some typos and grammar # This is the commit message #26: Tweaked some typos, grammar, and writing flow. # This is the commit message #27: Tweaked some writing flow... # This is the commit message #28: Tweaked some typos # This is the commit message #29: Tweaked some typos # This is the commit message #30: Tweaked some writing style and grammar # This is the commit message #31: Tweaked some grammar # This is the commit message #32: Tweak grammar # This is the commit message #33: add funding news # This is the commit message #34: add funding news Yahoo # This is the commit message #35: minor updates # This is the commit message #36: minor updates # This is the commit message #37: Update java code documentary # This is the commit message #38: Tweaked the reading flow and grammar # This is the commit message #39: Tweaked grammar # This is the commit message #40: Fixed some grammar # This is the commit message #41: Tweaked language flow # This is the commit message #42: Tweaked some grammar # This is the commit message #43: Placeholder for needed fix I was unable to find the body of text represented by the link to the docker-compose.yml configuration--> {% include docs-config-gen.html %} . A word in the instructions needs to be corrected which I included in parentheses. ...You can also select an older version for compatbility (compatibility) sake... # This is the commit message #44: Smoothed out the readability and fixed some grammar # This is the commit message #45: Fixed an upper/lower case issue. # This is the commit message #46: Smoothed out some language # This is the commit message #47: Fixed some readability issues # This is the commit message #48: Tweaked grammar # This is the commit message #49: Tweaked grammar # This is the commit message #50: Tweaked grammar and readability # This is the commit message #51: Fixed some typos Note: I don't know the status of these pages but the images run off the right side of the page (only 25-50% are visible at 100% webpage view) and are not optimized. # This is the commit message #52: fix travis # This is the commit message #53: minor update in resources # This is the commit message #54: Update to Example Code--> Python. Added required option `answer` inside `_additional` # This is the commit message #55: minor update in resources # This is the commit message #56: gh-42: update GSOC page # This is the commit message #57: gh-42: update GSOC page # This is the commit message #58: add Plausible # This is the commit message #59: minor updates # This is the commit message #60: add next pod # This is the commit message #61: updated podcast images # This is the commit message #62: minor fixes # This is the commit message #63: Update using multiple vectorization modules # This is the commit message #64: deleted old jpgs' # This is the commit message #65: podcast 9 img uploaded # This is the commit message #66: changed file size image, its now 140kb # This is the commit message #67: added podcast 9 # This is the commit message #68: upload Karen Beckers company img for podcast 9 # This is the commit message #69: Update podcasts.yml # This is the commit message #70: add tutorial on writing great bug reports # This is the commit message #71: bug report: tweak language, fix misspelling # This is the commit message #72: change order of new tutorial page # This is the commit message #73: GSoC updates # This is the commit message #74: created og-documentaion jpgs # This is the commit message #75: changed OG references # This is the commit message #76: changed OG references for images # This is the commit message #77: changed jpg size to 1200 x 630 # This is the commit message #78: also added OGs for index pages # This is the commit message #79: minor OG updates # This is the commit message #80: Tweaked grammar, added a word for clarity # This is the commit message #81: Tweaked grammar # This is the commit message #82: Tweaked grammar # This is the commit message #83: Tweaked some grammar # This is the commit message #84: Tweaked some grammar # This is the commit message #85: add venturebeat # This is the commit message #86: add news # This is the commit message #87: update gql addtional props ref with timestamps, fix code sample # This is the commit message #88: add Slack to gsoc # This is the commit message #89: corrected wrong img names # This is the commit message #90: corrected typo in huggingface # This is the commit message #91: Created README.md @bobvanluijt I added this with the information I needed when running the website locally. # This is the commit message #92: Update README.md # This is the commit message #93: Delete README.md # This is the commit message #94: add Yury pod # This is the commit message #95: make v1.11.0 the default weaviate version # This is the commit message #96: document how to set open AI key at runtime # This is the commit message #97: feat: og image generation script & refactored og image naming
weaviate · Jan 18, 2023 · d39663b · d39663b
1 parent 5b17a31
commit d39663b
Show file tree

Hide file tree

Showing 308 changed files with 31,362 additions and 1,003 deletions.
diff --git a/.travis.yml b/.travis.yml
@@ -1,48 +1,54 @@
 os: linux
 dist: focal
 language: ruby
-rvm:
-- 2.7.0
-before_install:
-- openssl aes-256-cbc -K $encrypted_617a65259523_key -iv $encrypted_617a65259523_iv
-  -in key.master.json.enc -out key.master.json -d
-- sudo apt-get update
-- sudo apt-get install -y minify
-- bundle install
-- |
-  if [ "${TRAVIS_PULL_REQUEST}" = "false" ]; then
-    gcloud version || true
-    if [ ! -d "$HOME/google-cloud-sdk/bin" ]; then rm -rf $HOME/google-cloud-sdk; export CLOUDSDK_CORE_DISABLE_PROMPTS=1; curl https://sdk.cloud.google.com | bash; fi
-    echo "LOAD SOURCE"
-    source /home/travis/google-cloud-sdk/path.bash.inc
-    gcloud version
-    gcloud auth activate-service-account --key-file key.master.json
-  fi
-- rm key.master.json
-install:
-- bundle install
-- gem install jekyll html-proofer
-script:
-- bundle exec jekyll build
-- minify --match='\.html' -r -o _site_min/ _site/
-- rsync -av _site_min/ _site/
-- |
-  if [ "${TRAVIS_PULL_REQUEST}" = "false" ]; then
-    if [ $TRAVIS_BRANCH = "main" ]; then
-      # set project
-      gcloud config set project "$GS_PROJECT"
-      # rm everything
-      gsutil -m rm -r gs://$GS_BUCKET/**
-      # cd into assets dir
-      cd _site/
-      # Upload data to bucket
-      gsutil -m -h "Cache-Control:public,max-age=86400" cp -r ./ gs://$GS_BUCKET/
-      # set access
-      gsutil iam ch allUsers:objectViewer gs://$GS_BUCKET
-      # set web service
-      gsutil web set -m index.html -e 404.html gs://$GS_BUCKET
-      # Invalidate the CDN
-      gcloud compute url-maps invalidate-cdn-cache $GS_BUCKET --path "/*" --async
-    fi
-  fi
-cache: bundler
+jobs:
+  include:
+    - language: python
+      python: 3.8
+      install:
+        - pip install -r ./python/requirements.txt
+      script: ./python/generate_og.py
+    - language: ruby
+      rvm:
+      - 2.7.0
+      before_install:
+      - sudo apt-get update
+      - sudo apt-get install -y minify
+      - bundle install
+      install:
+      - bundle install
+      - gem install jekyll html-proofer
+      script:
+      - bundle exec jekyll build
+      - minify --match='\.html' -r -o _site_min/ _site/
+      - rsync -av _site_min/ _site/
+      - |
+        if [ "${TRAVIS_PULL_REQUEST}" = "false" ]; then
+          if [ $TRAVIS_BRANCH = "main" ]; then
+            # unpack secrets
+            openssl aes-256-cbc -K $encrypted_617a65259523_key -iv $encrypted_617a65259523_iv -in key.master.json.enc -out key.master.json -d
+            # Install gcloud
+            gcloud version || true
+            if [ ! -d "$HOME/google-cloud-sdk/bin" ]; then rm -rf $HOME/google-cloud-sdk; export CLOUDSDK_CORE_DISABLE_PROMPTS=1; curl https://sdk.cloud.google.com | bash; fi
+            echo "LOAD SOURCE"
+            source /home/travis/google-cloud-sdk/path.bash.inc
+            gcloud version
+            gcloud auth activate-service-account --key-file key.master.json
+            rm key.master.json
+            # set project
+            gcloud config set project "$GS_PROJECT"
+            # rm everything
+            gsutil -m rm -r gs://$GS_BUCKET/**
+            # cd into assets dir
+            cd _site/
+            # Upload data to bucket
+            gsutil -m -h "Cache-Control:public,max-age=3600" cp -r ./ gs://$GS_BUCKET/
+            # set access
+            gsutil iam ch allUsers:objectViewer gs://$GS_BUCKET
+            # set web service
+            gsutil web set -m index.html -e 404.html gs://$GS_BUCKET
+            # Invalidate the CDN
+            gcloud compute url-maps invalidate-cdn-cache $GS_BUCKET --path "/*" --async
+          fi
+        fi
+      cache: bundler
diff --git a/404.md b/404.md
@@ -0,0 +1,22 @@
+---
+title: 404
+layout: default
+---
+
+<!-- WELCOME -->
+<section class="pt-12 pt-md-14 pb-12 pb-md-15 bg-gray-900" style="margin-top: -87px;">
+    <div class="container">
+        <div class="row justify-content-center">
+            <div class="col-12 col-md-10 col-lg-7 text-center">
+                <!-- Headin -->
+                <h1 class="display-2 fw-bold text-white">
+                    404
+                </h1>
+                <!-- Text -->
+                <p class="lead text-white-75 mb-4">
+                    Whoops, we can't find this page? Did it link from somewhere? Please let us know so we can fix it.
+                </p>
+            </div>
+        </div>
+    </div>
+</section>
diff --git a/Gemfile.lock b/Gemfile.lock
@@ -45,8 +45,14 @@ GEM
       rb-fsevent (~> 0.10, >= 0.10.3)
       rb-inotify (~> 0.9, >= 0.9.10)
     mercenary (0.4.0)
+    mini_portile2 (2.7.1)
+    nokogiri (1.13.1)
+      mini_portile2 (~> 2.7.0)
+      racc (~> 1.4)
     nokogiri (1.13.1-arm64-darwin)
       racc (~> 1.4)
+    nokogiri (1.13.1-x86_64-darwin)
+      racc (~> 1.4)
     pathutil (0.16.2)
       forwardable-extended (~> 2.6)
     public_suffix (4.0.6)
@@ -66,6 +72,8 @@ GEM
 
 PLATFORMS
   arm64-darwin-21
+  ruby
+  x86_64-darwin-19
 
 DEPENDENCIES
   jekyll (~> 4.2)

diff --git a/_config.yml b/_config.yml
@@ -34,8 +34,10 @@ toc:
 # SPECIFIC SETTINGS FOR THE DOCS
 # ALSO SEE THE README FILE
 ###
-weaviate_version: v1.10.1 # the current and latest version
+weaviate_version: v1.11.0 # the current and latest version
 weaviate_versions: # order the versions how you want them displayed
+  "v1.11.0":
+    helm_version: 14.2.0 # Helm version for this Weaviate version
   "v1.10.1":
     helm_version: 14.2.0 # Helm version for this Weaviate version
   "v1.9.0":
@@ -62,6 +64,40 @@ weaviate_versions: # order the versions how you want them displayed
     helm_version: 11.0.0 # Helm version for this Weaviate version
 docs:
     weaviate:
+        'v1.11.0':
+            - name: Getting started
+              folder: getting-started
+              header: false
+            - name: Architecture
+              folder: architecture
+              header: false
+            - name: Configuration
+              folder: configuration
+              header: false
+            - name: Vector Index (ANN) Plugins
+              folder: vector-index-plugins
+              header: false
+            - name: Modules
+              folder: modules
+              header: false
+            - name: Client libraries & CLI
+              folder: client-libraries
+              header: false
+            - name: Data schema
+              folder: data-schema
+              header: false
+            - name: RESTful API references
+              folder: restful-api-references
+              header: false
+            - name: GraphQL references
+              folder: graphql-references
+              header: false
+            - name: More resources
+              folder: more-resources
+              header: false
+            - name: Tutorials
+              folder: tutorials
+              header: true
         'v1.10.1':
             - name: Getting started
               folder: getting-started

diff --git a/_data/integrations.yml b/_data/integrations.yml
@@ -0,0 +1,22 @@
+---
+- name: OpenAI Embeddings
+  website: https://beta.openai.com/docs/guides/embeddings
+  description: OpenAI has made both the power of GPT-3 available through their Embeddings API as well as their CLIP <code>multi2vec</code> model. Both the Embeddings API and the CLIP model are integrated directly into Weaviate and can be used to vectorize and search through your text data objects, images, or code.
+  image: /img/openai.svg
+  type: embeddings
+- name: Huggingface Transformers
+  website: https://huggingface.co/models
+  description: Huggingface hosts a wide variety of transformer models, and all models can be used as vectorizers or for other use cases (like Q&A, named entity recognition, and more) in Weaviate. The Weaviate transformers module comes with a wide variety of best-performing models out-of-the-box but can also be easily extended with your own, fine-tuned models. 
+  image: /img/huggingface.png
+  type: embeddings
+- name: deepset's Haystack
+  website: https://www.deepset.ai/weaviate-vector-search-engine-integration
+  description: deepset's Haystack is an open source NLP framework that leverages Transformer models. It enables developers to implement production-ready semantic search, question answering, information retrieval, summarization and more for a wide range of applications. Weaviate can be used in combination with Haystack to store large amounts of vectorized data.
+  image: /img/deepset.png
+  type: NLP framework
+- name: DocArray from Jina AI
+  website: https://docarray.jina.ai/advanced/document-store/weaviate/
+  description: DocArray (from Jina AI) is a library for nested, unstructured data in transit, including text, image, audio, video, 3D mesh, etc. It allows deep-learning engineers to efficiently process, embed, search, recommend, store, and transfer the data with a Pythonic API. Weaviate can be used in combination with DocArray to store large amounts of vectorized data.
+  image: /img/jina_logo.svg
+  type: neural search framework
+...
diff --git a/_data/podcasts.yml b/_data/podcasts.yml
@@ -1,4 +1,29 @@
 ---
+- title: >
+    Yury Malkov co-author of HNSW • HNSW in Vector Search and Weaviate
+  description: > 
+    At the heart of Weaviate sits HNSW, the ANN algorithm that brings the vector search engine to life! Check out this amazing podcast about the science and engineering behind it.
+  youtube: WijYx9_Bpkw
+  date: 2022-03-10T00:00:00Z
+  cover_image: '/img/podcasts/podcast-10.jpg'
+  is_use_case: false
+- title: >
+    Karen Beckers of Squadra • vector search in eCommerce
+  description: > 
+    Karen Beckers, Data Scientist from Squadra Machine Learning Company, gives insightful information about how to use vector search in eCommerce.
+  youtube: brUP1OEtQ5U
+  date: 2022-03-03T00:00:00Z
+  cover_image: '/img/podcasts/podcast-9.jpg'
+  is_use_case: true
+  logo: '/img/squadra.png'
+- title: >
+    Brady Neal of Oogway • Causal Inference in Vector Search
+  description: > 
+    Brady Neal from Oogway talks with Connor Shorten from Henry AI Labs about causal inference and many more. See the timestamps below to check out what this podcast is all about. 
+  youtube: t7g9s1GWcB8
+  date: 2022-02-28T00:00:00Z
+  cover_image: '/img/podcasts/podcast-8.jpg'
+  is_use_case: false
 - title: >
     Arvind Neelakantan of OpenAI • Embeddings API in Weaviate
   description: > 
@@ -59,4 +84,4 @@
   date: 2021-12-05T00:00:00Z
   cover_image: '/img/podcasts/podcast-1.jpg'
   is_use_case: false
-...
+...
diff --git a/_data/resources.yml b/_data/resources.yml
@@ -1,10 +1,50 @@
 ---
+- title: >
+    "Database technology evolves to combine machine learning and data storage"
+  date: 2022-03-07T00:00:01Z
+  cover_image: https://venturebeat.com/wp-content/uploads/2022/01/GettyImages-1350722251-e1644354952407.jpg?w=1200&amp;strip=all
+  description: > 
+    Article about vector search and Weaviate in VentureBeat
+  source: venturebeat
+  link: https://venturebeat.com/2022/03/07/database-technology-evolves-to-combine-machine-learning-and-data-storage/
+  tags:
+  - news
+- title: >
+    "Weaviate accepted for the Google Summer of Code 2022"
+  date: 2022-03-07T00:00:00Z
+  cover_image: /img/og/og-gsoc.jpg
+  description: > 
+    Weaviate is accepted for this year's Google Summer of Code
+  source: GSoC
+  link: /resources/gsoc.html
+  tags:
+  - news
+- title: >
+    "SeMI Technologies’ search engine opens up new ways to query your data"
+  date: 2022-02-22T00:00:02Z
+  cover_image: https://upload.wikimedia.org/wikipedia/commons/b/b9/TechCrunch_logo.svg
+  description: > 
+    Check out this Techcrunch article that features SeMI's Series-A investment
+  source: techcrunch
+  link: https://techcrunch.com/2022/02/22/semi-technologies-search-engine-data/
+  tags:
+  - news
+- title: >
+    "SeMI Technologies' $16M Series A Round Highlights a New Wave of AI-first Database Tech"
+  date: 2022-02-22T00:00:01Z
+  cover_image: https://upload.wikimedia.org/wikipedia/commons/8/8f/Yahoo%21_Finance_logo_2021.png
+  description: > 
+    Press release of SeMI's Series-A investment
+  source: yahoo-finance
+  link: https://finance.yahoo.com/news/semi-technologies-16m-series-round-141500875.html
+  tags:
+  - press-release
 - title: >
     Weaviate: Towards the New Era of Vector Search Engines
   date: 2022-02-03T00:00:00Z
   cover_image: https://cdn.analyticsvidhya.com/wp-content/uploads/2021/12/732227807104_1578230927_time_analysis_tittle-banner-1.jpg
   description: > 
-    Check out this Techcrunch article that features Weaviate and in the section: How to get coverage for your company. And, vector search.
+    Community article about vector search engines like Weaviate
   source: analyticsvidhya
   link: https://www.analyticsvidhya.com/blog/2022/02/weaviate-towards-the-new-era-of-vector-search-engines/
   tags:

diff --git a/_includes/code/1.x/graphql.filters.where.id.html b/_includes/code/1.x/graphql.filters.where.id.html
@@ -120,7 +120,7 @@
       Article(where: {
           path: [\"id\"],
           operator: Equal,
-          valueString: "e5dc4a4c-ef0f-3aed-89a3-a73435c6bbcf"
+          valueString: \"e5dc4a4c-ef0f-3aed-89a3-a73435c6bbcf\"
         }) {
         title
       }

diff --git a/_includes/code/1.x/qna-transformers.ask.html b/_includes/code/1.x/qna-transformers.ask.html
@@ -37,7 +37,7 @@
   "properties": ["summary"]
 }
 
-client.query.get("Article", ["title", "_additional {hasAnswer certainty property result startPosition endPosition}"]).with_ask(ask).with_limit(1).do()
+client.query.get("Article", ["title", "_additional {answer {hasAnswer certainty property result startPosition endPosition} }"]).with_ask(ask).with_limit(1).do()
 
 {% endcapture %}
 

diff --git a/_includes/code/1.x/spellcheck-module.html b/_includes/code/1.x/spellcheck-module.html
@@ -104,7 +104,7 @@
 
 String fields = "title _additional {spellCheck { change {corrected original} didYouMean location originalText}}";
 NearTextArgument explore = client.graphQL().arguments().nearTextArgBuilder()
-            .concepts([]string{"houssing prices"})
+            .concepts(new String[]{"houssing prices"})
             .build();
 
 Result<GraphQLResponse> result = client.graphQL().get()
@@ -151,4 +151,4 @@
 {% endcapture %}
 
 <!-- SET BLOCK_ID TO A UNIQUE ID, OFTEN THIS IS = TO THE FILENAME WHERE . == - -->
-{% include molecule-graphql-block-request.html block_id='spellcheck-module' %}
+{% include molecule-graphql-block-request.html block_id='spellcheck-module' %}
diff --git a/_includes/docs-support-links.html b/_includes/docs-support-links.html
@@ -1,7 +1,7 @@
 If you can't find the answer to your question here, please look at the:
 
 {% if page.solution == 'weaviate' %}
-0. [Frequently Asked Questions](../more-resources/faq.html). Or,
+0. [Frequently Asked Questions](https://weaviate.io/developers/weaviate/current/more-resources/faq.html). Or,
 0. [Knowledge base of old issues](https://github.com/semi-technologies/weaviate/issues?utf8=%E2%9C%93&q=label%3Abug). Or,
 0. For questions: [Stackoverflow](https://stackoverflow.com/questions/tagged/weaviate). Or,
 0. For issues: [Github](//github.com/semi-technologies/weaviate/issues). Or,

diff --git a/_includes/docs-toc.html b/_includes/docs-toc.html
@@ -3,7 +3,11 @@
 
     <!-- edit on GH -->
     <p>
-      <a class="btn btn-info btn-xs mt-3" href="https://github.com/semi-technologies/weaviate-io/tree/main{{ page.url | replace:'.html','.md' }}" role="button" target="_blank">Edit page on Github</a>
+      {% if page.url contains '.html' %}
+        <a class="btn btn-info btn-xs mt-3" href="https://github.com/semi-technologies/weaviate-io/tree/main{{ page.url | replace:'.html','.md' }}" role="button" target="_blank">Edit on Github</a>
+      {% else %}
+        <a class="btn btn-info btn-xs mt-3" href="https://github.com/semi-technologies/weaviate-io/tree/main{{ page.url }}/index.md" role="button" target="_blank">Edit on Github</a>
+      {% endif %}
     </p>
 
     <!-- Heading -->