Code

Website Updates for 2.4.0#1126

Code

Merged

chakravarthik27 merged 118 commits intogh-pagesJohnSnowLabs/langtest:gh-pagesfrom mainJohnSnowLabs/langtest:mainCopy head branch name to clipboardSep 23, 2024

+4,391-552

Commits

Commits on Jul 25, 2024

• Refactor NERSample.is_pass() to handle cases where either aligned span has entity "O"

  chakravarthik27

  committed
  c2b1393

  Copy full SHA for c2b1393

• format issues

  chakravarthik27

  committed
  ea48e1f

  Copy full SHA for ea48e1f

• Merge pull request #1080 from JohnSnowLabs/bug/nersample-transformation-data-lost-during-testcase-import-process

  Show description for beb0d31
  chakravarthik27

  authored
  beb0d31

  Copy full SHA for beb0d31

Commits on Aug 5, 2024

• resolved: recovering the transformation object.

  chakravarthik27

  committed
  52b81f2

  Copy full SHA for 52b81f2

• removed the unused imports

  chakravarthik27

  committed
  1c0112e

  Copy full SHA for 1c0112e

• chore: Recover transformation object and apply to NER task test cases

  chakravarthik27

  committed
  3229bd2

  Copy full SHA for 3229bd2

• resolved: unknown args

  chakravarthik27

  committed
  e42f282

  Copy full SHA for e42f282

• chore: Refactor CSVDataset to handle missing or invalid transformations

  chakravarthik27

  committed
  f195d1f

  Copy full SHA for f195d1f

• Merge pull request #1081 from JohnSnowLabs/bug/nersample-transformation-data-lost-during-testcase-import-process

  Show description for d155f20
  chakravarthik27

  authored
  d155f20

  Copy full SHA for d155f20

Commits on Aug 13, 2024

• fixed: consistent issues while generated templates in templatic augmentation.

  chakravarthik27

  committed
  82f8b87

  Copy full SHA for 82f8b87

• resolved: lint and format issues.

  chakravarthik27

  committed
  a47156d

  Copy full SHA for a47156d

Commits on Aug 14, 2024

• fixed: transformed and add export types are supported in DataAugumenter

  chakravarthik27

  committed
  92cd12c

  Copy full SHA for 92cd12c

• fixed: inplace method in DataAugmenter with proper proportion.

  chakravarthik27

  committed
  712d4d6

  Copy full SHA for 712d4d6

• update doc strings and remove the print statements.

  chakravarthik27

  committed
  fd2333d

  Copy full SHA for fd2333d

• Merge pull request #1085 from JohnSnowLabs/fix/augmentation-config-varies-even-when-no-transformations-are-applied

  Show description for fa7e3cf
  chakravarthik27

  authored
  fa7e3cf

  Copy full SHA for fa7e3cf

Commits on Aug 15, 2024

• chore: generate additional templates in TemplaticAugment as user choice to number of extra templates to be needed

  chakravarthik27

  committed
  526ae6f

  Copy full SHA for 526ae6f

• chore: remove quotes in generated template and self check the num_extra_templates.

  chakravarthik27

  committed
  8185a90

  Copy full SHA for 8185a90

• Merge pull request #1089 from JohnSnowLabs/fix/augmentation-config-varies-even-when-no-transformations-are-applied

  Show description for f377ff0
  chakravarthik27

  authored
  f377ff0

  Copy full SHA for f377ff0

Commits on Aug 16, 2024

• chore: Fix error message in Augmentation when generating templates

  chakravarthik27

  committed
  6734f70

  Copy full SHA for 6734f70

• chore: Refactor DataAugmenter to improve template generation and proportion handling

  chakravarthik27

  committed
  55d17e1

  Copy full SHA for 55d17e1

• Refactor DataAugmenter to improve proportion handling

  chakravarthik27

  committed
  b7f68c1

  Copy full SHA for b7f68c1

• Merge pull request #1090 from JohnSnowLabs/fix/augmentation-config-varies-even-when-no-transformations-are-applied

  Show description for 64475eb
  chakravarthik27

  authored
  64475eb

  Copy full SHA for 64475eb

Commits on Aug 26, 2024

• Refactor TemplaticAugment to support multiple AI providers for template generation

  chakravarthik27

  committed
  24be4be

  Copy full SHA for 24be4be

Commits on Aug 27, 2024

• Integrated Azure OpenAI and OpenAI services for automated template generation.

  chakravarthik27

  committed
  4d866f2

  Copy full SHA for 4d866f2

• added comment for "azoi means Azue OpenAI"

  chakravarthik27

  committed
  d04d500

  Copy full SHA for d04d500

Commits on Aug 28, 2024

• updated the model_config handling.

  chakravarthik27

  committed
  29d136e

  Copy full SHA for 29d136e

Commits on Aug 29, 2024

• changed: logging to logger from langtest

  chakravarthik27

  committed
  cccb562

  Copy full SHA for cccb562

Commits on Sep 2, 2024

• added: doc lines

  chakravarthik27

  committed
  85d7e70

  Copy full SHA for 85d7e70

• Merge pull request #1091 from JohnSnowLabs/fix/augmentation-config-varies-even-when-no-transformations-are-applied

  Show description for cc821c9
  chakravarthik27

  authored
  cc821c9

  Copy full SHA for cc821c9

• implemented: basic version to handling document wise.

  chakravarthik27

  committed
  6887233

  Copy full SHA for 6887233

Commits on Sep 3, 2024

• implemented: text-classification support for multi-label classification.

  chakravarthik27

  committed
  df7776e

  Copy full SHA for df7776e

• Refactor SequenceClassificationOutputFormatter to handle multi-label predictions

  chakravarthik27

  committed
  2da96b7

  Copy full SHA for 2da96b7

• Refactor CSVDataset to remove unnecessary transformation field

  chakravarthik27

  committed
  16fee46

  Copy full SHA for 16fee46

• feat: Add pos_tag and chunk_tag to ConllDataset token creation in doc_wise.

  chakravarthik27

  committed
  beec9c3

  Copy full SHA for beec9c3

• fixed: Unbound Error and Key Error.

  chakravarthik27

  committed
  258a0f7

  Copy full SHA for 258a0f7

• Merge pull request #1096 from JohnSnowLabs/feature/add-support-for-the-multi-label-classification-model

  Show description for 23eb0c3
  chakravarthik27

  authored
  23eb0c3

  Copy full SHA for 23eb0c3

Commits on Sep 4, 2024

• Merge pull request #1097 from JohnSnowLabs/patch/2.3.1

  Show description for f2f3cc0
  ArshaanNazir

  authored
  f2f3cc0

  Copy full SHA for f2f3cc0

• chore: update pyproject.toml version to 2.3.1

  chakravarthik27

  committed
  72eba73

  Copy full SHA for 72eba73

• Merge pull request #1098 from JohnSnowLabs/patch/2.3.1

  Show description for 5b1c284
  chakravarthik27

  authored
  5b1c284

  Copy full SHA for 5b1c284

Commits on Sep 9, 2024

• chore: update DataAugmenter to support generating JSON output for NER samples in GEN AI LAB tool

  chakravarthik27

  committed
  dd588cb

  Copy full SHA for dd588cb

• Refactor: the save method in the DataAugmenter class to handle the file_path validation correctly and improve the overall code clarity and maintainability.

  chakravarthik27

  committed
  12934cd

  Copy full SHA for 12934cd

• Merge pull request #1100 from JohnSnowLabs/feature/add-json-output-for-ner-sample-to-support-generative-ai-lab

  Show description for 97bee72
  chakravarthik27

  authored
  97bee72

  Copy full SHA for 97bee72

• Merge pull request #1101 from JohnSnowLabs/patch/2.3.1

  Show description for 78cb31f
  chakravarthik27

  authored
  78cb31f

  Copy full SHA for 78cb31f

Commits on Sep 10, 2024

• Refactor ConllDataset token creation in doc_wise

  chakravarthik27

  committed
  2eb72a3

  Copy full SHA for 2eb72a3

• Refactor NEROutputFormatter to add newline character after each sentence

  chakravarthik27

  committed
  aef1352

  Copy full SHA for aef1352

• fixed: linting issues

  chakravarthik27

  committed
  6a8aae3

  Copy full SHA for 6a8aae3

• Refactor NEROutputFormatter to handle newline characters in sample predictions

  chakravarthik27

  committed
  3111017

  Copy full SHA for 3111017

• fixed: issue with doc_wise parameter for another task.

  chakravarthik27

  committed
  6759417

  Copy full SHA for 6759417

Commits on Sep 11, 2024

• fixed: doc_wise issue in harness import_testcases method.

  chakravarthik27

  committed
  84040b6

  Copy full SHA for 84040b6

• Merge remote-tracking branch 'origin/patch/2.3.1' into enhance/document-wise-data-processing-in-conlldataset

  chakravarthik27

  committed
  3927b24

  Copy full SHA for 3927b24

• fixed: module error while importing harness.

  chakravarthik27

  committed
  5598359

  Copy full SHA for 5598359

• updated: build and test support for patch branches

  chakravarthik27

  committed
  e312032

  Copy full SHA for e312032

• Merge pull request #1094 from JohnSnowLabs/enhance/document-wise-data-processing-in-conlldataset

  Show description for f1fbdc1
  chakravarthik27

  authored
  f1fbdc1

  Copy full SHA for f1fbdc1

• Merge pull request #1102 from JohnSnowLabs/fix/module_error-with-openai-package

  Show description for 4448c71
  chakravarthik27

  authored
  4448c71

  Copy full SHA for 4448c71

• Refactor split method in robustness.py to split on space character explicitly

  chakravarthik27

  committed
  134de82

  Copy full SHA for 134de82

• Merge pull request #1103 from JohnSnowLabs/patch/2.3.1

  Show description for b35c28a
  chakravarthik27

  authored
  b35c28a

  Copy full SHA for b35c28a

Commits on Sep 14, 2024

• Added: implemeted the breaking sentence by newline in robustness.

  chakravarthik27

  committed
  f331b69

  Copy full SHA for f331b69

• refactor the add_new_lines and while random selection of number of new lines.

  chakravarthik27

  committed
  f274765

  Copy full SHA for f274765

• parameter: number_of_lines -> max_lines.

  chakravarthik27

  committed
  0414f71

  Copy full SHA for 0414f71

• Merge pull request #1109 from JohnSnowLabs/feature/implement-the-addnewlines-test-in-robustness-category

  Show description for a3986b4
  chakravarthik27

  authored
  a3986b4

  Copy full SHA for a3986b4

• Implemented the add_tabs test in robustness category

  chakravarthik27

  committed
  3160b1d

  Copy full SHA for 3160b1d

• Merge remote-tracking branch 'origin/release/2.4.0' into feature/implement-the-addtabs-test-in-robustness-category

  chakravarthik27

  committed
  8179145

  Copy full SHA for 8179145

• implemented: basic structured to handle visualQA

  chakravarthik27

  committed
  c8a9511

  Copy full SHA for c8a9511

• Refactor VisualQASample class to include additional attributes and documentation

  chakravarthik27

  committed
  f7b53e6

  Copy full SHA for f7b53e6

• Refactor llm_modelhandler.py to include PretrainedModelForVisualQA class

  chakravarthik27

  committed
  6eec7ca

  Copy full SHA for 6eec7ca

• Refactor VisualQA class to fix typo in base class name

  chakravarthik27

  committed
  b95ecf3

  Copy full SHA for b95ecf3

Commits on Sep 15, 2024

• Merge pull request #1110 from JohnSnowLabs/feature/implement-the-addtabs-test-in-robustness-category

  Show description for ca2f9d6
  chakravarthik27

  authored
  ca2f9d6

  Copy full SHA for ca2f9d6

• Merge remote-tracking branch 'origin/release/2.4.0' into feature/implement-the-support-for-multimodal-with-new-vqa-task

  chakravarthik27

  committed
  adf18db

  Copy full SHA for adf18db

• updated: image handling while loading dataset.

  chakravarthik27

  committed
  d3e6fa5

  Copy full SHA for d3e6fa5

• implemented the different tests under robusntess category and supported upto generating testcases.

  chakravarthik27

  committed
  3ee5f8f

  Copy full SHA for 3ee5f8f

• Refactor image handling in robustness tests

  chakravarthik27

  committed
  3dd6770

  Copy full SHA for 3dd6770

• Refactor image handling in robustness tests and add support for multimodal VQA task

  chakravarthik27

  committed
  d95e558

  Copy full SHA for d95e558

• Refactor image handling in robustness tests and update VisualQASample class

  chakravarthik27

  committed
  ebd7bfd

  Copy full SHA for ebd7bfd

• Refactor image handling in robustness tests and exclude image-related perturbations

  chakravarthik27

  committed
  4538490

  Copy full SHA for 4538490

• fixed: format issues.

  chakravarthik27

  committed
  41f0db2

  Copy full SHA for 41f0db2

Commits on Sep 16, 2024

• Refactor image handling in robustness tests and remove commented code

  chakravarthik27

  committed
  3521927

  Copy full SHA for 3521927

• Refactor image handling in robustness tests and update VisualQASample class for huggingface DataSource.

  chakravarthik27

  committed
  a87e96c

  Copy full SHA for a87e96c

• - added new tests in image robustness.

  chakravarthik27

  committed
  04e18e3

  Copy full SHA for 04e18e3

• Add pillow library to pyproject.toml

  chakravarthik27

  committed
  8039ef8

  Copy full SHA for 8039ef8

• Update transformers version to 4.44.2

  chakravarthik27

  committed
  febf855

  Copy full SHA for febf855

• Update transformers version to 4.43.1

  chakravarthik27

  committed
  101305a

  Copy full SHA for 101305a

• Update pyproject.toml to force CPU installation of torch

  chakravarthik27

  committed
  96cc4f1

  Copy full SHA for 96cc4f1

• Update accelerate version to 0.22.0

  chakravarthik27

  committed
  d64312d

  Copy full SHA for d64312d

• Update accelerate version to 0.33.0 and pyproject.toml to force CPU installation of torch

  chakravarthik27

  committed
  4780cf0

  Copy full SHA for 4780cf0

• Now handles the multi-label in accuracy tests.

  chakravarthik27

  committed
  0c7c9b0

  Copy full SHA for 0c7c9b0

• Refactor accuracy tests to handle multi-label classification

  chakravarthik27

  committed
  54f235d

  Copy full SHA for 54f235d

• Update mlflow version to 2.16.1 and add openpyxl and tables dependencies

  chakravarthik27

  committed
  a04eba6

  Copy full SHA for a04eba6

• Merge pull request #1114 from JohnSnowLabs/fix/error-in-accuracy-tests-for-multi-label-classification

  chakravarthik27

  authored
  9f7f73e

  Copy full SHA for 9f7f73e

Commits on Sep 17, 2024

• Update pydantic version to 1.10.11

  chakravarthik27

  committed
  ac652cf

  Copy full SHA for ac652cf

• Update transformers version to 4.44.2 and mlflow version to 2.16.2

  chakravarthik27

  committed
  2d0f0d8

  Copy full SHA for 2d0f0d8

• Refactor calculate_f1_score function to handle different types of y_true and y_pred

  chakravarthik27

  committed
  3745e6a

  Copy full SHA for 3745e6a

• formatted.

  chakravarthik27

  committed
  bcdfc92

  Copy full SHA for bcdfc92

• Merge pull request #1116 from JohnSnowLabs/fix/error-in-accuracy-tests-for-ner-task

  Show description for b0a1a26
  chakravarthik27

  authored
  b0a1a26

  Copy full SHA for b0a1a26

• Merge pull request #1112 from JohnSnowLabs/update/fixing-security-issues

  Show description for d3a4663
  chakravarthik27

  authored
  d3a4663

  Copy full SHA for d3a4663

• Merge remote-tracking branch 'origin/release/2.4.0' into feature/implement-the-support-for-multimodal-with-new-vqa-task

  chakravarthik27

  committed
  a5ae26a

  Copy full SHA for a5ae26a

• Refactor security.py to add new security checks

  chakravarthik27

  committed
  10aa4b3

  Copy full SHA for 10aa4b3

• resolve OutofMemory issues

  chakravarthik27

  committed
  b29f9dd

  Copy full SHA for b29f9dd

• updated the notebook

  chakravarthik27

  committed
  16a3aa5

  Copy full SHA for 16a3aa5

• Update pillow version to 10.0.0 and make it a required dependency

  chakravarthik27

  committed
  b337d2b

  Copy full SHA for b337d2b

• Merge pull request #1111 from JohnSnowLabs/feature/implement-the-support-for-multimodal-with-new-vqa-task

  Show description for 67c641d
  chakravarthik27

  authored
  67c641d

  Copy full SHA for 67c641d

Commits on Sep 18, 2024

• Refactor typing imports in accuracy.py and safety.py

  chakravarthik27

  committed
  62b77b1

  Copy full SHA for 62b77b1

• Refactor prepare_model_response method to handle multi-label classification in text-classification task and predictions in ner task

  chakravarthik27

  committed
  409cb96

  Copy full SHA for 409cb96

• fixed: circular import errors

  chakravarthik27

  committed
  d98a9d3

  Copy full SHA for d98a9d3

• Refactor test type in safety.py and add decimal formatting in output.py

  chakravarthik27

  committed
  7a58067

  Copy full SHA for 7a58067

• Refactor multi-label handling in TestResultManager

  chakravarthik27

  committed
  5e482e1

  Copy full SHA for 5e482e1

• fixed: formatted issue

  chakravarthik27

  committed
  e9c54e9

  Copy full SHA for e9c54e9

• Merge pull request #1118 from JohnSnowLabs/fix/error-in-accuracy-tests-for-multi-label-classification

  Show description for 4664bbf
  chakravarthik27

  authored
  4664bbf

  Copy full SHA for 4664bbf

Commits on Sep 19, 2024

• Refactor PromptGuard class and related modules

  Show description for a90c932
  chakravarthik27

  committed
  a90c932

  Copy full SHA for a90c932

• Refactor fairness test to handle multi-label classification in text classification task and predictions in ner task

  chakravarthik27

  committed
  092b3e9

  Copy full SHA for 092b3e9

• fixed: format and liniting issues.

  chakravarthik27

  committed
  f362a62

  Copy full SHA for f362a62

• Merge pull request #1121 from JohnSnowLabs/fix/error-in-fairness-tests-for-multi-label-classification

  Show description for 7e2b232
  chakravarthik27

  authored
  7e2b232

  Copy full SHA for 7e2b232

• Merge pull request #1119 from JohnSnowLabs/feature/enhance-security-tests-with-promptguard

  Show description for d89477a
  chakravarthik27

  authored
  d89477a

  Copy full SHA for d89477a

• Refactor security.py: Remove unused classes and methods

  chakravarthik27

  committed
  da9f58b

  Copy full SHA for da9f58b

Commits on Sep 20, 2024

• update version to 2.4.0 in pyproject.toml for release

  chakravarthik27

  committed
  90e902f

  Copy full SHA for 90e902f

• jailbreak and injection tests supports for text-classification.

  chakravarthik27

  committed
  551cc12

  Copy full SHA for 551cc12

Commits on Sep 22, 2024

• Merge pull request #1122 from JohnSnowLabs/release/2.4.0

  Show description for 1b9c7db
  chakravarthik27

  authored
  1b9c7db

  Copy full SHA for 1b9c7db

Commits on Sep 23, 2024

• Add new tests for text classification and prompt evaluation tutorials

  chakravarthik27

  committed
  a2580ba

  Copy full SHA for a2580ba

• Merge pull request #1123 from JohnSnowLabs/chore/final_website_updates

  Show description for 833bbaf
  chakravarthik27

  authored
  833bbaf

  Copy full SHA for 833bbaf