Code

[do not merge] Large scale#175

Code

Closed

ethanglaser wants to merge 120 commits intomainIntelPython/scikit-learn_bench:mainfrom

large-scaleIntelPython/scikit-learn_bench:large-scaleCopy head branch name to clipboard

Commits

Commits on Aug 30, 2024

• Creating branch for large scale measurements

  ethanglaser

  committed
  b3500dd

  Copy full SHA for b3500dd

Commits on Sep 18, 2024

• strong scaling, config updates, minor revisions

  ethanglaser

  committed
  4bd6c7f

  Copy full SHA for 4bd6c7f

• Merge branch 'IntelPython:large-scale' into large-scale

  ethanglaser

  authored
  984aab1

  Copy full SHA for 984aab1

Commits on Sep 21, 2024

• knn and forest config updates

  ethanglaser

  committed
  3cd955c

  Copy full SHA for 3cd955c

Commits on Sep 23, 2024

• lint

  md-shafiul-alam

  committed
  e39dc2b

  Copy full SHA for e39dc2b

• just gpu for regular

  md-shafiul-alam

  committed
  6e0fbf8

  Copy full SHA for 6e0fbf8

• juremove cuml

  md-shafiul-alam

  committed
  7bb8fb4

  Copy full SHA for 7bb8fb4

• Add incremental algorithms support

  olegkkruglov

  committed
  535c1e4

  Copy full SHA for 535c1e4

• Fix win yml

  olegkkruglov

  committed
  d6952ac

  Copy full SHA for d6952ac

• refactor and kmeans strong

  md-shafiul-alam

  committed
  9cf382e

  Copy full SHA for 9cf382e

• refactor and add config

  md-shafiul-alam

  committed
  6c8f529

  Copy full SHA for 6c8f529

• strong reduce nodes

  md-shafiul-alam

  committed
  3867a86

  Copy full SHA for 3867a86

• forest reg config

  md-shafiul-alam

  committed
  ed875b4

  Copy full SHA for ed875b4

• forest reg config

  md-shafiul-alam

  committed
  c596a56

  Copy full SHA for c596a56

• KNN weak

  md-shafiul-alam

  committed
  4fee991

  Copy full SHA for 4fee991

• KNN strong

  md-shafiul-alam

  committed
  fce0651

  Copy full SHA for fce0651

Commits on Sep 24, 2024

• experiment with ppn

  md-shafiul-alam

  committed
  e1ff9a0

  Copy full SHA for e1ff9a0

• experiment with ppn

  md-shafiul-alam

  committed
  e3d9a35

  Copy full SHA for e3d9a35

• bf16

  md-shafiul-alam

  committed
  817710b

  Copy full SHA for 817710b

• bf16

  md-shafiul-alam

  committed
  aaa0039

  Copy full SHA for aaa0039

• Remove samples/ms info

  olegkkruglov

  committed
  03a152a

  Copy full SHA for 03a152a

• knn

  md-shafiul-alam

  committed
  b7d962e

  Copy full SHA for b7d962e

• Remove BS from config (need to add after pip version update)

  olegkkruglov

  committed
  3ac5c23

  Copy full SHA for 3ac5c23

Commits on Sep 25, 2024

• basic stat single

  md-shafiul-alam

  committed
  87b6fa6

  Copy full SHA for 87b6fa6

• Add condition for finalize

  olegkkruglov

  committed
  9461fad

  Copy full SHA for 9461fad

• Fix num_batches usage

  olegkkruglov

  committed
  b82d772

  Copy full SHA for b82d772

• Creating branch for large scale measurements

  

  ethanglaser

  authored and

  olegkkruglov

  committed
  c70e122

  Copy full SHA for c70e122

• strong scaling, config updates, minor revisions

  

  ethanglaser

  authored and

  olegkkruglov

  committed
  8d74f6d

  Copy full SHA for 8d74f6d

• knn and forest config updates

  

  ethanglaser

  authored and

  olegkkruglov

  committed
  192744f

  Copy full SHA for 192744f

• lint

  

  md-shafiul-alam

  authored and

  olegkkruglov

  committed
  b1f2c15

  Copy full SHA for b1f2c15

• just gpu for regular

  

  md-shafiul-alam

  authored and

  olegkkruglov

  committed
  f3be737

  Copy full SHA for f3be737

• juremove cuml

  

  md-shafiul-alam

  authored and

  olegkkruglov

  committed
  ee8c74b

  Copy full SHA for ee8c74b

• Add metrics to list for proper report generation

  olegkkruglov

  committed
  93eae2f

  Copy full SHA for 93eae2f

Commits on Sep 26, 2024

• batch for online

  md-shafiul-alam

  committed
  574ff2a

  Copy full SHA for 574ff2a

• online vs spmd

  md-shafiul-alam

  committed
  da7f425

  Copy full SHA for da7f425

• spmd vs online fix

  md-shafiul-alam

  committed
  2377a9e

  Copy full SHA for 2377a9e

• batch vs online fix

  md-shafiul-alam

  committed
  3e4333e

  Copy full SHA for 3e4333e

• increase online data size

  md-shafiul-alam

  committed
  40ad9d5

  Copy full SHA for 40ad9d5

• batch vs online fix

  md-shafiul-alam

  committed
  894ed1d

  Copy full SHA for 894ed1d

• separate nodes

  md-shafiul-alam

  committed
  36c57c3

  Copy full SHA for 36c57c3

• minor

  md-shafiul-alam

  committed
  08f0aa8

  Copy full SHA for 08f0aa8

• dbscan

  md-shafiul-alam

  committed
  3302212

  Copy full SHA for 3302212

Commits on Sep 27, 2024

• config fixes

  md-shafiul-alam

  committed
  1779a9f

  Copy full SHA for 1779a9f

• config fix

  md-shafiul-alam

  committed
  4ac119e

  Copy full SHA for 4ac119e

• forest regression

  md-shafiul-alam

  committed
  902f0ec

  Copy full SHA for 902f0ec

• forest regression

  md-shafiul-alam

  committed
  d40389e

  Copy full SHA for d40389e

• forest regression

  md-shafiul-alam

  committed
  906de02

  Copy full SHA for 906de02

Commits on Oct 1, 2024

• kmeans and logreg update

  md-shafiul-alam

  committed
  7348b42

  Copy full SHA for 7348b42

Commits on Oct 2, 2024

• forest reg data same as cls

  md-shafiul-alam

  committed
  270c841

  Copy full SHA for 270c841

• knn bf16

  md-shafiul-alam

  committed
  d172d2a

  Copy full SHA for d172d2a

• cov regular prev

  md-shafiul-alam

  committed
  29ea288

  Copy full SHA for 29ea288

Commits on Oct 4, 2024

• add incremental

  md-shafiul-alam

  committed
  35282a0

  Copy full SHA for 35282a0

Commits on Oct 7, 2024

• Update logreg.json

  icfaust

  authored
  13c0514

  Copy full SHA for 13c0514

• Update ensemble.json

  icfaust

  authored
  8532908

  Copy full SHA for 8532908

• Update kmeans.json

  icfaust

  authored
  c3ac4bb

  Copy full SHA for c3ac4bb

• Update knn.json

  icfaust

  authored
  a8d898b

  Copy full SHA for a8d898b

• Update logreg.json

  icfaust

  authored
  fe90de2

  Copy full SHA for fe90de2

• Update pca.json

  icfaust

  authored
  7ab1cc3

  Copy full SHA for 7ab1cc3

• Update linear_model.json

  icfaust

  authored
  595a7ee

  Copy full SHA for 595a7ee

• dbscan large scale support and logreg details

  ethanglaser

  committed
  8025719

  Copy full SHA for 8025719

Commits on Oct 8, 2024

• reformat

  md-shafiul-alam

  committed
  fcaa907

  Copy full SHA for fcaa907

• knn bf16

  md-shafiul-alam

  committed
  a4653a1

  Copy full SHA for a4653a1

• add bf16 cases

  md-shafiul-alam

  committed
  4f65e1f

  Copy full SHA for 4f65e1f

• merge changes from root and add config updates

  ethanglaser

  committed
  105d203

  Copy full SHA for 105d203

• forest bf16

  md-shafiul-alam

  committed
  c852279

  Copy full SHA for c852279

• incremental

  md-shafiul-alam

  committed
  698d884

  Copy full SHA for 698d884

• spmd online

  md-shafiul-alam

  committed
  5592d31

  Copy full SHA for 5592d31

• fix

  md-shafiul-alam

  committed
  c47649a

  Copy full SHA for c47649a

Commits on Oct 10, 2024

• incremental spmd

  md-shafiul-alam

  committed
  687178b

  Copy full SHA for 687178b

• incremental spmd test

  md-shafiul-alam

  committed
  5c97aed

  Copy full SHA for 5c97aed

• incremental spmd

  md-shafiul-alam

  committed
  907b35a

  Copy full SHA for 907b35a

• incremental spmd

  md-shafiul-alam

  committed
  7ed0235

  Copy full SHA for 7ed0235

Commits on Oct 15, 2024

• rebase

  ethanglaser

  committed
  d732e0f

  Copy full SHA for d732e0f

• configs nearly finalized + minor job updates

  ethanglaser

  committed
  e68edd5

  Copy full SHA for e68edd5

Commits on Oct 16, 2024

• <=

  ethanglaser

  committed
  e834493

  Copy full SHA for e834493

• lint

  ethanglaser

  committed
  75f2f10

  Copy full SHA for 75f2f10

• Merge pull request #161 from ethanglaser/large-scale

  Show description for 9b70f7e
  ethanglaser

  authored
  9b70f7e

  Copy full SHA for 9b70f7e

• Update knn.json

  icfaust

  authored
  fdd32d1

  Copy full SHA for fdd32d1

• Update linear_model.json

  icfaust

  authored
  99fdb89

  Copy full SHA for 99fdb89

Commits on Oct 17, 2024

• minor

  md-shafiul-alam

  committed
  d419a01

  Copy full SHA for d419a01

Commits on Dec 12, 2024

• Merge branch 'main' into large-scale

  ethanglaser

  committed
  72dfdd2

  Copy full SHA for 72dfdd2

Commits on Mar 17, 2025

• Added updated configs.

  KateBlueSky

  committed
  fd59a64

  Copy full SHA for fd59a64

• Added shift.

  KateBlueSky

  committed
  985db07

  Copy full SHA for 985db07

• Added center box.

  KateBlueSky

  committed
  34a30c7

  Copy full SHA for 34a30c7

Commits on Mar 18, 2025

• Removed the inertia for Kmeans.

  KateBlueSky

  committed
  d47face

  Copy full SHA for d47face

• fixed config locations.

  KateBlueSky

  committed
  e617791

  Copy full SHA for e617791

• Updated configs.

  KateBlueSky

  committed
  00ac46d

  Copy full SHA for 00ac46d

• Moved large scale files.

  KateBlueSky

  committed
  f37f964

  Copy full SHA for f37f964

• Added line.

  KateBlueSky

  committed
  1c5552b

  Copy full SHA for 1c5552b

• Added large scale 2k parameters sample shift

  KateBlueSky

  committed
  dcfef94

  Copy full SHA for dcfef94

• Fixed imports.

  KateBlueSky

  committed
  4ba3fe4

  Copy full SHA for 4ba3fe4

• Updated format.

  KateBlueSky

  committed
  5c04a35

  Copy full SHA for 5c04a35

• Merge branch 'main' into large-scale

  ethanglaser

  committed
  72d65c1

  Copy full SHA for 72d65c1

• Added the math import.

  KateBlueSky

  committed
  af48e96

  Copy full SHA for af48e96

Commits on Mar 20, 2025

• Rolled back the accidental changes to the ranked_based distributed_split.

  KateBlueSky

  committed
  c7f38f4

  Copy full SHA for c7f38f4

• Updated large scale 2k parameters for the full 24576 tiles.

  KateBlueSky

  committed
  264701e

  Copy full SHA for 264701e

• Updated config files.

  KateBlueSky

  committed
  20419a9

  Copy full SHA for 20419a9

• cleaned up diff.

  KateBlueSky

  committed
  4e93858

  Copy full SHA for 4e93858

Commits on Mar 21, 2025

• Reformatted correctly.

  KateBlueSky

  committed
  428f3df

  Copy full SHA for 428f3df

• Fixed if else.

  KateBlueSky

  committed
  2f8c68b

  Copy full SHA for 2f8c68b

• Updated format.

  KateBlueSky

  committed
  816c6dc

  Copy full SHA for 816c6dc

• Added mpi4py

  KateBlueSky

  committed
  5d3bf52

  Copy full SHA for 5d3bf52

• Merge branch 'large-scale' of https://github.com/IntelPython/scikit-learn_bench into dev/large_scale_kmeans

  KateBlueSky

  committed
  edceece

  Copy full SHA for edceece

• fixed mpi4py

  KateBlueSky

  committed
  a937963

  Copy full SHA for a937963

• Rolled back mpi4py.

  KateBlueSky

  committed
  3809d17

  Copy full SHA for 3809d17

• Formatted file.

  KateBlueSky

  committed
  c128748

  Copy full SHA for c128748

• Removed environment from diff.

  KateBlueSky

  committed
  15db792

  Copy full SHA for 15db792

• initial alignment of configs to final results (#176)

  Show description for 30b0b80
  ethanglaser

  authored
  30b0b80

  Copy full SHA for 30b0b80

• Revert "Removed environment from diff."

  Show description for f0fccdd
  KateBlueSky

  committed
  f0fccdd

  Copy full SHA for f0fccdd

• Merged change from large-scale

  KateBlueSky

  committed
  548d824

  Copy full SHA for 548d824

• Removed extra code for sample_shift.

  KateBlueSky

  committed
  4d675ec

  Copy full SHA for 4d675ec

• Changes for sample_shift.

  KateBlueSky

  committed
  e8fbd0b

  Copy full SHA for e8fbd0b

• Updated sample shift.

  KateBlueSky

  committed
  a7cea17

  Copy full SHA for a7cea17

• Updated sample shift.

  KateBlueSky

  committed
  f3c2757

  Copy full SHA for f3c2757

• Removed extra code.

  KateBlueSky

  committed
  2ae3c39

  Copy full SHA for 2ae3c39

• Added comment for sample_shift.

  KateBlueSky

  committed
  39cc4f2

  Copy full SHA for 39cc4f2

• Added back in x_train in sample_shift.

  KateBlueSky

  committed
  3fc7c42

  Copy full SHA for 3fc7c42

• Updated description of sample_shift.

  KateBlueSky

  committed
  1bd5aa1

  Copy full SHA for 1bd5aa1

• Added predict back in.

  KateBlueSky

  committed
  06944c1

  Copy full SHA for 06944c1

Commits on Mar 22, 2025

• Merge pull request #174 from IntelPython/dev/large_scale_kmeans

  Show description for 2edb597
  KateBlueSky

  authored
  2edb597

  Copy full SHA for 2edb597