-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathout_cl
98 lines (98 loc) · 13.9 KB
/
out_cl
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
Requirement already satisfied: torch in ./venv/lib/python3.8/site-packages (from -r requirements.txt (line 1)) (2.0.1)
Requirement already satisfied: randomname in ./venv/lib/python3.8/site-packages (from -r requirements.txt (line 2)) (0.2.1)
Requirement already satisfied: transformers in ./venv/lib/python3.8/site-packages (from -r requirements.txt (line 3)) (4.29.2)
Requirement already satisfied: datasets in ./venv/lib/python3.8/site-packages (from -r requirements.txt (line 4)) (2.12.0)
Requirement already satisfied: sentencepiece in ./venv/lib/python3.8/site-packages (from -r requirements.txt (line 5)) (0.1.99)
Requirement already satisfied: wandb in ./venv/lib/python3.8/site-packages (from -r requirements.txt (line 6)) (0.15.3)
Requirement already satisfied: scikit-learn in ./venv/lib/python3.8/site-packages (from -r requirements.txt (line 7)) (1.2.2)
Requirement already satisfied: matplotlib in ./venv/lib/python3.8/site-packages (from -r requirements.txt (line 8)) (3.7.1)
Requirement already satisfied: accelerate in ./venv/lib/python3.8/site-packages (from -r requirements.txt (line 9)) (0.19.0)
Requirement already satisfied: nvidia-ml-py3 in ./venv/lib/python3.8/site-packages (from -r requirements.txt (line 10)) (7.352.0)
Requirement already satisfied: deepspeed in ./venv/lib/python3.8/site-packages (from -r requirements.txt (line 11)) (0.9.2)
Requirement already satisfied: nvidia-cublas-cu11==11.10.3.66; platform_system == "Linux" and platform_machine == "x86_64" in ./venv/lib/python3.8/site-packages (from torch->-r requirements.txt (line 1)) (11.10.3.66)
Requirement already satisfied: nvidia-nvtx-cu11==11.7.91; platform_system == "Linux" and platform_machine == "x86_64" in ./venv/lib/python3.8/site-packages (from torch->-r requirements.txt (line 1)) (11.7.91)
Requirement already satisfied: nvidia-cusparse-cu11==11.7.4.91; platform_system == "Linux" and platform_machine == "x86_64" in ./venv/lib/python3.8/site-packages (from torch->-r requirements.txt (line 1)) (11.7.4.91)
Requirement already satisfied: networkx in ./venv/lib/python3.8/site-packages (from torch->-r requirements.txt (line 1)) (3.1)
Requirement already satisfied: nvidia-curand-cu11==10.2.10.91; platform_system == "Linux" and platform_machine == "x86_64" in ./venv/lib/python3.8/site-packages (from torch->-r requirements.txt (line 1)) (10.2.10.91)
Requirement already satisfied: nvidia-cudnn-cu11==8.5.0.96; platform_system == "Linux" and platform_machine == "x86_64" in ./venv/lib/python3.8/site-packages (from torch->-r requirements.txt (line 1)) (8.5.0.96)
Requirement already satisfied: filelock in ./venv/lib/python3.8/site-packages (from torch->-r requirements.txt (line 1)) (3.12.0)
Requirement already satisfied: nvidia-cufft-cu11==10.9.0.58; platform_system == "Linux" and platform_machine == "x86_64" in ./venv/lib/python3.8/site-packages (from torch->-r requirements.txt (line 1)) (10.9.0.58)
Requirement already satisfied: jinja2 in ./venv/lib/python3.8/site-packages (from torch->-r requirements.txt (line 1)) (3.1.2)
Requirement already satisfied: sympy in ./venv/lib/python3.8/site-packages (from torch->-r requirements.txt (line 1)) (1.12)
Requirement already satisfied: nvidia-nccl-cu11==2.14.3; platform_system == "Linux" and platform_machine == "x86_64" in ./venv/lib/python3.8/site-packages (from torch->-r requirements.txt (line 1)) (2.14.3)
Requirement already satisfied: nvidia-cuda-nvrtc-cu11==11.7.99; platform_system == "Linux" and platform_machine == "x86_64" in ./venv/lib/python3.8/site-packages (from torch->-r requirements.txt (line 1)) (11.7.99)
Requirement already satisfied: typing-extensions in ./venv/lib/python3.8/site-packages (from torch->-r requirements.txt (line 1)) (4.6.1)
Requirement already satisfied: nvidia-cusolver-cu11==11.4.0.1; platform_system == "Linux" and platform_machine == "x86_64" in ./venv/lib/python3.8/site-packages (from torch->-r requirements.txt (line 1)) (11.4.0.1)
Requirement already satisfied: triton==2.0.0; platform_system == "Linux" and platform_machine == "x86_64" in ./venv/lib/python3.8/site-packages (from torch->-r requirements.txt (line 1)) (2.0.0)
Requirement already satisfied: nvidia-cuda-cupti-cu11==11.7.101; platform_system == "Linux" and platform_machine == "x86_64" in ./venv/lib/python3.8/site-packages (from torch->-r requirements.txt (line 1)) (11.7.101)
Requirement already satisfied: nvidia-cuda-runtime-cu11==11.7.99; platform_system == "Linux" and platform_machine == "x86_64" in ./venv/lib/python3.8/site-packages (from torch->-r requirements.txt (line 1)) (11.7.99)
Requirement already satisfied: fire in ./venv/lib/python3.8/site-packages (from randomname->-r requirements.txt (line 2)) (0.5.0)
Requirement already satisfied: huggingface-hub<1.0,>=0.14.1 in ./venv/lib/python3.8/site-packages (from transformers->-r requirements.txt (line 3)) (0.14.1)
Requirement already satisfied: tokenizers!=0.11.3,<0.14,>=0.11.1 in ./venv/lib/python3.8/site-packages (from transformers->-r requirements.txt (line 3)) (0.13.3)
Requirement already satisfied: requests in ./venv/lib/python3.8/site-packages (from transformers->-r requirements.txt (line 3)) (2.31.0)
Requirement already satisfied: tqdm>=4.27 in ./venv/lib/python3.8/site-packages (from transformers->-r requirements.txt (line 3)) (4.65.0)
Requirement already satisfied: regex!=2019.12.17 in ./venv/lib/python3.8/site-packages (from transformers->-r requirements.txt (line 3)) (2023.5.5)
Requirement already satisfied: pyyaml>=5.1 in ./venv/lib/python3.8/site-packages (from transformers->-r requirements.txt (line 3)) (6.0)
Requirement already satisfied: packaging>=20.0 in ./venv/lib/python3.8/site-packages (from transformers->-r requirements.txt (line 3)) (23.1)
Requirement already satisfied: numpy>=1.17 in ./venv/lib/python3.8/site-packages (from transformers->-r requirements.txt (line 3)) (1.24.3)
Requirement already satisfied: xxhash in ./venv/lib/python3.8/site-packages (from datasets->-r requirements.txt (line 4)) (3.2.0)
Requirement already satisfied: multiprocess in ./venv/lib/python3.8/site-packages (from datasets->-r requirements.txt (line 4)) (0.70.14)
Requirement already satisfied: dill<0.3.7,>=0.3.0 in ./venv/lib/python3.8/site-packages (from datasets->-r requirements.txt (line 4)) (0.3.6)
Requirement already satisfied: responses<0.19 in ./venv/lib/python3.8/site-packages (from datasets->-r requirements.txt (line 4)) (0.18.0)
Requirement already satisfied: pyarrow>=8.0.0 in ./venv/lib/python3.8/site-packages (from datasets->-r requirements.txt (line 4)) (12.0.0)
Requirement already satisfied: pandas in ./venv/lib/python3.8/site-packages (from datasets->-r requirements.txt (line 4)) (2.0.1)
Requirement already satisfied: aiohttp in ./venv/lib/python3.8/site-packages (from datasets->-r requirements.txt (line 4)) (3.8.4)
Requirement already satisfied: fsspec[http]>=2021.11.1 in ./venv/lib/python3.8/site-packages (from datasets->-r requirements.txt (line 4)) (2023.5.0)
Requirement already satisfied: setuptools in ./venv/lib/python3.8/site-packages (from wandb->-r requirements.txt (line 6)) (47.1.0)
Requirement already satisfied: sentry-sdk>=1.0.0 in ./venv/lib/python3.8/site-packages (from wandb->-r requirements.txt (line 6)) (1.24.0)
Requirement already satisfied: appdirs>=1.4.3 in ./venv/lib/python3.8/site-packages (from wandb->-r requirements.txt (line 6)) (1.4.4)
Requirement already satisfied: setproctitle in ./venv/lib/python3.8/site-packages (from wandb->-r requirements.txt (line 6)) (1.3.2)
Requirement already satisfied: pathtools in ./venv/lib/python3.8/site-packages (from wandb->-r requirements.txt (line 6)) (0.1.2)
Requirement already satisfied: protobuf!=4.21.0,<5,>=3.12.0; python_version < "3.9" and sys_platform == "linux" in ./venv/lib/python3.8/site-packages (from wandb->-r requirements.txt (line 6)) (4.23.1)
Requirement already satisfied: Click!=8.0.0,>=7.0 in ./venv/lib/python3.8/site-packages (from wandb->-r requirements.txt (line 6)) (8.1.3)
Requirement already satisfied: docker-pycreds>=0.4.0 in ./venv/lib/python3.8/site-packages (from wandb->-r requirements.txt (line 6)) (0.4.0)
Requirement already satisfied: psutil>=5.0.0 in ./venv/lib/python3.8/site-packages (from wandb->-r requirements.txt (line 6)) (5.9.5)
Requirement already satisfied: GitPython!=3.1.29,>=1.0.0 in ./venv/lib/python3.8/site-packages (from wandb->-r requirements.txt (line 6)) (3.1.31)
Requirement already satisfied: scipy>=1.3.2 in ./venv/lib/python3.8/site-packages (from scikit-learn->-r requirements.txt (line 7)) (1.10.1)
Requirement already satisfied: joblib>=1.1.1 in ./venv/lib/python3.8/site-packages (from scikit-learn->-r requirements.txt (line 7)) (1.2.0)
Requirement already satisfied: threadpoolctl>=2.0.0 in ./venv/lib/python3.8/site-packages (from scikit-learn->-r requirements.txt (line 7)) (3.1.0)
Requirement already satisfied: importlib-resources>=3.2.0; python_version < "3.10" in ./venv/lib/python3.8/site-packages (from matplotlib->-r requirements.txt (line 8)) (5.12.0)
Requirement already satisfied: fonttools>=4.22.0 in ./venv/lib/python3.8/site-packages (from matplotlib->-r requirements.txt (line 8)) (4.39.4)
Requirement already satisfied: kiwisolver>=1.0.1 in ./venv/lib/python3.8/site-packages (from matplotlib->-r requirements.txt (line 8)) (1.4.4)
Requirement already satisfied: pillow>=6.2.0 in ./venv/lib/python3.8/site-packages (from matplotlib->-r requirements.txt (line 8)) (9.5.0)
Requirement already satisfied: pyparsing>=2.3.1 in ./venv/lib/python3.8/site-packages (from matplotlib->-r requirements.txt (line 8)) (3.0.9)
Requirement already satisfied: python-dateutil>=2.7 in ./venv/lib/python3.8/site-packages (from matplotlib->-r requirements.txt (line 8)) (2.8.2)
Requirement already satisfied: cycler>=0.10 in ./venv/lib/python3.8/site-packages (from matplotlib->-r requirements.txt (line 8)) (0.11.0)
Requirement already satisfied: contourpy>=1.0.1 in ./venv/lib/python3.8/site-packages (from matplotlib->-r requirements.txt (line 8)) (1.0.7)
Requirement already satisfied: hjson in ./venv/lib/python3.8/site-packages (from deepspeed->-r requirements.txt (line 11)) (3.1.0)
Requirement already satisfied: ninja in ./venv/lib/python3.8/site-packages (from deepspeed->-r requirements.txt (line 11)) (1.11.1)
Requirement already satisfied: py-cpuinfo in ./venv/lib/python3.8/site-packages (from deepspeed->-r requirements.txt (line 11)) (9.0.0)
Requirement already satisfied: pydantic<2.0.0 in ./venv/lib/python3.8/site-packages (from deepspeed->-r requirements.txt (line 11)) (1.10.8)
Requirement already satisfied: wheel in ./venv/lib/python3.8/site-packages (from nvidia-cublas-cu11==11.10.3.66; platform_system == "Linux" and platform_machine == "x86_64"->torch->-r requirements.txt (line 1)) (0.40.0)
Requirement already satisfied: MarkupSafe>=2.0 in ./venv/lib/python3.8/site-packages (from jinja2->torch->-r requirements.txt (line 1)) (2.1.2)
Requirement already satisfied: mpmath>=0.19 in ./venv/lib/python3.8/site-packages (from sympy->torch->-r requirements.txt (line 1)) (1.3.0)
Requirement already satisfied: lit in ./venv/lib/python3.8/site-packages (from triton==2.0.0; platform_system == "Linux" and platform_machine == "x86_64"->torch->-r requirements.txt (line 1)) (16.0.5)
Requirement already satisfied: cmake in ./venv/lib/python3.8/site-packages (from triton==2.0.0; platform_system == "Linux" and platform_machine == "x86_64"->torch->-r requirements.txt (line 1)) (3.26.3)
Requirement already satisfied: termcolor in ./venv/lib/python3.8/site-packages (from fire->randomname->-r requirements.txt (line 2)) (2.3.0)
Requirement already satisfied: six in ./venv/lib/python3.8/site-packages (from fire->randomname->-r requirements.txt (line 2)) (1.16.0)
Requirement already satisfied: charset-normalizer<4,>=2 in ./venv/lib/python3.8/site-packages (from requests->transformers->-r requirements.txt (line 3)) (3.1.0)
Requirement already satisfied: certifi>=2017.4.17 in ./venv/lib/python3.8/site-packages (from requests->transformers->-r requirements.txt (line 3)) (2023.5.7)
Requirement already satisfied: urllib3<3,>=1.21.1 in ./venv/lib/python3.8/site-packages (from requests->transformers->-r requirements.txt (line 3)) (2.0.2)
Requirement already satisfied: idna<4,>=2.5 in ./venv/lib/python3.8/site-packages (from requests->transformers->-r requirements.txt (line 3)) (3.4)
Requirement already satisfied: pytz>=2020.1 in ./venv/lib/python3.8/site-packages (from pandas->datasets->-r requirements.txt (line 4)) (2023.3)
Requirement already satisfied: tzdata>=2022.1 in ./venv/lib/python3.8/site-packages (from pandas->datasets->-r requirements.txt (line 4)) (2023.3)
Requirement already satisfied: yarl<2.0,>=1.0 in ./venv/lib/python3.8/site-packages (from aiohttp->datasets->-r requirements.txt (line 4)) (1.9.2)
Requirement already satisfied: frozenlist>=1.1.1 in ./venv/lib/python3.8/site-packages (from aiohttp->datasets->-r requirements.txt (line 4)) (1.3.3)
Requirement already satisfied: multidict<7.0,>=4.5 in ./venv/lib/python3.8/site-packages (from aiohttp->datasets->-r requirements.txt (line 4)) (6.0.4)
Requirement already satisfied: async-timeout<5.0,>=4.0.0a3 in ./venv/lib/python3.8/site-packages (from aiohttp->datasets->-r requirements.txt (line 4)) (4.0.2)
Requirement already satisfied: attrs>=17.3.0 in ./venv/lib/python3.8/site-packages (from aiohttp->datasets->-r requirements.txt (line 4)) (23.1.0)
Requirement already satisfied: aiosignal>=1.1.2 in ./venv/lib/python3.8/site-packages (from aiohttp->datasets->-r requirements.txt (line 4)) (1.3.1)
Requirement already satisfied: gitdb<5,>=4.0.1 in ./venv/lib/python3.8/site-packages (from GitPython!=3.1.29,>=1.0.0->wandb->-r requirements.txt (line 6)) (4.0.10)
Requirement already satisfied: zipp>=3.1.0; python_version < "3.10" in ./venv/lib/python3.8/site-packages (from importlib-resources>=3.2.0; python_version < "3.10"->matplotlib->-r requirements.txt (line 8)) (3.15.0)
Requirement already satisfied: smmap<6,>=3.0.1 in ./venv/lib/python3.8/site-packages (from gitdb<5,>=4.0.1->GitPython!=3.1.29,>=1.0.0->wandb->-r requirements.txt (line 6)) (5.0.0)
Strategy = Random
Strategy = Min path
PHASE 2: Evaluating.
Evaluating min_path-tahoe-word/run_15...
PHASE 2: Evaluating.
Evaluating max_path-vicious-tree/run_15...