Skip to content
This repository has been archived by the owner on Jul 16, 2024. It is now read-only.

The error of "No module named 'awsglue.transforms'" in lab 1 #2

Open
liualexiang opened this issue Aug 15, 2019 · 3 comments
Open

The error of "No module named 'awsglue.transforms'" in lab 1 #2

liualexiang opened this issue Aug 15, 2019 · 3 comments

Comments

@liualexiang
Copy link

When you create first glue ETL job in lab1, you may encounter an error as below:

Traceback (most recent call last):
File "/tmp/runscript.py", line 115, in <module>
runpy.run_path(temp_file_path, run_name='__main__')
File "/usr/local/lib/python3.6/runpy.py", line 263, in run_path
pkg_name=pkg_name, script_name=fname)
File "/usr/local/lib/python3.6/runpy.py", line 96, in _run_module_code
mod_name, mod_spec, pkg_name, script_name)
File "/usr/local/lib/python3.6/runpy.py", line 85, in _run_code
exec(code, run_globals)
File "/tmp/glue-python-scripts-7tb3qep1/tests.html", line 2, in <module>
ModuleNotFoundError: No module named 'awsglue.transforms'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/tmp/runscript.py", line 134, in <module>
raise e_type(e_value).with_tracsback(new_stack)
AttributeError: 'ModuleNotFoundError' object has no attribute 'with_tracsback'

The reason is due to ETL language is "Spark", but not "Python".

Please modify the document, thanks

@mmarionncern
Copy link

I fully support the observation, examples for using GLUE with python shell scripts are not correct, it would be good to get a proper and accurate example.
Thanks a lot

@jgdelrio
Copy link

I agree, the indications to add libraries are totally misleading and the error reported as 'ModuleNotFoundError' don't help to find where AWS was looking...
As it is clearly not looking at the location provided, go figure!

@blaparna
Copy link

When you create first glue ETL job in lab1, you may encounter an error as below:

Traceback (most recent call last):
File "/tmp/runscript.py", line 115, in <module>
runpy.run_path(temp_file_path, run_name='__main__')
File "/usr/local/lib/python3.6/runpy.py", line 263, in run_path
pkg_name=pkg_name, script_name=fname)
File "/usr/local/lib/python3.6/runpy.py", line 96, in _run_module_code
mod_name, mod_spec, pkg_name, script_name)
File "/usr/local/lib/python3.6/runpy.py", line 85, in _run_code
exec(code, run_globals)
File "/tmp/glue-python-scripts-7tb3qep1/tests.html", line 2, in <module>
ModuleNotFoundError: No module named 'awsglue.transforms'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/tmp/runscript.py", line 134, in <module>
raise e_type(e_value).with_tracsback(new_stack)
AttributeError: 'ModuleNotFoundError' object has no attribute 'with_tracsback'

The reason is due to ETL language is "Spark", but not "Python".

Please modify the document, thanks

so how do i fix the error

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants