templates: move the globals up to the Environment (Jinja2 3.0.0) (#419)

* jinja: fix TemplateNotFound missing name

The TemplateNotFound exception requires a parameter, name, that is
missing in one of the calls.

File "/usr/lib/python3.8/site-packages/salt/utils/jinja.py", line 158, in get_source
    raise TemplateNotFound
TypeError: __init__() missing 1 required positional argument: 'name'

This patch add the missing parameter in the raise call.

Signed-off-by: Alberto Planas <[email protected]>

* templates: move the globals up to the Environment

When creating a Jinja2 environment, we populate the globals in the
Template object that we generate from the environment.  This cause a
problem when there is a {% include "./file.sls" %} in the template, as
cannot find in the environment globals information like the "tpldir",
for example, making the relative path to be unresolved.

Seems that in Jinja2 2.X this behaviour is not present, so attaching the
globals to the Template will make the include to work, but since Jinja2
3.0.0 this is not the case.  Maybe related with the re-architecture from
pallets/jinja#295

This patch populate the globals in the Environment level, making this
and other variables reachable by the Jinja templates.

Fix #55159

Signed-off-by: Alberto Planas <[email protected]>

changelog/55159.fixed

@@ -0,0 +1 @@
+Jinja renderer resolves wrong relative paths when importing subdirectories

salt/utils/jinja.py

@@ -151,7 +151,7 @@ def get_source(self, environment, template):
                     'Relative path "%s" cannot be resolved without an environment',
                     template
                 )
-                raise TemplateNotFound
+                raise TemplateNotFound(template)
             base_path = environment.globals['tpldir']
             _template = os.path.normpath('/'.join((base_path, _template)))
             if _template.split('/', 1)[0] == '..':

salt/utils/templates.py

@@ -389,9 +389,9 @@ def opt_jinja_env_helper(opts, optname):
             )
             decoded_context[key] = salt.utils.data.decode(value)
 
+    jinja_env.globals.update(decoded_context)
     try:
         template = jinja_env.from_string(tmplstr)
-        template.globals.update(decoded_context)
         output = template.render(**decoded_context)
     except jinja2.exceptions.UndefinedError as exc:
         trace = traceback.extract_tb(sys.exc_info()[2])

tests/unit/utils/test_jinja.py

@@ -595,6 +595,22 @@ def test_render_with_undefined_variable_unicode(self):
             dict(opts=self.local_opts, saltenv='test', salt=self.local_salt)
         )
 
+    def test_relative_include(self):
+        template = "{% include './hello_import' %}"
+        expected = "Hey world !a b !"
+        filename = os.path.join(self.template_dir, "hello_import")
+        with salt.utils.files.fopen(filename) as fp_:
+            out = render_jinja_tmpl(
+                template,
+                dict(
+                    opts=self.local_opts,
+                    saltenv="test",
+                    salt=self.local_salt,
+                    tpldir=self.template_dir,
+                ),
+            )
+        self.assertEqual(out, expected)
+
 
 class TestJinjaDefaultOptions(TestCase):