[Bug] Lacking "The judgment to Empty" introduces a "wrong value of a Spark lineage object" issue

[xglv1985]

Code of Conduct

• I agree to follow this project's Code of Conduct

Search before asking

• I have searched in the issues and found no similar issues.

Describe the bug

How to reproduce the issue?

The changes in this PR will avoid a wrong result when generating the instance of org.apache.kyuubi.plugin.lineage.Lineage, in the certain case as follows:
step 1: create a temporary view from a file
CREATE OR REPLACE TEMPORARY VIEW temp_view ( aSTRING COMMENT '',b STRING COMMENT '' ) USING csv OPTIONS( sep='\t', path='${sourceFile.path}' );

step 2: insert into a table by selecting from the temporary view in step 1
insert overwrite table test_db.test_table_from_dir SELECT a, b FROM temp_view

step 3: generate the lineage when executing the insert statement in step 2

Then a None object of org.apache.kyuubi.plugin.lineage.Lineage will be generated. However, the correct value of it should be:
inputTables(List()) outputTables(List(spark_catalog.test_db.test_table_from_dir)) columnLineage(List(ColumnLineage(spark_catalog.test_db.test_table_from_dir.a0,Set()), ColumnLineage(spark_catalog.test_db.test_table_from_dir.b0,Set())))

How is the issue introduced?

Let's see the current code when getting the Lineage object by resolving a LogicalPlan object:

According to the above logic, a None org.apache.kyuubi.plugin.lineage.Lineage object will be generated due to "try-recover" self-protection, in this certain case.

The consequence of this bug

Unit Test Environment

In Unit Test, when the code runs here a "None.get" exception will be raised:

Here's the runtime exception stack:
None.get java.util.NoSuchElementException: None.get at scala.None$.get(Option.scala:529) at scala.None$.get(Option.scala:527) at org.apache.kyuubi.plugin.lineage.helper.SparkSQLLineageParserHelperSuite.extractLineageWithoutExecuting(SparkSQLLineageParserHelperSuite.scala:1485) at org.apache.kyuubi.plugin.lineage.helper.SparkSQLLineageParserHelperSuite.$anonfun$new$83(SparkSQLLineageParserHelperSuite.scala:1465)

Production Environment

This Lineage object cannot be used in the production environment because it has a None value which lacks necessary lineage information.

Affects Version(s)

all versions

Kyuubi Server Log Output

unrelated

Kyuubi Engine Log Output

unrelated

Kyuubi Server Configurations

unrelated

Kyuubi Engine Configurations

unrelated

Additional context

I have already proposed a PR to this issue in advance, please see:
#6911

Are you willing to submit PR?

• Yes. I would be willing to submit a PR with guidance from the Kyuubi community to fix.
• No. I cannot submit a PR at this time.

[github-actions]

Hello @xglv1985,
Thanks for finding the time to report the issue!
We really appreciate the community's efforts to improve Apache Kyuubi.