Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

EM refactoring / EMv2 #136

Merged
merged 69 commits into from
Mar 1, 2024
Merged
Show file tree
Hide file tree
Changes from 9 commits
Commits
Show all changes
69 commits
Select commit Hold shift + click to select a range
764093c
Fixed missing references to EM/CGMS/ICME-related base classes in the …
atomprobe-tc Dec 13, 2023
8a3ae1b
Refactoring storage of images and spectra
atomprobe-tc Dec 13, 2023
6663bec
Minor edit
atomprobe-tc Dec 13, 2023
dba0e64
Refactoring apm has three aims: i) extent NXapm appdef to take advant…
atomprobe-tc Jan 3, 2024
261f91b
Testing the use of NXapm_paraprobe_tool_config/results base classes o…
atomprobe-tc Jan 3, 2024
7abeded
Applied to i)
atomprobe-tc Jan 3, 2024
b50f160
Working on ii) mirrored concept used for NXem with NXapm_msr and NXap…
atomprobe-tc Jan 4, 2024
cdcebea
Implemented design of event_data_apm, correlated signals with keyword…
atomprobe-tc Jan 5, 2024
7e4be9b
Editing NXapm_ranging remains and a final check of the NXapm_new, the…
Jan 5, 2024
373da83
Refactored NXapm_ranging, renamed NXapm_new, a through and complete c…
Jan 5, 2024
df219e8
Reviewing, fixing typos, a minor glitches
Jan 6, 2024
6b649bc
Further reviewing and corrections
Jan 6, 2024
701f277
NXapm reviewing and typos
Jan 7, 2024
34fc49b
Fixed issues detected during make local, manual builds successfully, …
atomprobe-tc Jan 8, 2024
5c7d197
Added changes relevant to use the refactored NXapm parser of pynxtool…
atomprobe-tc Jan 10, 2024
f402b33
Fixes and additions revealed from implementing parser functionalities…
atomprobe-tc Jan 17, 2024
c1aa2e3
Placed version as child of definition
atomprobe-tc Jan 17, 2024
23d34bc
Added version as a child of definition, spotted what could be a bug t…
atomprobe-tc Jan 17, 2024
0a2bd84
Fixes and modifications revealed during implementation of imgs, apex …
atomprobe-tc Jan 17, 2024
e37edaf
Added suggestions from @lukaspie on NXpeak
atomprobe-tc Jan 17, 2024
f816790
Fixes introduced for Velox EMD file parser
atomprobe-tc Jan 19, 2024
1072a9a
Fixed definitions and version
atomprobe-tc Jan 23, 2024
8041523
Fixed definitions and version
atomprobe-tc Jan 23, 2024
3b266bf
Removed unfortunated row vector style matrix isotope_vector and nucli…
atomprobe-tc Jan 23, 2024
c043182
Updated apm-specific documentation for new base classes and refactori…
atomprobe-tc Jan 23, 2024
9745686
Fixes and modifications specifically for paraprobe-toolbox tools: par…
atomprobe-tc Jan 25, 2024
4b84b08
Added appdef for selector_results, reorganized where to place common …
atomprobe-tc Jan 25, 2024
0d40ece
Reorganized transcoder, ranger, selector
atomprobe-tc Jan 26, 2024
a172c01
Refactored surfacer to use APMv2
atomprobe-tc Jan 26, 2024
8b6ee88
Refactored appdefs for distancer and tessellator to use APMv2
atomprobe-tc Jan 27, 2024
8ac38a5
Fixes added in the process of refactoring parmsetup-distancer and par…
Jan 27, 2024
7c1f072
Fixes to complete distancer and tessellator APMv2 refactoring
atomprobe-tc Jan 28, 2024
13efc84
Refactored appdefs for paraprobe-spatstat, specified symbol to use fo…
Jan 28, 2024
a04b6fb
Minor editing of spatstat
atomprobe-tc Feb 9, 2024
5291ffe
Refactored paraprobe-clusterer definitions to use APM v2
atomprobe-tc Feb 10, 2024
6122e74
Added missing profiling and program for results appdefs of tools wher…
atomprobe-tc Feb 10, 2024
23722e2
Renaming the last two missing appdefs for tools nanochem and intersec…
atomprobe-tc Feb 13, 2024
7892cf9
Refactored config files for nanochem and intersector to use APMv2
atomprobe-tc Feb 16, 2024
2df16a3
Updated apm-specific landing page
atomprobe-tc Feb 16, 2024
0bd04c7
Minor edits and fixes apm-structure
atomprobe-tc Feb 16, 2024
d5fa011
Fixing a copy-paste error
atomprobe-tc Feb 16, 2024
38bb082
Fixed inconsistence
atomprobe-tc Feb 16, 2024
f8cb8db
Refactored NXapm_paraprobe_nanochem_results and delocalization
atomprobe-tc Feb 16, 2024
7d21589
Refactored NXapm_paraprobe_intersector_results, fixed formatting issu…
Feb 16, 2024
92afaee
Proposal to move common data nicely out, fixes on nanochem config, ne…
atomprobe-tc Feb 18, 2024
70ac95f
Moved profiling and other common information out of task specific gro…
atomprobe-tc Feb 26, 2024
a2c13f5
Resolved logical problem that status was not always present
atomprobe-tc Feb 26, 2024
a0de2c4
Moving of analysis_identifier and config
atomprobe-tc Feb 26, 2024
03b15b5
First round of fixes for appdefs of nanochem tool for delocalization …
atomprobe-tc Feb 27, 2024
2b8c352
Fixes intersector config
atomprobe-tc Feb 27, 2024
ca5b4af
Changes due to comments from colleagues
atomprobe-tc Feb 28, 2024
41b354c
Final changes prior merge
atomprobe-tc Feb 28, 2024
9b8ee6b
Merge pull request #151 from FAIRmat-NFDI/composing-v0.5
mkuehbach Feb 28, 2024
b6cf0b2
Round 1, implementation feedback from colleagues
atomprobe-tc Feb 28, 2024
4fe028d
Recompiled NXDLs from YAML using nyaml==0.0.9
atomprobe-tc Feb 28, 2024
bb7f17a
Recompiled NXDLs from yaml using nyaml==0.0.9
atomprobe-tc Feb 28, 2024
d91898c
Manually merged em into apm
Feb 28, 2024
0b928c4
Deactivated use of NXactuator for now because em_refactoring branch d…
Feb 28, 2024
b37f8ec
Constrained name of ions in NXapm
Feb 28, 2024
ebd722c
Merge pull request #140 from FAIRmat-NFDI/apm_refactoring
mkuehbach Feb 29, 2024
6697f96
Manual merge of fairmat into em_refactoring
atomprobe-tc Feb 29, 2024
95b6505
Recompiled NXdata and NXsensor with nyaml==0.0.9 as they showed issue…
atomprobe-tc Feb 29, 2024
5740f4f
Clarifying situation with NXem_base
atomprobe-tc Feb 29, 2024
5fc31d0
Dropped NXem_base to not immediately be a competitor to NXem, all sug…
atomprobe-tc Feb 29, 2024
6961f34
Cleanly removed NXem_base class
atomprobe-tc Feb 29, 2024
d0358cd
Merge pull request #187 from FAIRmat-NFDI/em_refactoring_em_base_removal
mkuehbach Feb 29, 2024
3337196
Changes suggested by @domna
atomprobe-tc Mar 1, 2024
092580d
Reverted unintentional change NXsensor.nxdl.xml
mkuehbach Mar 1, 2024
7ff42ce
Revert that was unintentionally changed NXdata.nxdl.xml
mkuehbach Mar 1, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 3 additions & 3 deletions contributed_definitions/NXaberration.nxdl.xml
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
<?xml-stylesheet type="text/xsl" href="nxdlformat.xsl"?>
<!--
# NeXus - Neutron and X-ray Common Data Format
#
# Copyright (C) 2014-2023 NeXus International Advisory Committee (NIAC)
#
#
# Copyright (C) 2014-2024 NeXus International Advisory Committee (NIAC)
#
# This library is free software; you can redistribute it and/or
# modify it under the terms of the GNU Lesser General Public
# License as published by the Free Software Foundation; either
Expand Down
6 changes: 3 additions & 3 deletions contributed_definitions/NXaberration_model.nxdl.xml
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
<?xml-stylesheet type="text/xsl" href="nxdlformat.xsl"?>
<!--
# NeXus - Neutron and X-ray Common Data Format
#
# Copyright (C) 2014-2023 NeXus International Advisory Committee (NIAC)
#
#
# Copyright (C) 2014-2024 NeXus International Advisory Committee (NIAC)
#
# This library is free software; you can redistribute it and/or
# modify it under the terms of the GNU Lesser General Public
# License as published by the Free Software Foundation; either
Expand Down
6 changes: 3 additions & 3 deletions contributed_definitions/NXaberration_model_ceos.nxdl.xml
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
<?xml-stylesheet type="text/xsl" href="nxdlformat.xsl"?>
<!--
# NeXus - Neutron and X-ray Common Data Format
#
# Copyright (C) 2014-2023 NeXus International Advisory Committee (NIAC)
#
#
# Copyright (C) 2014-2024 NeXus International Advisory Committee (NIAC)
#
# This library is free software; you can redistribute it and/or
# modify it under the terms of the GNU Lesser General Public
# License as published by the Free Software Foundation; either
Expand Down
6 changes: 3 additions & 3 deletions contributed_definitions/NXaberration_model_nion.nxdl.xml
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
<?xml-stylesheet type="text/xsl" href="nxdlformat.xsl"?>
<!--
# NeXus - Neutron and X-ray Common Data Format
#
# Copyright (C) 2014-2023 NeXus International Advisory Committee (NIAC)
#
#
# Copyright (C) 2014-2024 NeXus International Advisory Committee (NIAC)
#
# This library is free software; you can redistribute it and/or
# modify it under the terms of the GNU Lesser General Public
# License as published by the Free Software Foundation; either
Expand Down
6 changes: 3 additions & 3 deletions contributed_definitions/NXaperture_em.nxdl.xml
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
<?xml-stylesheet type="text/xsl" href="nxdlformat.xsl"?>
<!--
# NeXus - Neutron and X-ray Common Data Format
#
# Copyright (C) 2014-2023 NeXus International Advisory Committee (NIAC)
#
#
# Copyright (C) 2014-2024 NeXus International Advisory Committee (NIAC)
#
# This library is free software; you can redistribute it and/or
# modify it under the terms of the GNU Lesser General Public
# License as published by the Free Software Foundation; either
Expand Down
35 changes: 12 additions & 23 deletions contributed_definitions/NXapm.nxdl.xml
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
<?xml-stylesheet type="text/xsl" href="nxdlformat.xsl"?>
<!--
# NeXus - Neutron and X-ray Common Data Format
#
# Copyright (C) 2014-2023 NeXus International Advisory Committee (NIAC)
#
#
# Copyright (C) 2014-2024 NeXus International Advisory Committee (NIAC)
#
# This library is free software; you can redistribute it and/or
# modify it under the terms of the GNU Lesser General Public
# License as published by the Free Software Foundation; either
Expand Down Expand Up @@ -865,10 +865,8 @@ NEW ISSUE: see in WO2016171675A1 Invizo 6000 patent from AMETEK-->
<field name="standing_voltage" type="NX_FLOAT" recommended="true"/>
<group type="NXcsg" optional="true"/>
<group name="SOURCE" type="NXsource" minOccurs="0" maxOccurs="2">
<!--
INVIZO 6000 instrument have two symmetric lasers! so for these
laser_gun and laser_beam exists: [min, 0, max, 2]
-->
<!--INVIZO 6000 instrument have two symmetric lasers! so for these
laser_gun and laser_beam exists: [min, 0, max, 2]-->
<doc>
Atom probe microscopes use controlled laser, voltage, or a
combination of pulsing strategies to trigger the excitation
Expand Down Expand Up @@ -1016,10 +1014,7 @@ NEW ISSUE: dld_signal_amplitude monitoring
arrival_time_pairs: (recommended) NX_NUMBER (Rank: 3, Dimensions: [n_ions, n_dld_wires, 2]) {units=NX_TIME}
eventually one may wish to store values from an NXmonitoring tracking the DLD signal amplitude (mV) = f(t)-->
<group name="specimen_monitoring" type="NXcollection" recommended="true">
<!--
NEW ISSUE: should be promoted to recommended at some point in particular with
closer integration of APM and EM instruments
-->
<!--NEW ISSUE: should be promoted to recommended at some point in particular with closer integration of APM and EM instruments-->
<doc>
A place where details about the initial shape of the specimen
can be stored. Ideally, here also data about the shape evolution
Expand Down Expand Up @@ -1259,10 +1254,8 @@ term with epos files.-->
</dimensions>
</field>
<field name="hit_multiplicity" type="NX_UINT" units="NX_UNITLESS">
<!--
NEW ISSUE: further discussions with members of the APM community
is required to clarify this field and what it means
-->
<!--NEW ISSUE: further discussions with members of the APM community
is required to clarify this field and what it means-->
<doc>
Hit multiplicity.
</doc>
Expand Down Expand Up @@ -1324,10 +1317,8 @@ Relevant for ranging are the calibrated data, thats why only these
</dimensions>
</field>
<field name="calibrated_tof" type="NX_FLOAT" units="NX_TIME">
<!--
NEW ISSUE: which type of calibrations are applied is usually a modified
sqrt tof to m/q mapping the exact parameter of which are for LEAP instruments not immediately accessible.
-->
<!--NEW ISSUE: which type of calibrations are applied is usually a modified
sqrt tof to m/q mapping the exact parameter of which are for LEAP instruments not immediately accessible.-->
<doc>
Calibrated time-of-flight.
</doc>
Expand Down Expand Up @@ -1420,12 +1411,10 @@ numerically the same voltage-and-bowl correction results are obtained
</enumeration>
</field>
<field name="parameter">
<!--
NEW ISSUE: the status here should be promoted to required but currently
<!--NEW ISSUE: the status here should be promoted to required but currently
one needs to manually extract the reconstruction parameters
NEW ISSUE: for instance from commercial software, here a better strategy
is needed how to document the reconstruction parameter.
-->
is needed how to document the reconstruction parameter.-->
<doc>
Different reconstruction protocols exist. Although these approaches
are qualitatively similar, each protocol uses different parameters
Expand Down
22 changes: 7 additions & 15 deletions contributed_definitions/NXapm_paraprobe_results_nanochem.nxdl.xml
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
<?xml-stylesheet type="text/xsl" href="nxdlformat.xsl"?>
<!--
# NeXus - Neutron and X-ray Common Data Format
#
# Copyright (C) 2014-2023 NeXus International Advisory Committee (NIAC)
#
#
# Copyright (C) 2014-2024 NeXus International Advisory Committee (NIAC)
#
# This library is free software; you can redistribute it and/or
# modify it under the terms of the GNU Lesser General Public
# License as published by the Free Software Foundation; either
Expand Down Expand Up @@ -1120,9 +1120,7 @@ details about specific features-->
</dimensions>
</field>
<group name="hexahedra" type="NXcg_face_list_data_structure">
<!--
exists: [min, 0, max, 1]
-->
<!--exists: [min, 0, max, 1]-->
<doc>
A simple approach to describe the entire set of hexahedra
when the main intention is to store the shape of the
Expand Down Expand Up @@ -1938,27 +1936,21 @@ face_identifier_offset(NX_UINT):-->
<field name="description"/>
<field name="elapsed_time" type="NX_NUMBER"/>
<field name="number_of_processes" type="NX_POSINT">
<!--
exists: recommended
-->
<!--exists: recommended-->
<doc>
Specify if it was different from the number_of_processes
in the NXcs_profiling super class.
</doc>
</field>
<field name="number_of_threads" type="NX_POSINT">
<!--
exists: recommended
-->
<!--exists: recommended-->
<doc>
Specify if it was different from the number_of_threads
in the NXcs_profiling super class.
</doc>
</field>
<field name="number_of_gpus" type="NX_POSINT">
<!--
exists: recommended
-->
<!--exists: recommended-->
<doc>
Specify if it was different from the number_of_threads
in the NXcs_profiling super class.
Expand Down
6 changes: 3 additions & 3 deletions contributed_definitions/NXcalibration.nxdl.xml
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
<?xml-stylesheet type="text/xsl" href="nxdlformat.xsl"?>
<!--
# NeXus - Neutron and X-ray Common Data Format
#
# Copyright (C) 2014-2023 NeXus International Advisory Committee (NIAC)
#
#
# Copyright (C) 2014-2024 NeXus International Advisory Committee (NIAC)
#
# This library is free software; you can redistribute it and/or
# modify it under the terms of the GNU Lesser General Public
# License as published by the Free Software Foundation; either
Expand Down
12 changes: 5 additions & 7 deletions contributed_definitions/NXcg_alpha_complex.nxdl.xml
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
<?xml-stylesheet type="text/xsl" href="nxdlformat.xsl"?>
<!--
# NeXus - Neutron and X-ray Common Data Format
#
# Copyright (C) 2014-2023 NeXus International Advisory Committee (NIAC)
#
#
# Copyright (C) 2014-2024 NeXus International Advisory Committee (NIAC)
#
# This library is free software; you can redistribute it and/or
# modify it under the terms of the GNU Lesser General Public
# License as published by the Free Software Foundation; either
Expand Down Expand Up @@ -74,10 +74,8 @@ stating meter is a stronger constraint while m is the strongest constraint, mean
</field>
<!--check again carefully the CGAL documentation talks about, for 3D, the square of the radius!-->
<group name="point_setID" type="NXcg_point_set">
<!--
basically just constraints that if you use one or more instances of NXcg_point_set
inside an instance of NXcg_alpha_complex, name that group with the prefix "point_set"
-->
<!--basically just constraints that if you use one or more instances of NXcg_point_set
inside an instance of NXcg_alpha_complex, name that group with the prefix "point_set"-->
<doc>
Point cloud for which the alpha shape or wrapping has been computed.
</doc>
Expand Down
22 changes: 11 additions & 11 deletions contributed_definitions/NXcg_cylinder_set.nxdl.xml
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
<?xml-stylesheet type="text/xsl" href="nxdlformat.xsl"?>
<!--
# NeXus - Neutron and X-ray Common Data Format
#
# Copyright (C) 2014-2023 NeXus International Advisory Committee (NIAC)
#
#
# Copyright (C) 2014-2024 NeXus International Advisory Committee (NIAC)
#
# This library is free software; you can redistribute it and/or
# modify it under the terms of the GNU Lesser General Public
# License as published by the Free Software Foundation; either
Expand Down Expand Up @@ -52,7 +52,7 @@ cylinder could be constructed, but NXcylinder is easier to understand-->
A direction vector which is parallel to the cylinder/cone axis
and whose magnitude is the height of the cylinder/cone.
</doc>
<dimensions rank="2">
<dimensions>
<dim index="1" value="c"/>
<dim index="2" value="d"/>
</dimensions>
Expand All @@ -77,7 +77,7 @@ one should really better use NXquadric...-->
<doc>
Radii of the cylinder.
</doc>
<dimensions rank="1">
<dimensions>
<dim index="1" value="c"/>
</dimensions>
</field>
Expand All @@ -88,7 +88,7 @@ one should really better use NXquadric...-->
This field, combined with lower_cap_radius can be used to describe
(eventually truncated) circular cones.
</doc>
<dimensions rank="1">
<dimensions>
<dim index="1" value="c"/>
</dimensions>
</field>
Expand All @@ -99,7 +99,7 @@ one should really better use NXquadric...-->
This field, combined with upper_cap_radius can be used to describe
(eventually truncated) circular cones.
</doc>
<dimensions rank="1">
<dimensions>
<dim index="1" value="c"/>
</dimensions>
</field>
Expand All @@ -108,23 +108,23 @@ one should really better use NXquadric...-->
<doc>
Lateral surface area
</doc>
<dimensions rank="1">
<dimensions>
<dim index="1" value="c"/>
</dimensions>
</field>
<field name="upper_cap_surface_area" type="NX_NUMBER" units="NX_AREA">
<doc>
Area of the upper cap of each cylinder.
</doc>
<dimensions rank="1">
<dimensions>
<dim index="1" value="c"/>
</dimensions>
</field>
<field name="lower_cap_surface_area" type="NX_NUMBER" units="NX_AREA">
<doc>
Area of the lower cap of each cylinder.
</doc>
<dimensions rank="1">
<dimensions>
<dim index="1" value="c"/>
</dimensions>
</field>
Expand All @@ -133,7 +133,7 @@ one should really better use NXquadric...-->
Sum of upper and lower cap areas and lateral surface area
of each cylinder.
</doc>
<dimensions rank="1">
<dimensions>
<dim index="1" value="c"/>
</dimensions>
</field>
Expand Down
10 changes: 5 additions & 5 deletions contributed_definitions/NXcg_ellipsoid_set.nxdl.xml
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
<?xml-stylesheet type="text/xsl" href="nxdlformat.xsl"?>
<!--
# NeXus - Neutron and X-ray Common Data Format
#
# Copyright (C) 2014-2023 NeXus International Advisory Committee (NIAC)
#
#
# Copyright (C) 2014-2024 NeXus International Advisory Committee (NIAC)
#
# This library is free software; you can redistribute it and/or
# modify it under the terms of the GNU Lesser General Public
# License as published by the Free Software Foundation; either
Expand Down Expand Up @@ -48,15 +48,15 @@ redundant as there is NXcsg, and NXquadric but easier to understand-->

Use if all ellipsoids in the set have the same half-axes.
</doc>
<dimensions rank="1">
<dimensions>
<dim index="1" value="d"/>
</dimensions>
</field>
<field name="half_axes_radii" type="NX_NUMBER" units="NX_LENGTH">
<doc>
Half-axes radii of each ellipsoid.
</doc>
<dimensions rank="2">
<dimensions>
<dim index="1" value="c"/>
<dim index="2" value="d"/>
</dimensions>
Expand Down
Loading
Loading