Update metadata.json generation to adhear to new metadata reorganization

[shirey]

Based on the reorganization of Dataset metadata update the code that generates the metadata.json files at Publication time to output the metadata.json file with these changes.

Also, make sure that all excluded fields as excluded by issue (specified in schema yaml file): Exclude fields from public responses

Use the new endpoint for prov-metadata to do this when finished.