pep_sex_2024 changes made

scripts/us_census/pep/us_pep_sex/README.md

@@ -1,7 +1,7 @@
 # US Census PEP: Population Estimate By Sex
 
 ## About the Dataset
-This dataset has Population Estimates for the National, State and County geographic levels in United States from the year 1900 to 2021 on a yearly basis.        
+This dataset has Population Estimates for the National, State and County geographic levels in United States from the year 1900 to latest year on a yearly basis.        
 
 ### Download URL
 The data in txt/csv/xls formats are downloadable from within https://www2.census.gov/programs-surveys/popest/tables and https://www2.census.gov/programs-surveys/popest/datasets. The actual URLs are listed in download.py.
@@ -45,4 +45,17 @@ The below script will download the data.
 
 The below script will clean the data, Also generate final csv, mcf and tmcf files.
 
-`/bin/python3 scripts/us_census/pep/us_pep_sex/process.py`
+`/bin/python3 scripts/us_census/pep/us_pep_sex/process.py`
+
+###Automation Refresh
+The process.py has a parameter 'mode' with values 'download' and 'process'
+
+when the file 'process.py' is ran with the flag --mode=download, it will only download the files and put it in the input_files directory.
+i.e. python3 process.py mode=download
+
+when the file 'process.py' is ran with the flag --mode=process, it will process the downloaded files and put it in the output directory.
+i.e. python3 process.py mode=process
+
+when the file 'process .py' is ran without any flag, it will download and process the files and keep it in the respective directories as mentioned above.
+i.e. python3 process.py
+

scripts/us_census/pep/us_pep_sex/manifest.json

@@ -0,0 +1,19 @@
+{
+  "import_specifications": [
+    {
+      "import_name": "USCensusPEP_Sex",
+      "curator_emails": ["[email protected]"],
+      "provenance_url": "https://www2.census.gov/programs-surveys/popest/tables",
+      "provenance_description": "US Census Population Estimates Program (PEP).",
+      "scripts": ["process.py"],
+      "import_inputs": [
+        {
+          "template_mcf": "output/population_estimate_sex.tmcf",
+          "cleaned_csv": "output/population_estimate_sex.csv"
+        }
+      ],
+      "cron_schedule": "0 03 * * 1"
+    }
+  ]
+}
+