Data pre 2014 for OES: thoughts and musings

[mbkupfer]

The main inconsistency prior to 2013 is in the msa files. They are broken up into 3 sections (reason being that there were limitations in older excel versions.) For example, here are the OES files for each MSA in 2013:

MSA_M2013_dl_3_OH_WY.xls
MSA_M2013_dl_1_AK_IN.xls 
MSA_M2013_dl_2_KS_NY.xls

This can all be combined into one dataframe using pd.concat()
For example:

df1 = pd.read_excel(zip_ma.open('MSA_M2013_dl_3_OH_WY.xls'))
df2 = pd.read_excel(zip_ma.open('MSA_M2013_dl_1_AK_IN.xls'))
df3= pd.read_excel(zip_ma.open('MSA_M2013_dl_2_KS_NY.xls'))
df_all = pd.concat([df1, df2, df3], sort=False)

All other files appear to look the same.

[mbkupfer]

df_metros_1 = pd.read_excel(zip_ma.open(f'MSA_M20{yy}_dl_1_AK_IN.xls'))
df_metros_2 = pd.read_excel(zip_ma.open(f'MSA_M20{yy}_dl_2_KS_NY.xls'))
df_metros_3 = pd.read_excel(zip_ma.open(f'MSA_M20{yy}_dl_3_OH_WY.xls'))
df_metros = pd.concat([df_metros_1, df_metros_2, df_metros_3], sort=False)