Cluster, Auxiliary Parameters - Hungarian Data Centre/M. Tatrallyay (KFKI)

Fetch the full dataset (template)

import cloudcatalog
dataset_id = 'CL_SP_AUX'
start = '2000-08-22T00:00:30.000Z'
stop =   '2022-10-31T23:59:30.000Z'
fr=cloudcatalog.CloudCatalog('s3://gov-nasa-hdrl-data1/')
filelist = fr.request_cloud_catalog(dataset_id, start_date=start, stop_date=stop)

#example usage:
fr.stream_uri(filelist, lambda s3_uri, start, stop, filesize: MYCODE(s3_uri, start, stop, filesize))
    

Yearly index files

• CL_SP_AUX_2000.csv   https s3
• CL_SP_AUX_2001.csv   https s3
• CL_SP_AUX_2002.csv   https s3
• CL_SP_AUX_2003.csv   https s3
• CL_SP_AUX_2004.csv   https s3
• CL_SP_AUX_2005.csv   https s3
• CL_SP_AUX_2006.csv   https s3
• CL_SP_AUX_2007.csv   https s3
• CL_SP_AUX_2008.csv   https s3
• CL_SP_AUX_2009.csv   https s3
• CL_SP_AUX_2010.csv   https s3
• CL_SP_AUX_2011.csv   https s3
• CL_SP_AUX_2012.csv   https s3
• CL_SP_AUX_2013.csv   https s3
• CL_SP_AUX_2014.csv   https s3
• CL_SP_AUX_2015.csv   https s3
• CL_SP_AUX_2016.csv   https s3
• CL_SP_AUX_2017.csv   https s3
• CL_SP_AUX_2018.csv   https s3
• CL_SP_AUX_2019.csv   https s3
• CL_SP_AUX_2020.csv   https s3
• CL_SP_AUX_2021.csv   https s3
• CL_SP_AUX_2022.csv   https s3