Here is a copy of the last report I sent out concerning core hour and storage usage for DFO COMDA and DPNM allocations on GPSC.  Like I said these are not perfect, and require a fair amount of hands on work to create them. 

 

If I could generate similar information and a similar report using a system from HPCO in the near term I would consider that a significant success for reporting.

 

 

 

Here’s the GPSC core-hour month-end status and storage update.  Please note that Core Hours is for all usage with the project tag, Normal and Low QoS.  For COMDA we have separated out the other projects (PFM,AFM, Aquaculture) that share the same Normal QoS Queue with COMDA. 

Please note 85% of a partition is an industry guideline of how full a partition can safely get.  15% of a storage partition in traditional storage structures should be kept empty as swing space to allow the system space to create temporary files and operational space for things such as moving files or copying files or system storage activities.  When there is not enough swing space the storage ought to be actively managed to avoid problems with the system. Rate of data growth and how often files are created and deleted as well as how large files can grow temporarily during actively modelling are factors in determining the risk when a partition begins to fill up.

Top 5 Storage Users

Name	Space Used (TB)	Total Space Used (TB)	User Percentage of Total
Minghong Zhang	121.82	733.97	17%
Yongxing Ma	106.22	733.97	14%
Colin Hughes	74.84	733.97	10%
Guoqi Han	58.37	733.97	8%
SeDOO	53.7	733.97	7%

Reporting for 2023-12

COMDA allocation is 458936.4 core-hours/month

99.8% COMDA project usage - lower than last month

10 COMDA project users

83.3% of total usage from 3 users

Name	COMDA project C-H usage
Zhenxia Long	203522.0
Guoqi Han	101384.0
Catarina Wor	76401.2
Sarah MacDermid	58589.0
William Perrie	6658.1
Olivier Riche	5725.4
Jacqueline Dumas	3763.8
Dan Greenberg	1590.7
Yongxing Ma	356.3
Adam Drozdowski	0.0
Total Usage	457990.7
Total Allocation	458936.4
Total %	99.79%

 

 

Please note 85% of a partition is an industry guideline of how full a partition can safely get.  15% of a storage partition in traditional storage structures should be kept empty as swing space to allow the system space to create temporary files and operational space for things such as moving files or copying files or system storage activities.  When there is not enough swing space the storage ought to be actively managed to avoid problems with the system. Rate of data growth and how often files are created and deleted as well as how large files can grow temporarily during actively modelling are factors in determining the risk when a partition begins to fill up.

Name	Space Used (TB)	Total Space Used (TB)	User Percentage of Total
Port Leads Group	188.24	829.2	23%
Michael Dunphy	107.83	829.2	13%
Stephanne Taylor	85.83	829.2	10%
SeDOO group	72.36	829.2	9%
Hauke Blanken	67.3	829.2	8%

Reporting for 2023-12

OPP allocation is 1350500.0 core-hours/month

47% OPP project usage - lower than last month

14 OPP project users

97% of total usage from 3 users

Name	OPP project C-H usage
Stephanne Taylor	389232.12
Maxim Krassovski	155636.039
Rachel Horwitz	68359.0492
Andy Lin	8415.52972
Michael Dunphy	6073.83111
Michael Dunphy	3121.53306
Simon St-OngeDrouin	1038.74528
Simon St-OngeDrouin	695.825833
Hauke Blanken	572.125833
Rachel Horwitz	64.273333
Nancy Soontiens	45.675
Maxim Krassovski	15.595
Corinne Bourgault-Brunelle	0.8425
Corinne Bourgault-Brunelle	0.205278
Total Usage	633271.4
Total Allocation	1350500
Total %	47%

 

Ross Weaver

 

Science Advisor, Ocean and Climate Change Science

Fisheries and Oceans Canada, Government of Canada

Ross.Weaver@dfo-mpo.gc.ca / Tel. : 343.576.2076

 

Conseiller scientifique, Sciences océaniques et des changements climatiques

Pêches et Océans Canada, Gouvernement du Canada

Ross.Weaver@dfo-mpo.gc.ca / Tél. : 343.576.2076