MADIS DR RUN-TIME STATUS for Wed Apr 16 13:32:01 GMT 2025 on vm-bldr-madis-ops-recovery1
INFO Node name: vm-bldr-madis-ops-recovery1
PASS METAR processing tbl exists: 179538 Apr 8 17:30 /opt/ldm/madis/dr/decode/data/fxa/LDAD/data/NonFedAWOSStation.tbl
PASS Station update flag exists: 0 Jul 18 2024 /opt/ldm/madis/dr/decode/awips/fxa/GO-UPDATE-STATIONS
PASS Metar station table exists: 1121683 May 20 2024 /opt/ldm/madis/dr/sfc/iqc1/fslparms/lsfc.tbl
PASS Accept/reject|autorej files exists: AO: 3 IQC: 3 NON-SFC:
PASS Persistent processes exists: pqact (1+): 1 ldmd (1+): 7 DECODE (4): 5
PASS Dcmetr check: CNT-LDAD.raw: 889
PASS Load resource check: 60% of the time M15 < 9 Samples: 811 %<60: 100% #10=+ 0 #9 0 #8 0 #7 0
PASS Open file resource check: < 5000 Max files: -1 #<1000: 811 #<10000 811
FAIL Process count check: < 1000 Max Processes: 1005G
PASS AO Throughput test: <20 delayed %Delayed: 0% #Sample: 12 #Delayed: 0
PASS IQC Throughput test: <30 delayed #Delayed: 0 Competed timely: 113
PASS No '0' length Station table files in data: #: 0
PASS No '0' length Station table files in master: #: 0
PASS No netcdf-4.1 netCDF lib connection for routerStoreNetCDF:
PASS Shefdecoder check 20250415_1100: #CPYRMA: 5 #NJWXNET: 770 #NERRS: 0
COMPARE UNIQUE mesonet provider cnt for 20250415_1100: 29
WARN DR_SendFile2LDM is NOT updating MADIS netcdf common data directories
COMPARE DECODE STN TBLS 149 Newest: 235717 Apr 16 01:50 /opt/ldm/madis/dr/decode/data/fxa/LDAD/data/RAWSStation.txt Oldest: 8848 Jul 18 2024 /opt/ldm/madis/dr/decode/data/fxa/LDAD/data/AWS-GANetStation.txt
COMPARE PRE-DECODE STN TBLS 149 Newest: 235717 Apr 16 01:50 /opt/ldm/madis/dr/decode/data/fxa/LDAD/data/master/RAWSStation.txt Oldest: 1568 Jul 18 2024 /opt/ldm/madis/dr/decode/data/fxa/LDAD/data/master/AWS-KSNetStation.txt
COMPARE Compare rough file sizes for same hour on known good system. Hour: 20250415_11
-rw-r-----. 1 337008 Apr 15 12:55 /opt/ldm/madis/dr/decode/data/fxa/LDAD/crn/netCDF/20250415_1100
-rw-r-----. 1 66244 Apr 15 12:55 /opt/ldm/madis/dr/decode/data/fxa/LDAD/hcn/netCDF/20250415_1100
-rw-r-----. 1 11222996 Apr 16 13:31 /opt/ldm/madis/dr/decode/data/fxa/LDAD/hydro/netCDF/20250415_1100
-rwxr-x---. 1 254785888 Apr 16 11:40 /opt/ldm/madis/dr/decode/data/fxa/LDAD/mesonet/netCDF/20250415_1100
-rw-r-----. 1 101988 Apr 16 12:55 /opt/ldm/madis/dr/decode/data/fxa/LDAD/nepp/netCDF/20250415_1100
-rw-r-----. 1 18209500 Apr 15 13:28 /opt/ldm/madis/dr/decode/data/fxa/LDAD/rwis/netCDF/20250415_1100
-rw-r-----. 1 2489784 Apr 16 13:31 /opt/ldm/madis/dr/decode/data/fxa/LDAD/snow/netCDF/20250415_1100
-rw-r-----. 1 4123320 Apr 15 12:06 /opt/ldm/madis/dr/decode/data/fxa/LDAD/urbanet/netCDF/20250415_1100
-rw-r--r--. 1 413180 Apr 15 15:14 /opt/ldm/madis/dr/sfc/iqc1/qcms_data/buoy/20250415_1100
-rw-r--r--. 1 295228 Apr 16 12:18 /opt/ldm/madis/dr/sfc/iqc1/qcms_data/crn/20250415_1100
-rw-r--r--. 1 69692 Apr 16 11:18 /opt/ldm/madis/dr/sfc/iqc1/qcms_data/hcn/20250415_1100
-rw-r--r--. 1 5238052 Apr 16 11:18 /opt/ldm/madis/dr/sfc/iqc1/qcms_data/hydro/20250415_1100
-rw-r--r--. 1 108919212 Apr 16 12:18 /opt/ldm/madis/dr/sfc/iqc1/qcms_data/mesonet/20250415_1100
-rw-r--r--. 1 5548004 Apr 15 15:14 /opt/ldm/madis/dr/sfc/iqc1/qcms_data/metar/20250415_1100
-rw-r--r--. 1 72928 Apr 16 11:18 /opt/ldm/madis/dr/sfc/iqc1/qcms_data/nepp/20250415_1100
-rw-r--r--. 1 1607792 Apr 16 12:18 /opt/ldm/madis/dr/sfc/iqc1/qcms_data/urbanet/20250415_1100
-rw-r--r--. 1 150060 Apr 15 12:17 /opt/ldm/madis/dr/sfc/iqc2/qcms_data/buoy/20250415_1100
-rw-r--r--. 1 151480 Apr 16 12:20 /opt/ldm/madis/dr/sfc/iqc2/qcms_data/crn/20250415_1100
-rw-r--r--. 1 69692 Apr 16 11:20 /opt/ldm/madis/dr/sfc/iqc2/qcms_data/hcn/20250415_1100
-rw-r--r--. 1 2393000 Apr 16 11:20 /opt/ldm/madis/dr/sfc/iqc2/qcms_data/hydro/20250415_1100
-rw-r--r--. 1 70763564 Apr 16 12:20 /opt/ldm/madis/dr/sfc/iqc2/qcms_data/mesonet/20250415_1100
-rw-r--r--. 1 1396964 Apr 15 13:17 /opt/ldm/madis/dr/sfc/iqc2/qcms_data/metar/20250415_1100
-rw-r--r--. 1 72928 Apr 16 11:20 /opt/ldm/madis/dr/sfc/iqc2/qcms_data/nepp/20250415_1100
-rw-r--r--. 1 1543952 Apr 16 12:20 /opt/ldm/madis/dr/sfc/iqc2/qcms_data/urbanet/20250415_1100
-rw-r--r--. 1 225564 Apr 15 15:28 /opt/ldm/madis/dr/sfc/iqc3/qcms_data/buoy/20250415_1100
-rw-r--r--. 1 123892 Apr 16 11:32 /opt/ldm/madis/dr/sfc/iqc3/qcms_data/crn/20250415_1100
-rw-r--r--. 1 69692 Apr 16 11:32 /opt/ldm/madis/dr/sfc/iqc3/qcms_data/hcn/20250415_1100
-rw-r--r--. 1 3388708 Apr 16 11:32 /opt/ldm/madis/dr/sfc/iqc3/qcms_data/hydro/20250415_1100
-rw-r--r--. 1 94009152 Apr 16 12:32 /opt/ldm/madis/dr/sfc/iqc3/qcms_data/mesonet/20250415_1100
-rw-r--r--. 1 2667300 Apr 15 13:28 /opt/ldm/madis/dr/sfc/iqc3/qcms_data/metar/20250415_1100
-rw-r--r--. 1 72928 Apr 16 11:32 /opt/ldm/madis/dr/sfc/iqc3/qcms_data/nepp/20250415_1100
-rw-r--r--. 1 1408292 Apr 16 12:32 /opt/ldm/madis/dr/sfc/iqc3/qcms_data/urbanet/20250415_1100
-rw-r--r--. 1 756380 Apr 15 15:29 /opt/ldm/madis/dr/sfc/iqc4/qcms_data/buoy/20250415_1100
-rw-r--r--. 1 112276 Apr 16 11:34 /opt/ldm/madis/dr/sfc/iqc4/qcms_data/crn/20250415_1100
-rw-r--r--. 1 88832 Apr 16 11:34 /opt/ldm/madis/dr/sfc/iqc4/qcms_data/hcn/20250415_1100
-rw-r--r--. 1 6253024 Apr 16 11:34 /opt/ldm/madis/dr/sfc/iqc4/qcms_data/hydro/20250415_1100
-rw-r--r--. 1 121085292 Apr 16 12:35 /opt/ldm/madis/dr/sfc/iqc4/qcms_data/mesonet/20250415_1100
-rw-r--r--. 1 2384676 Apr 15 13:29 /opt/ldm/madis/dr/sfc/iqc4/qcms_data/metar/20250415_1100
-rw-r--r--. 1 72928 Apr 16 11:34 /opt/ldm/madis/dr/sfc/iqc4/qcms_data/nepp/20250415_1100
-rw-r--r--. 1 7518312 Apr 16 12:35 /opt/ldm/madis/dr/sfc/iqc4/qcms_data/urbanet/20250415_1100
-rw-r--r--. 1 408604 Apr 15 15:42 /opt/ldm/madis/dr/sfc/iqc5/qcms_data/buoy/20250415_1100
-rw-r--r--. 1 120988 Apr 16 12:48 /opt/ldm/madis/dr/sfc/iqc5/qcms_data/crn/20250415_1100
-rw-r--r--. 1 69692 Apr 16 11:47 /opt/ldm/madis/dr/sfc/iqc5/qcms_data/hcn/20250415_1100
-rw-r--r--. 1 8251664 Apr 16 11:47 /opt/ldm/madis/dr/sfc/iqc5/qcms_data/hydro/20250415_1100
-rw-r--r--. 1 135409088 Apr 16 12:48 /opt/ldm/madis/dr/sfc/iqc5/qcms_data/mesonet/20250415_1100
-rw-r--r--. 1 1943076 Apr 15 15:42 /opt/ldm/madis/dr/sfc/iqc5/qcms_data/metar/20250415_1100
-rw-r--r--. 1 142624 Apr 16 12:48 /opt/ldm/madis/dr/sfc/iqc5/qcms_data/nepp/20250415_1100
-rw-r--r--. 1 3738452 Apr 16 12:48 /opt/ldm/madis/dr/sfc/iqc5/qcms_data/urbanet/20250415_1100
-rw-r--r--. 1 465112 Apr 16 12:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/crn/20250415_1100
-rw-r--r--. 1 88832 Apr 16 12:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/hcn/20250415_1100
-rw-r--r--. 1 16915648 Apr 16 12:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/hydro/20250415_1100
-rw-r--r--. 1 455207284 Apr 16 12:07 /opt/ldm/madis/dr/sfc/ao/qcms_data/mesonet/20250415_1100
-rw-r--r--. 1 142624 Apr 16 12:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/nepp/20250415_1100
-rw-r--r--. 1 12274392 Apr 16 12:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/urbanet/20250415_1100
COMPARE Compare rough file sizes for same hour on known good system. Hour: 20250415_1100
-rw-r--r--. 1 5539444 Apr 16 12:19 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/buoy/20250415_1100
-rw-r--r--. 1 465112 Apr 16 12:19 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/crn/20250415_1100
-rw-r--r--. 1 88832 Apr 16 12:19 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/hcn/20250415_1100
-rw-r--r--. 1 18552288 Apr 16 12:19 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/hfmetar/20250415_1100
-rw-r--r--. 1 26061232 Apr 16 12:19 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/hydro/20250415_1100
-rw-r--r--. 1 690684848 Apr 16 12:16 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/mesonet/20250415_1100
-rw-r--r--. 1 12038052 Apr 16 12:19 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/metar/20250415_1100
-rw-r--r--. 1 142624 Apr 16 12:19 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/nepp/20250415_1100
-rw-r--r--. 1 12274392 Apr 16 12:19 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/urbanet/20250415_1100
-rw-r--r--. 1 465112 Apr 16 12:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/crn/20250415_1100
-rw-r--r--. 1 88832 Apr 16 12:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/hcn/20250415_1100
-rw-r--r--. 1 16915648 Apr 16 12:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/hydro/20250415_1100
-rw-r--r--. 1 455207284 Apr 16 12:07 /opt/ldm/madis/dr/sfc/ao/qcms_data/mesonet/20250415_1100
-rw-r--r--. 1 142624 Apr 16 12:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/nepp/20250415_1100
-rw-r--r--. 1 12274392 Apr 16 12:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/urbanet/20250415_1100
COMPARE Compare rough file sizes for same hour on known good system. Hour: 20250415_1000
-rw-r--r--. 1 5560036 Apr 16 11:19 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/buoy/20250415_1000
-rw-r--r--. 1 441880 Apr 16 11:19 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/crn/20250415_1000
-rw-r--r--. 1 88832 Apr 16 11:19 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/hcn/20250415_1000
-rw-r--r--. 1 18740564 Apr 16 11:19 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/hfmetar/20250415_1000
-rw-r--r--. 1 21396936 Apr 16 11:19 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/hydro/20250415_1000
-rw-r--r--. 1 674904208 Apr 16 11:16 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/mesonet/20250415_1000
-rw-r--r--. 1 12076324 Apr 16 11:19 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/metar/20250415_1000
-rw-r--r--. 1 142624 Apr 16 11:19 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/nepp/20250415_1000
-rw-r--r--. 1 12314292 Apr 16 11:19 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/urbanet/20250415_1000
-rw-r--r--. 1 441880 Apr 16 11:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/crn/20250415_1000
-rw-r--r--. 1 88832 Apr 16 11:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/hcn/20250415_1000
-rw-r--r--. 1 12324796 Apr 16 11:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/hydro/20250415_1000
-rw-r--r--. 1 443977904 Apr 16 11:07 /opt/ldm/madis/dr/sfc/ao/qcms_data/mesonet/20250415_1000
-rw-r--r--. 1 142624 Apr 16 11:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/nepp/20250415_1000
-rw-r--r--. 1 12314292 Apr 16 11:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/urbanet/20250415_1000