MADIS DR RUN-TIME STATUS for Wed Apr 16 16:32:01 GMT 2025 on vm-bldr-madis-ops-recovery1
INFO Node name: vm-bldr-madis-ops-recovery1
PASS METAR processing tbl exists: 179538 Apr 15 17:30 /opt/ldm/madis/dr/decode/data/fxa/LDAD/data/NonFedAWOSStation.tbl
PASS Station update flag exists: 0 Jul 18 2024 /opt/ldm/madis/dr/decode/awips/fxa/GO-UPDATE-STATIONS
PASS Metar station table exists: 1121683 May 20 2024 /opt/ldm/madis/dr/sfc/iqc1/fslparms/lsfc.tbl
PASS Accept/reject|autorej files exists: AO: 3 IQC: 3 NON-SFC:
PASS Persistent processes exists: pqact (1+): 1 ldmd (1+): 7 DECODE (4): 5
PASS Dcmetr check: CNT-LDAD.raw: 960
PASS Load resource check: 60% of the time M15 < 9 Samples: 992 %<60: 100% #10=+ 0 #9 0 #8 0 #7 0
PASS Open file resource check: < 5000 Max files: -1 #<1000: 992 #<10000 992
FAIL Process count check: < 1000 Max Processes: 1005G
PASS AO Throughput test: <20 delayed %Delayed: 0% #Sample: 15 #Delayed: 0
PASS IQC Throughput test: <30 delayed #Delayed: 0 Competed timely: 143
PASS No '0' length Station table files in data: #: 0
PASS No '0' length Station table files in master: #: 0
PASS No netcdf-4.1 netCDF lib connection for routerStoreNetCDF:
PASS Shefdecoder check 20250415_1400: #CPYRMA: 25 #NJWXNET: 660 #NERRS: 0
COMPARE UNIQUE mesonet provider cnt for 20250415_1400: 30
WARN DR_SendFile2LDM is NOT updating MADIS netcdf common data directories
COMPARE DECODE STN TBLS 149 Newest: 4318 Apr 16 15:00 /opt/ldm/madis/dr/decode/data/fxa/LDAD/data/YPGStation.txt Oldest: 8848 Jul 18 2024 /opt/ldm/madis/dr/decode/data/fxa/LDAD/data/AWS-GANetStation.txt
COMPARE PRE-DECODE STN TBLS 149 Newest: 4318 Apr 16 15:00 /opt/ldm/madis/dr/decode/data/fxa/LDAD/data/master/YPGStation.txt Oldest: 1568 Jul 18 2024 /opt/ldm/madis/dr/decode/data/fxa/LDAD/data/master/AWS-KSNetStation.txt
COMPARE Compare rough file sizes for same hour on known good system. Hour: 20250415_14
-rw-r-----. 1 318504 Apr 15 17:55 /opt/ldm/madis/dr/decode/data/fxa/LDAD/crn/netCDF/20250415_1400
-rw-r-----. 1 66244 Apr 15 15:55 /opt/ldm/madis/dr/decode/data/fxa/LDAD/hcn/netCDF/20250415_1400
-rw-r-----. 1 8158340 Apr 16 16:31 /opt/ldm/madis/dr/decode/data/fxa/LDAD/hydro/netCDF/20250415_1400
-rwxr-x---. 1 248351152 Apr 16 16:25 /opt/ldm/madis/dr/decode/data/fxa/LDAD/mesonet/netCDF/20250415_1400
-rw-r-----. 1 101988 Apr 16 15:55 /opt/ldm/madis/dr/decode/data/fxa/LDAD/nepp/netCDF/20250415_1400
-rw-r-----. 1 17999220 Apr 15 16:27 /opt/ldm/madis/dr/decode/data/fxa/LDAD/rwis/netCDF/20250415_1400
-rw-r-----. 1 1292784 Apr 16 16:31 /opt/ldm/madis/dr/decode/data/fxa/LDAD/snow/netCDF/20250415_1400
-rw-r-----. 1 4133544 Apr 15 15:06 /opt/ldm/madis/dr/decode/data/fxa/LDAD/urbanet/netCDF/20250415_1400
-rw-r--r--. 1 417756 Apr 15 18:14 /opt/ldm/madis/dr/sfc/iqc1/qcms_data/buoy/20250415_1400
-rw-r--r--. 1 269092 Apr 16 15:18 /opt/ldm/madis/dr/sfc/iqc1/qcms_data/crn/20250415_1400
-rw-r--r--. 1 69692 Apr 16 14:18 /opt/ldm/madis/dr/sfc/iqc1/qcms_data/hcn/20250415_1400
-rw-r--r--. 1 4636052 Apr 16 14:18 /opt/ldm/madis/dr/sfc/iqc1/qcms_data/hydro/20250415_1400
-rw-r--r--. 1 104513416 Apr 16 15:18 /opt/ldm/madis/dr/sfc/iqc1/qcms_data/mesonet/20250415_1400
-rw-r--r--. 1 5478820 Apr 15 18:14 /opt/ldm/madis/dr/sfc/iqc1/qcms_data/metar/20250415_1400
-rw-r--r--. 1 72928 Apr 16 14:18 /opt/ldm/madis/dr/sfc/iqc1/qcms_data/nepp/20250415_1400
-rw-r--r--. 1 1599812 Apr 16 15:18 /opt/ldm/madis/dr/sfc/iqc1/qcms_data/urbanet/20250415_1400
-rw-r--r--. 1 150060 Apr 15 15:17 /opt/ldm/madis/dr/sfc/iqc2/qcms_data/buoy/20250415_1400
-rw-r--r--. 1 150028 Apr 16 15:20 /opt/ldm/madis/dr/sfc/iqc2/qcms_data/crn/20250415_1400
-rw-r--r--. 1 69692 Apr 16 14:20 /opt/ldm/madis/dr/sfc/iqc2/qcms_data/hcn/20250415_1400
-rw-r--r--. 1 2696408 Apr 16 14:20 /opt/ldm/madis/dr/sfc/iqc2/qcms_data/hydro/20250415_1400
-rw-r--r--. 1 68790984 Apr 16 15:20 /opt/ldm/madis/dr/sfc/iqc2/qcms_data/mesonet/20250415_1400
-rw-r--r--. 1 1410212 Apr 15 16:17 /opt/ldm/madis/dr/sfc/iqc2/qcms_data/metar/20250415_1400
-rw-r--r--. 1 72928 Apr 16 14:20 /opt/ldm/madis/dr/sfc/iqc2/qcms_data/nepp/20250415_1400
-rw-r--r--. 1 1533312 Apr 16 15:20 /opt/ldm/madis/dr/sfc/iqc2/qcms_data/urbanet/20250415_1400
-rw-r--r--. 1 233572 Apr 15 18:28 /opt/ldm/madis/dr/sfc/iqc3/qcms_data/buoy/20250415_1400
-rw-r--r--. 1 123892 Apr 16 14:31 /opt/ldm/madis/dr/sfc/iqc3/qcms_data/crn/20250415_1400
-rw-r--r--. 1 69692 Apr 16 14:31 /opt/ldm/madis/dr/sfc/iqc3/qcms_data/hcn/20250415_1400
-rw-r--r--. 1 3239412 Apr 16 14:31 /opt/ldm/madis/dr/sfc/iqc3/qcms_data/hydro/20250415_1400
-rw-r--r--. 1 92367172 Apr 16 15:31 /opt/ldm/madis/dr/sfc/iqc3/qcms_data/mesonet/20250415_1400
-rw-r--r--. 1 2664356 Apr 15 16:28 /opt/ldm/madis/dr/sfc/iqc3/qcms_data/metar/20250415_1400
-rw-r--r--. 1 72928 Apr 16 14:31 /opt/ldm/madis/dr/sfc/iqc3/qcms_data/nepp/20250415_1400
-rw-r--r--. 1 1413612 Apr 16 15:31 /opt/ldm/madis/dr/sfc/iqc3/qcms_data/urbanet/20250415_1400
-rw-r--r--. 1 754092 Apr 15 18:29 /opt/ldm/madis/dr/sfc/iqc4/qcms_data/buoy/20250415_1400
-rw-r--r--. 1 112276 Apr 16 14:34 /opt/ldm/madis/dr/sfc/iqc4/qcms_data/crn/20250415_1400
-rw-r--r--. 1 88832 Apr 16 14:34 /opt/ldm/madis/dr/sfc/iqc4/qcms_data/hcn/20250415_1400
-rw-r--r--. 1 4020808 Apr 16 14:34 /opt/ldm/madis/dr/sfc/iqc4/qcms_data/hydro/20250415_1400
-rw-r--r--. 1 118513224 Apr 16 15:34 /opt/ldm/madis/dr/sfc/iqc4/qcms_data/mesonet/20250415_1400
-rw-r--r--. 1 2458276 Apr 15 16:29 /opt/ldm/madis/dr/sfc/iqc4/qcms_data/metar/20250415_1400
-rw-r--r--. 1 72928 Apr 16 14:34 /opt/ldm/madis/dr/sfc/iqc4/qcms_data/nepp/20250415_1400
-rw-r--r--. 1 7547572 Apr 16 15:34 /opt/ldm/madis/dr/sfc/iqc4/qcms_data/urbanet/20250415_1400
-rw-r--r--. 1 392588 Apr 15 18:42 /opt/ldm/madis/dr/sfc/iqc5/qcms_data/buoy/20250415_1400
-rw-r--r--. 1 122440 Apr 16 15:47 /opt/ldm/madis/dr/sfc/iqc5/qcms_data/crn/20250415_1400
-rw-r--r--. 1 69692 Apr 16 14:47 /opt/ldm/madis/dr/sfc/iqc5/qcms_data/hcn/20250415_1400
-rw-r--r--. 1 5436712 Apr 16 14:47 /opt/ldm/madis/dr/sfc/iqc5/qcms_data/hydro/20250415_1400
-rw-r--r--. 1 132120720 Apr 16 15:47 /opt/ldm/madis/dr/sfc/iqc5/qcms_data/mesonet/20250415_1400
-rw-r--r--. 1 1999012 Apr 15 18:42 /opt/ldm/madis/dr/sfc/iqc5/qcms_data/metar/20250415_1400
-rw-r--r--. 1 142624 Apr 16 15:47 /opt/ldm/madis/dr/sfc/iqc5/qcms_data/nepp/20250415_1400
-rw-r--r--. 1 3759732 Apr 16 15:47 /opt/ldm/madis/dr/sfc/iqc5/qcms_data/urbanet/20250415_1400
-rw-r--r--. 1 438976 Apr 16 15:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/crn/20250415_1400
-rw-r--r--. 1 88832 Apr 16 15:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/hcn/20250415_1400
-rw-r--r--. 1 12276636 Apr 16 15:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/hydro/20250415_1400
-rw-r--r--. 1 443490820 Apr 16 15:07 /opt/ldm/madis/dr/sfc/ao/qcms_data/mesonet/20250415_1400
-rw-r--r--. 1 142624 Apr 16 15:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/nepp/20250415_1400
-rw-r--r--. 1 12306312 Apr 16 15:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/urbanet/20250415_1400
COMPARE Compare rough file sizes for same hour on known good system. Hour: 20250415_1400
-rw-r--r--. 1 5441060 Apr 16 15:18 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/buoy/20250415_1400
-rw-r--r--. 1 438976 Apr 16 15:18 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/crn/20250415_1400
-rw-r--r--. 1 88832 Apr 16 15:18 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/hcn/20250415_1400
-rw-r--r--. 1 18720336 Apr 16 15:18 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/hfmetar/20250415_1400
-rw-r--r--. 1 21581148 Apr 16 15:18 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/hydro/20250415_1400
-rw-r--r--. 1 675411128 Apr 16 15:15 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/mesonet/20250415_1400
-rw-r--r--. 1 12071908 Apr 16 15:18 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/metar/20250415_1400
-rw-r--r--. 1 142624 Apr 16 15:18 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/nepp/20250415_1400
-rw-r--r--. 1 12306312 Apr 16 15:18 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/urbanet/20250415_1400
-rw-r--r--. 1 438976 Apr 16 15:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/crn/20250415_1400
-rw-r--r--. 1 88832 Apr 16 15:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/hcn/20250415_1400
-rw-r--r--. 1 12276636 Apr 16 15:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/hydro/20250415_1400
-rw-r--r--. 1 443490820 Apr 16 15:07 /opt/ldm/madis/dr/sfc/ao/qcms_data/mesonet/20250415_1400
-rw-r--r--. 1 142624 Apr 16 15:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/nepp/20250415_1400
-rw-r--r--. 1 12306312 Apr 16 15:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/urbanet/20250415_1400
COMPARE Compare rough file sizes for same hour on known good system. Hour: 20250415_1300
-rw-r--r--. 1 5510844 Apr 16 14:18 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/buoy/20250415_1300
-rw-r--r--. 1 446236 Apr 16 14:18 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/crn/20250415_1300
-rw-r--r--. 1 88832 Apr 16 14:18 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/hcn/20250415_1300
-rw-r--r--. 1 18815252 Apr 16 14:18 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/hfmetar/20250415_1300
-rw-r--r--. 1 23951824 Apr 16 14:18 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/hydro/20250415_1300
-rw-r--r--. 1 668909328 Apr 16 14:15 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/mesonet/20250415_1300
-rw-r--r--. 1 12051300 Apr 16 14:18 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/metar/20250415_1300
-rw-r--r--. 1 142624 Apr 16 14:18 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/nepp/20250415_1300
-rw-r--r--. 1 12269072 Apr 16 14:18 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/urbanet/20250415_1300
-rw-r--r--. 1 446236 Apr 16 14:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/crn/20250415_1300
-rw-r--r--. 1 88832 Apr 16 14:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/hcn/20250415_1300
-rw-r--r--. 1 14691860 Apr 16 14:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/hydro/20250415_1300
-rw-r--r--. 1 437791276 Apr 16 14:07 /opt/ldm/madis/dr/sfc/ao/qcms_data/mesonet/20250415_1300
-rw-r--r--. 1 142624 Apr 16 14:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/nepp/20250415_1300
-rw-r--r--. 1 12269072 Apr 16 14:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/urbanet/20250415_1300