MADIS DR RUN-TIME STATUS for Thu Apr 17 05:32:01 GMT 2025 on vm-bldr-madis-ops-recovery1
INFO Node name: vm-bldr-madis-ops-recovery1
PASS METAR processing tbl exists: 179538 Apr 15 17:30 /opt/ldm/madis/dr/decode/data/fxa/LDAD/data/NonFedAWOSStation.tbl
PASS Station update flag exists: 0 Jul 18 2024 /opt/ldm/madis/dr/decode/awips/fxa/GO-UPDATE-STATIONS
PASS Metar station table exists: 1121683 May 20 2024 /opt/ldm/madis/dr/sfc/iqc1/fslparms/lsfc.tbl
PASS Accept/reject|autorej files exists: AO: 3 IQC: 3 NON-SFC:
PASS Persistent processes exists: pqact (1+): 1 ldmd (1+): 9 DECODE (4): 5
PASS Dcmetr check: CNT-LDAD.raw: 691
PASS Load resource check: 60% of the time M15 < 9 Samples: 332 %<60: 100% #10=+ 0 #9 0 #8 0 #7 0
PASS Open file resource check: < 5000 Max files: -1 #<1000: 332 #<10000 332
FAIL Process count check: < 1000 Max Processes: 1004G
PASS AO Throughput test: <20 delayed %Delayed: 0% #Sample: 4 #Delayed: 0
PASS IQC Throughput test: <30 delayed #Delayed: 0 Competed timely: 33
PASS No '0' length Station table files in data: #: 0
PASS No '0' length Station table files in master: #: 0
PASS No netcdf-4.1 netCDF lib connection for routerStoreNetCDF:
PASS Shefdecoder check 20250416_0300: #CPYRMA: 2 #NJWXNET: 659 #NERRS: 0
COMPARE UNIQUE mesonet provider cnt for 20250416_0300: 30
WARN DR_SendFile2LDM is NOT updating MADIS netcdf common data directories
COMPARE DECODE STN TBLS 149 Newest: 4318 Apr 16 15:00 /opt/ldm/madis/dr/decode/data/fxa/LDAD/data/YPGStation.txt Oldest: 8848 Jul 18 2024 /opt/ldm/madis/dr/decode/data/fxa/LDAD/data/AWS-GANetStation.txt
COMPARE PRE-DECODE STN TBLS 149 Newest: 4318 Apr 16 15:00 /opt/ldm/madis/dr/decode/data/fxa/LDAD/data/master/YPGStation.txt Oldest: 1568 Jul 18 2024 /opt/ldm/madis/dr/decode/data/fxa/LDAD/data/master/AWS-KSNetStation.txt
COMPARE Compare rough file sizes for same hour on known good system. Hour: 20250416_03
-rw-r-----. 1 317476 Apr 16 04:55 /opt/ldm/madis/dr/decode/data/fxa/LDAD/crn/netCDF/20250416_0300
-rw-r-----. 1 66244 Apr 16 04:55 /opt/ldm/madis/dr/decode/data/fxa/LDAD/hcn/netCDF/20250416_0300
-rw-r-----. 1 7690292 Apr 17 05:08 /opt/ldm/madis/dr/decode/data/fxa/LDAD/hydro/netCDF/20250416_0300
-rwxr-x---. 1 240801456 Apr 17 04:00 /opt/ldm/madis/dr/decode/data/fxa/LDAD/mesonet/netCDF/20250416_0300
-rw-r-----. 1 101988 Apr 17 04:55 /opt/ldm/madis/dr/decode/data/fxa/LDAD/nepp/netCDF/20250416_0300
-rw-r-----. 1 18035268 Apr 16 05:07 /opt/ldm/madis/dr/decode/data/fxa/LDAD/rwis/netCDF/20250416_0300
-rw-r-----. 1 544484 Apr 17 01:01 /opt/ldm/madis/dr/decode/data/fxa/LDAD/snow/netCDF/20250416_0300
-rw-r-----. 1 4116504 Apr 16 04:06 /opt/ldm/madis/dr/decode/data/fxa/LDAD/urbanet/netCDF/20250416_0300
-rw-r--r--. 1 473812 Apr 16 07:15 /opt/ldm/madis/dr/sfc/iqc1/qcms_data/buoy/20250416_0300
-rw-r--r--. 1 267640 Apr 17 04:18 /opt/ldm/madis/dr/sfc/iqc1/qcms_data/crn/20250416_0300
-rw-r--r--. 1 69692 Apr 17 03:18 /opt/ldm/madis/dr/sfc/iqc1/qcms_data/hcn/20250416_0300
-rw-r--r--. 1 4859996 Apr 17 03:18 /opt/ldm/madis/dr/sfc/iqc1/qcms_data/hydro/20250416_0300
-rw-r--r--. 1 102725972 Apr 17 04:18 /opt/ldm/madis/dr/sfc/iqc1/qcms_data/mesonet/20250416_0300
-rw-r--r--. 1 5203556 Apr 16 07:15 /opt/ldm/madis/dr/sfc/iqc1/qcms_data/metar/20250416_0300
-rw-r--r--. 1 72928 Apr 17 03:18 /opt/ldm/madis/dr/sfc/iqc1/qcms_data/nepp/20250416_0300
-rw-r--r--. 1 1605132 Apr 17 04:18 /opt/ldm/madis/dr/sfc/iqc1/qcms_data/urbanet/20250416_0300
-rw-r--r--. 1 148916 Apr 16 04:17 /opt/ldm/madis/dr/sfc/iqc2/qcms_data/buoy/20250416_0300
-rw-r--r--. 1 150028 Apr 17 04:20 /opt/ldm/madis/dr/sfc/iqc2/qcms_data/crn/20250416_0300
-rw-r--r--. 1 69692 Apr 17 03:20 /opt/ldm/madis/dr/sfc/iqc2/qcms_data/hcn/20250416_0300
-rw-r--r--. 1 2123304 Apr 17 03:20 /opt/ldm/madis/dr/sfc/iqc2/qcms_data/hydro/20250416_0300
-rw-r--r--. 1 66858076 Apr 17 04:20 /opt/ldm/madis/dr/sfc/iqc2/qcms_data/mesonet/20250416_0300
-rw-r--r--. 1 1363108 Apr 16 05:17 /opt/ldm/madis/dr/sfc/iqc2/qcms_data/metar/20250416_0300
-rw-r--r--. 1 72928 Apr 17 03:20 /opt/ldm/madis/dr/sfc/iqc2/qcms_data/nepp/20250416_0300
-rw-r--r--. 1 1533312 Apr 17 04:20 /opt/ldm/madis/dr/sfc/iqc2/qcms_data/urbanet/20250416_0300
-rw-r--r--. 1 231284 Apr 16 07:29 /opt/ldm/madis/dr/sfc/iqc3/qcms_data/buoy/20250416_0300
-rw-r--r--. 1 123892 Apr 17 03:31 /opt/ldm/madis/dr/sfc/iqc3/qcms_data/crn/20250416_0300
-rw-r--r--. 1 69692 Apr 17 03:31 /opt/ldm/madis/dr/sfc/iqc3/qcms_data/hcn/20250416_0300
-rw-r--r--. 1 2842092 Apr 17 03:31 /opt/ldm/madis/dr/sfc/iqc3/qcms_data/hydro/20250416_0300
-rw-r--r--. 1 89519604 Apr 17 04:32 /opt/ldm/madis/dr/sfc/iqc3/qcms_data/mesonet/20250416_0300
-rw-r--r--. 1 2604004 Apr 16 05:28 /opt/ldm/madis/dr/sfc/iqc3/qcms_data/metar/20250416_0300
-rw-r--r--. 1 72928 Apr 17 03:31 /opt/ldm/madis/dr/sfc/iqc3/qcms_data/nepp/20250416_0300
-rw-r--r--. 1 1405632 Apr 17 04:32 /opt/ldm/madis/dr/sfc/iqc3/qcms_data/urbanet/20250416_0300
-rw-r--r--. 1 764388 Apr 16 07:30 /opt/ldm/madis/dr/sfc/iqc4/qcms_data/buoy/20250416_0300
-rw-r--r--. 1 112276 Apr 17 03:33 /opt/ldm/madis/dr/sfc/iqc4/qcms_data/crn/20250416_0300
-rw-r--r--. 1 88832 Apr 17 03:33 /opt/ldm/madis/dr/sfc/iqc4/qcms_data/hcn/20250416_0300
-rw-r--r--. 1 4012380 Apr 17 03:34 /opt/ldm/madis/dr/sfc/iqc4/qcms_data/hydro/20250416_0300
-rw-r--r--. 1 114288156 Apr 17 04:34 /opt/ldm/madis/dr/sfc/iqc4/qcms_data/mesonet/20250416_0300
-rw-r--r--. 1 2277220 Apr 16 05:29 /opt/ldm/madis/dr/sfc/iqc4/qcms_data/metar/20250416_0300
-rw-r--r--. 1 72928 Apr 17 03:33 /opt/ldm/madis/dr/sfc/iqc4/qcms_data/nepp/20250416_0300
-rw-r--r--. 1 7512992 Apr 17 04:34 /opt/ldm/madis/dr/sfc/iqc4/qcms_data/urbanet/20250416_0300
-rw-r--r--. 1 424620 Apr 16 07:43 /opt/ldm/madis/dr/sfc/iqc5/qcms_data/buoy/20250416_0300
-rw-r--r--. 1 122440 Apr 17 04:48 /opt/ldm/madis/dr/sfc/iqc5/qcms_data/crn/20250416_0300
-rw-r--r--. 1 69692 Apr 17 03:47 /opt/ldm/madis/dr/sfc/iqc5/qcms_data/hcn/20250416_0300
-rw-r--r--. 1 5445140 Apr 17 03:47 /opt/ldm/madis/dr/sfc/iqc5/qcms_data/hydro/20250416_0300
-rw-r--r--. 1 127161720 Apr 17 04:48 /opt/ldm/madis/dr/sfc/iqc5/qcms_data/mesonet/20250416_0300
-rw-r--r--. 1 2031396 Apr 16 07:43 /opt/ldm/madis/dr/sfc/iqc5/qcms_data/metar/20250416_0300
-rw-r--r--. 1 142624 Apr 17 04:48 /opt/ldm/madis/dr/sfc/iqc5/qcms_data/nepp/20250416_0300
-rw-r--r--. 1 3733132 Apr 17 04:48 /opt/ldm/madis/dr/sfc/iqc5/qcms_data/urbanet/20250416_0300
-rw-r--r--. 1 437524 Apr 17 04:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/crn/20250416_0300
-rw-r--r--. 1 88832 Apr 17 04:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/hcn/20250416_0300
-rw-r--r--. 1 11581928 Apr 17 04:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/hydro/20250416_0300
-rw-r--r--. 1 430138988 Apr 17 04:07 /opt/ldm/madis/dr/sfc/ao/qcms_data/mesonet/20250416_0300
-rw-r--r--. 1 142624 Apr 17 04:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/nepp/20250416_0300
-rw-r--r--. 1 12253112 Apr 17 04:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/urbanet/20250416_0300
COMPARE Compare rough file sizes for same hour on known good system. Hour: 20250416_0300
-rw-r--r--. 1 5057820 Apr 17 04:18 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/buoy/20250416_0300
-rw-r--r--. 1 437524 Apr 17 04:18 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/crn/20250416_0300
-rw-r--r--. 1 88832 Apr 17 04:18 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/hcn/20250416_0300
-rw-r--r--. 1 18869712 Apr 17 04:18 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/hfmetar/20250416_0300
-rw-r--r--. 1 20761224 Apr 17 04:18 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/hydro/20250416_0300
-rw-r--r--. 1 661700044 Apr 17 04:15 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/mesonet/20250416_0300
-rw-r--r--. 1 11583204 Apr 17 04:18 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/metar/20250416_0300
-rw-r--r--. 1 142624 Apr 17 04:18 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/nepp/20250416_0300
-rw-r--r--. 1 12253112 Apr 17 04:18 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/urbanet/20250416_0300
-rw-r--r--. 1 437524 Apr 17 04:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/crn/20250416_0300
-rw-r--r--. 1 88832 Apr 17 04:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/hcn/20250416_0300
-rw-r--r--. 1 11581928 Apr 17 04:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/hydro/20250416_0300
-rw-r--r--. 1 430138988 Apr 17 04:07 /opt/ldm/madis/dr/sfc/ao/qcms_data/mesonet/20250416_0300
-rw-r--r--. 1 142624 Apr 17 04:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/nepp/20250416_0300
-rw-r--r--. 1 12253112 Apr 17 04:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/urbanet/20250416_0300
COMPARE Compare rough file sizes for same hour on known good system. Hour: 20250416_0200
-rw-r--r--. 1 5343820 Apr 17 03:18 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/buoy/20250416_0200
-rw-r--r--. 1 436072 Apr 17 03:18 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/crn/20250416_0200
-rw-r--r--. 1 18964628 Apr 17 03:18 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/hfmetar/20250416_0200
-rw-r--r--. 1 20699820 Apr 17 03:18 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/hydro/20250416_0200
-rw-r--r--. 1 682662288 Apr 17 03:16 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/mesonet/20250416_0200
-rw-r--r--. 1 11438948 Apr 17 03:18 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/metar/20250416_0200
-rw-r--r--. 1 142624 Apr 17 03:18 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/nepp/20250416_0200
-rw-r--r--. 1 12287692 Apr 17 03:18 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/urbanet/20250416_0200
-rw-r--r--. 1 436072 Apr 17 03:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/crn/20250416_0200
-rw-r--r--. 1 88832 Apr 17 03:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/hcn/20250416_0200
-rw-r--r--. 1 11515708 Apr 17 03:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/hydro/20250416_0200
-rw-r--r--. 1 449963968 Apr 17 03:07 /opt/ldm/madis/dr/sfc/ao/qcms_data/mesonet/20250416_0200
-rw-r--r--. 1 142624 Apr 17 03:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/nepp/20250416_0200
-rw-r--r--. 1 12287692 Apr 17 03:08 /opt/ldm/madis/dr/sfc/ao/qcms_data/urbanet/20250416_0200