[mcidas-x] 20260403: Re: 20260402: Re: [External] Re: Are tornado watches and severe warnings plotting?

  • To: "Sebenste, Gilbert" <sebensteg@xxxxxxx>
  • Subject: [mcidas-x] 20260403: Re: 20260402: Re: [External] Re: Are tornado watches and severe warnings plotting?
  • From: Tom Yoksas <tyoksas@xxxxxxxxx>
  • Date: Fri, 3 Apr 2026 00:11:22 -0600
Hi Gilbert,

On 4/2/26 19:43, Sebenste, Gilbert wrote:
That is so weird, because now that we are on new hardware, a new OS,
we have the exact same issue: severe thunderstorm warnings and weather
watches show up intermittently, if at all. I can't blame slow hardware now.

Actually, the problem is likely that the backing store files for textual
products for a day are exceeding the maximum size allowed for product
storage and product indexes into the file.  See below for more details.

re:
I am going to try replacing DDS with DDS|PPS. Do you think that will be acceptable to the XCD decoder?

This is not the problem, and, quite frankly, it will not work since
the case statement in the Bourne shell script 'xcd_run' does not
handle this possibility:

xcd_run
 ...

case $1 in
    DDS)     exec ingetext.k DDS;;
    IDS)     exec ingetext.k DDS;;
    PPS)     exec ingetext.k DDS;;
    DDPLUS)  exec ingetext.k DDS;;
    HRS)     exec ingebin.k  HRS;;
    HDS)     exec ingebin.k  HRS;;
    GRID)    exec ingebin.k  HRS;;
    NCON)    exec ingebin.k  NCON;;
    MONITOR)
# McIDAS environment in which to run STARTXCD
# NB: Change POKEd value to 0 _IF_ you want XCD decoders to dump core files
mcenv << EOF
ucu.k POKE 142 1
exec startxcd.k
EOF
;;
    *)       echo "xcd_run action $1 incorrectly specified, failing...";;
esac


What the likely cause of the problem is:

For several months, large binary products (like GRIB messages) have
been distributed in the IDS|DDPLUS feed, and these products are causing
the backing store files (*.XCD) to grow beyond their designed size limit
(which is the size of a 32-bit unsigned integer).

What you need to do is change your LDM pattern-action file to _not_
send those large, binary products to the McIDAS-XCD textual ingester
'ingetext.k':

change:

IDS|DDPLUS      .*      PIPE
        /path-to/xcd_run DDS

to:

IDS|DDPLUS      ^([^LS]|S[^DR]|SD[^C]|SDC[^N])  PIPE
        /path-to/xcd_run DDS

After making this change, you will need to stop your LDM,
delete the overly large *.XCD files and all pointer files
for each day where the *.XCD are too large, and then restart
the LDM.

On Unidata systems running ADDE servers, the *.XCD files live
in:

/data/ldm/pub/decoded/mcidas

The size of the *.XCD files being kept there are currently:

/data/ldm/pub/decoded/mcidas: ls -alt *.XCD
-rw-rw-r-- 1 ldm ldm  307114080 Apr  3 05:58 DD260930.XCD
-rw-rw-r-- 1 ldm ldm 1304067600 Apr  2 23:59 DD260920.XCD
-rw-rw-r-- 1 ldm ldm 1307784000 Apr  1 23:59 DD260910.XCD
-rw-rw-r-- 1 ldm ldm 1295336640 Mar 31 23:59 DD260900.XCD

The index files for these files should live in the same directory,
and will have an .IDX suffix.

Since it is most likely that the *.XCD files on your system are all
too large, the simplest thing to do is simply delete all of the *.XCD
and *.IDX files:

<in the directory that contain the *.XCD and *.IDX files on your
machine(s)>

rm -f *.XCD *.IDX

NB: it is NOT sufficient to just delete the *.XCD files; the *.IDX
files must be deleted also!

It is only after all of these files have been deleted that you can
safely restart your LDM.

Please let me know if you would like a detailed explanation for
the regular expression I have included above, and if you like
more information on the root cause of this problem (which is
not the NOAAPort ingester or LDM).

Cheers,

Tom

On Apr 2, 2026, at 6:32 PM, Tom Yoksas <tyoksas@xxxxxxxxx> wrote:

Hi Gilbert,

On 4/2/26 15:56, Sebenste, Gilbert wrote:
I was using ADDE.UCAR.EDU.
I just switched to that, and I will see if that fixes it.
On another note, I am using
this in my pqact for McIDAS. Is this what you are using?
IDS|DDPLUS .* PIPE
                    /path-to/xcd_run DDS
Is that what you are using?

That is how I advised Unidata McIDAS-X users to setup McIDAS processing
in the LDM, and it is what Unidata's McIDAS/LDM instances are setup.

Cheers,

Tom

On Apr 2, 2026, at 3:59 PM, Becky Schaffer <beckys@xxxxxxxxxxxxx> wrote:



CAUTION: This email originated from outside of COD’s system. Do not click 
links, open attachments, or respond with sensitive information unless you recognize 
the sender and know the content is safe.

Hi Gilbert,

What server are you using for RTWXTEXT?   I did a DATALOC ADD RTWXTEXT 
ADDE.UNIDATA.UCAR.EDU and I'm seeing the following with WWDISP USA.

Becky

<b3dBYJmq5VlikmQz.png>



On 4/2/2026 3:34 PM, Sebenste, Gilbert wrote:
Hello everyone,

I'm trying to figure out something. We make background overlays for our 
satellite imagery here, and severe convective warnings and weather watches are 
not plotting through McIDAS. Is anybody else having this issue?

Gilbert Sebenste
Meteorology Support Analyst
College of DuPage

_________________________________________________________
NOTE: All exchanges posted to NSF Unidata maintained email lists are
made publicly available through the web. Users who post to any of the
lists we maintain are reminded to remove any personal information that
they do not want to be made public.

NSF Unidata mcidas-x Mailing List
(mcidas-x@xxxxxxxxxxxxxxxx)
For list information, to unsubscribe, or change your membership options,
visit:https://urldefense.com/v3/__https://mailinglists.unidata.ucar.edu/ 
listinfo/mcidas-x/__;!!Mak6IKo!J0BZwB- 
bsUOWnc2I3lV7H9laD_61untihiOud9llaeDZXAdE55IoZrLGNvttJMJ7dIfhusg5HtXhxxtIOFIr1w$

_________________________________________________________
NOTE: All exchanges posted to NSF Unidata maintained email lists are
made publicly available through the web. Users who post to any of the
lists we maintain are reminded to remove any personal information that
they do not want to be made public.
NSF Unidata mcidas-x Mailing List
(mcidas-x@xxxxxxxxxxxxxxxx)
For list information, to unsubscribe, or change your membership options,
visit: https://mailinglists.unidata.ucar.edu/listinfo/mcidas-x/

--
+----------------------------------------------------------------------+
* Tom Yoksas                                                           +
* 230 Nightshade Dr.                                                   +
* Boulder, CO 80302                                                    +
* 303.258.0906                                                         +
+----------------------------------------------------------------------+

_________________________________________________________
NOTE: All exchanges posted to NSF Unidata maintained email lists are
made publicly available through the web. Users who post to any of the
lists we maintain are reminded to remove any personal information that
they do not want to be made public.

NSF Unidata mcidas-x Mailing List
(mcidas-x@xxxxxxxxxxxxxxxx)
For list information, to unsubscribe, or change your membership options,
visit: https://mailinglists.unidata.ucar.edu/listinfo/mcidas-x/

--
+----------------------------------------------------------------------+
* Tom Yoksas                                                           +
* 230 Nightshade Dr.                                                   +
* Boulder, CO 80302                                                    +
* 303.258.0906                                                         +
+----------------------------------------------------------------------+